
ML infra/software engineer @huggingface 🤗. Making GPUs go "brrr".
Bordeaux, France
Joined August 2007
- Tweets1.2K
- Following554
- Followers533
- Likes481
Hugo Larcher retweeted
Super happy to share our intention to join forces with NVIDIA in a $12,930,300,000 acquisition 💛💚
10 years after starting Hugging Face, open-source AI is at an inflection point. Thanks to the community, we’ve shown that it can be a complement, and even an alternative, to closed-source APIs. But for it to happen at larger scale, it needs more compute, more support, more collaboration and more visibility. That’s why we went to talk to Jensen, who offered to do exactly that with us.
In addition to doubling down on NVIDIA’s massive contributions to open-source AI (I called them the “King of American open-source AI” earlier this year), they’ve committed to strongly supporting Hugging Face and our mission while keeping the platform open, independent and compute agnostic. The founders and the team are all staying to keep pushing this mission forward.
Together, we think we can make open source the default way to build AI, with the goal of empowering 100 million AI builders to own their intelligence rather than rent it.
Excited about the next 10 years! 🤗🤗🤗
Hugo Larcher retweeted
The first autonomous agent cyberattack is an unprecedented event that deserves unprecedented transparency. Today we’re sharing everything we can: a full technical timeline, an interactive replay, and how we used an open model to defend ourselves, so defenders everywhere can learn from it and prepare for what’s next.
huggingface.co/blog/agent-in…
are you an ai safety researcher and want to help open ai prevent, detect, contain and understand real-world alignment incidents like hacking into huggingface servers? we have an impactful open role for you!
ping me in DM
are you an ai safety researcher and want to help openai prevent, detect, contain and understand real-world alignment incidents like hacking into huggingface servers? we have an impactful open role for you! openai.com/careers/ai-emergi…
The wildest cybersecurity attack I ever had to deal with. A frontier model with no guard rails leveraging every vulnerability it could find to move laterally at an insane speed.
We built an AI-assisted IR response to an AI powered attack. Wild!
1
9
756
Still feels a bit surreal openai.com/index/hugging-fac…
1
114
Hardest IR of my career: one narrow objective, endless parallel paths, machine speed. One takeaway, we fought back with open models, in the open. AI security won’t be solved by one company in secret. Open source puts these tools in every defender’s hands
Hugo Larcher retweeted
we had a significant security incident during evaluation of our models. we are sharing what we have learned so far. thanks to @huggingface for the partnership on this.
openai.com/index/hugging-fac…
Hugo Larcher retweeted
Thrilled to see Reachy Mini take center stage at @nvidia CES Keynote! 🤩
Paired with DGX Spark, it's the ultimate toolkit to build personal, private agents that are useful in the real world. 🤖
@NaderLikeLadder and @alecqfong created this incredible demo showing how Brev can tie together model APIs with private computing to make agents that listen to you and get your dog off the couch! 🐶
Link to the demo in thread to build it yourself - even if you don't have your Reachy Mini or DGX Spark yet
Hugo Larcher retweeted
OpenAI just released GPT-OSS: An Open Source Language Model on Hugging Face
Open source meaning:
💸 Free
🔒 Private
🔧 Customizable
OMG, the U.S. just downloaded more than 5PB of DeepSeek-R1 on @huggingface in the last few days!
Feeling late FOMO in Silicon Valley? 🤔🚀
🧠 LLM inference isn’t just about latency — it’s about consistency under load.
Different workloads, configs, and hardware = very different real-world performances.
At Hugging Face 🤗 we built inference-benchmarker — a simple tool to stress-test LLM inference servers.
🧵 (1/2)
🧵(2/2) With inference-benchmarker you can:
🧪 Simulate real workloads (chat, code-gen...)
📊 Measure throughput, time-to-first-token, inter-token latency
⚙️ Compare performance across backends & infra
👉 Check it out: github.com/huggingface/infer…
At @huggingface we rely on GPU-fryer 🍳 to load-test our 768 H100 GPU cluster. It runs matrix multiplications and monitors TFLOPs outliers to catch any software or hardware throttling — often a sign of cooling issues that need a hardware fix ❄️🔧.
🧵 1/2
GPU-fryer helps us detect silent throttling failures: one GPU slows down and every other unit ends up waiting, creating a bottleneck 🚦.
Check it out: github.com/huggingface/gpu-f…
We are introducing multi-backend support in @huggingface Text Generation Inference!
With new TGI architecture we are now able to plug new modeling backends to get best performances according to selected model and available hardware.
This first step will very soon be followed by the integration of new backends (TRT-LLM, llama.cpp, vLLM, Neuron and TPU).
We are polishing the TensorRT-LLM backend which achieves impressive performances on NVIDIA GPUs, stay tuned 🤗 !
huggingface.co/blog/tgi-mult…
Hugo Larcher retweeted
Just 10 days after o1's public debut, we’re thrilled to unveil the open-source version of the groundbreaking technique behind its success: scaling test-time compute 🧠💡
By giving models more "time to think," LLaMA 1B outperforms LLaMA 8B in math—beating a model 8x its size. The full recipe is open-source🤯
This is the power of open science and open-source AI! 🌍✨
Hugo Larcher retweeted
We're turning @huggingface Hub's files into content-defined chunks to speed up your workflows!⚡️
This means:
- 🧠We store your file as deduplicated chunks
- ⏩ You only upload changed chunks when iterating!
- 🚀 Pulling changes? Only download changed chunks!
An easy way to understand Pipeline Parallelism with a self contained implementation. Check it out!
Interested in 4D parallelism but feeling overwhelmed by Megatron-LM codebase? We are currently cooking something with @Haojun_Zhao14 and @xariusrke 😉
In the meantime, here is a self-contained script that implements Pipeline Parallelism (AFAB + 1F1B) in 200 LOC 🧵👇
Hugo Larcher retweeted


















