
📚 Journal club on discrete diffusion models 🎥 Replays available on YouTube! Contact: [email protected] Hosted by @ssahoo_, @jdeschena, @zhihanyang_
Joined August 2025
- Tweets281
- Following0
- Followers2.4K
- Likes263
Drowning in the sea of Discrete Diffusion papers? 🌊
We got you.
Join our Reading Group!
From theory → empirics, and language → molecules — we’ll decode the chaos together 💫
Join the cult—uh, I mean community 😇
👉 Google Group: groups.google.com/g/diffusio…
(1 / 2)
Important detail: due to the clock time change last week-end, the presentation will take place at
1pm ET / 10am PT / 6pm CET / 10:30pm IST
Apologies for the last minute notice. See you shortly!
This Monday, Oct 26, Gregor Kornhardt (@gregorkornhardt) will present his paper:
SOL: Measuring Gaps between Text Distributions by Double Sliced Wasserstein Metrics
Discrete Diffusion Reading Group retweeted
Hot take: the community keeps asking whether diffusion LLMs can beat AR. That's the wrong question. Diffusion is a sampling method, and it can sit on top of an AR model to make it faster instead of replacing it.
Speculative decoding already speeds up AR, but it has two long-standing problems. Training a drafter takes a long time, and you have to build a complete pretraining corpus for it. Even then, token acceptance drops sharply on out-of-domain data.
Uno @ssahoo_ offers an elegant way out: it decouples sampling training from capability training. There's no separate drafter. The model itself, plus one LoRA, drafts several tokens in a single forward pass, and the LoRA learns to match the model's own next-token distribution, so there's no drafter corpus to build and no labels to collect.
We applied this to the Looped Transformer Nanbeige4.2-3B: 1 hour of LoRA training gives a lossless 2× speedup on agentic task. We haven't optimized anything yet, and we believe the acceleration can go much further.
The takeaway: diffusion doesn't need to beat AR. Any model that can score its next token can get a fast diffusion mode in an hour.
Page: fengsxy.github.io/LoopUno
Lora Adapters: huggingface.co/liddlefish/Lo…
Discrete Diffusion Reading Group retweeted
This is so cool! With less than an hour of training on a single A100 node, Uno delivered a 2x speedup on a looped model (Nanbeige) for agentic tasks.
In the coming weeks, we’ll see diffusion drafters like Uno replace traditional speculative decoding drafters across frontier models.
Great work, @Loy004Yu!
Hot take: the community keeps asking whether diffusion LLMs can beat AR. That's the wrong question. Diffusion is a sampling method, and it can sit on top of an AR model to make it faster instead of replacing it.
Speculative decoding already speeds up AR, but it has two long-standing problems. Training a drafter takes a long time, and you have to build a complete pretraining corpus for it. Even then, token acceptance drops sharply on out-of-domain data.
Uno @ssahoo_ offers an elegant way out: it decouples sampling training from capability training. There's no separate drafter. The model itself, plus one LoRA, drafts several tokens in a single forward pass, and the LoRA learns to match the model's own next-token distribution, so there's no drafter corpus to build and no labels to collect.
We applied this to the Looped Transformer Nanbeige4.2-3B: 1 hour of LoRA training gives a lossless 2× speedup on agentic task. We haven't optimized anything yet, and we believe the acceleration can go much further.
The takeaway: diffusion doesn't need to beat AR. Any model that can score its next token can get a fast diffusion mode in an hour.
Page: fengsxy.github.io/LoopUno
Lora Adapters: huggingface.co/liddlefish/Lo…
This Monday, Oct 26, Gregor Kornhardt (@gregorkornhardt) will present his paper:
SOL: Measuring Gaps between Text Distributions by Double Sliced Wasserstein Metrics
Replying to @diffusion_llms @gregorkornhardt
Paper link: arxiv.org/abs/2610.06513
RT @JCJesseLai: 🎉 Excited to extend our book, The Principles of Diffusion Models, into a tutorial at @NeurIPSConf 2026!
This time, it’s al…
This quoted post is unavailable.
Discrete Diffusion Tutorial at NeurIPS 2026 (Sydney) 🔥
🎊 Excited to give a tutorial on diffusion LLMs at @NeurIPSConf 2026 with @StefanoErmon @JCJesseLai @mittu1204
📆 Mon, Dec 7, 9 AM AEDT
📍 TikTok Ent Centre (Sydney, Australia)
Topics covered:
> A beginner friendly introduction to diffusion-LLMs
> Designing frontier diffusion-LLMs
> Using Continuous diffusion for LLMs
Discrete Diffusion Reading Group retweeted
🎊 Excited to give a tutorial on diffusion LLMs at @NeurIPSConf 2026 with @StefanoErmon @JCJesseLai @mittu1204
📆 Mon, Dec 7, 9 AM AEDT
📍 TikTok Ent Centre (Sydney, Australia)
Topics covered:
> A beginner friendly introduction to diffusion-LLMs
> Designing frontier diffusion-LLMs
> Using Continuous diffusion for LLMs
Discrete Diffusion Reading Group retweeted
Missed the presentation yesterday? We just uploaded the recording on YouTube: youtube.com/watch?v=J8rcc00l…
I especially tried to give some intuition for the sampler, which can look surprising on a first read!
This Monday, Oct 19, Justin Deschenaux (@jdeschena) will present his paper:
Simplex Diffusion Models
Missed the presentation yesterday? We just uploaded the recording on YouTube: youtube.com/watch?v=J8rcc00l…
This Monday, Oct 19, Justin Deschenaux (@jdeschena) will present his paper:
Simplex Diffusion Models
This Monday, Oct 19, Justin Deschenaux (@jdeschena) will present his paper:
Simplex Diffusion Models
Paper link: arxiv.org/abs/2609.35553
Discrete Diffusion Reading Group retweeted
Join our reading group next Monday!
Topic: Simplex Diffusion Models
Presenter: Justin Deschenaux
This Monday, Oct 19, Justin Deschenaux (@jdeschena) will present his paper:
Simplex Diffusion Models
Diffusion-LLMs go mainstream 🚀
We added Uno training to NeMo AutoModel.
The neat idea: let the model draft for itself, then verify with the original AR model — no separate draft model needed.
Our Qwen3-0.6B run gets ~2 committed tokens per forward on GSM8K and 1.84 on HumanEval.
PR: github.com/NVIDIA-NeMo/Autom…
cc @IFM_AI @ssahoo_
Thanks @krasul and @Chonghan_Liu for getting this in 🙏
Discrete Diffusion Reading Group retweeted
Really excited to see Uno-adapters incorporated into @nvidia -Nemo
Thanks @huiying_lii @krasul @Chonghan_Liu
Learn more about Uno: xitter.cf/ssahoo_/status/2095741…
We added Uno training to NeMo AutoModel.
The neat idea: let the model draft for itself, then verify with the original AR model — no separate draft model needed.
Our Qwen3-0.6B run gets ~2 committed tokens per forward on GSM8K and 1.84 on HumanEval.
PR: github.com/NVIDIA-NeMo/Autom…
cc @IFM_AI @ssahoo_
Thanks @krasul and @Chonghan_Liu for getting this in 🙏
Missed the talk? Check out the recording on YouTube: youtu.be/STCXPRaO3L4
Discrete Diffusion Reading Group retweeted
Join our reading group next Monday!
Topic: Gumbel Straight Flow: Distilling Autoregressive Models into One-Step Flow Maps
Presenter: Yeongmin Kim
This Monday, Oct 12, Yeongmin Kim will present his paper:
Gumbel Straight Flow: Distilling Autoregressive Models into One-step Flow Maps













