
PhD @Mila_Quebec working on science⇄llms
Montreal, QC
Joined December 2017
- Tweets348
- Following617
- Followers355
- Likes589
Andrei Mircea {at 🇰🇷 ICML} retweeted
🚨✨Today we're introducing Tara Research, and sharing our first public work: a paper accepted at COLM 2026 (with a companion LessWrong post) 🎉.
Who we are: Tara Research is an independent, non-profit AI safety organization. We measure the propensity of AI systems to lie, and we benchmark how well safety techniques prevent it, openly and impartially. We believe that misalignment becomes catastrophic when models hide it. A model that is honest about its actions and goals can be corrected; one that lies cannot.
The paper: "Activation Steering for Aligned Open-ended Generation without Sacrificing Coherence."
We introduce two projection-aware steering methods that correct only the tokens whose activations fall on the misaligned side of a learned decision boundary. They restore honesty as well as classic uniform steering, at a fraction of the capability cost.
Additionally, we find a single honesty direction, extracted with our contrastive dataset, that generalizes and corrects dishonesty across four unrelated settings:
- Instructed lying (MASK benchmark): honesty 53.6% → 81.2%
- Strategic deception (Among Us): crewmate win rate 49% → 95%
- Hidden trained behaviors (AuditBench): discovery rate ~40% → ~85%
- Emergent misalignment: honesty 46.2% → 79.4%
In the last two settings, the vector was extracted from the aligned checkpoint and applied to a model that was subsequently fine-tuned, and it still worked.
This work is by Niklas Herbster, Martin Zborowski, Alberto Tosato, @gauthier_gidel, and @Tommaso_Tosato, in collaboration with @Mila_Quebec and the @TU_Muenchen .
🌐 About us: tararesearch.org
📄 Paper: arxiv.org/abs/2604.08169
📝 Blog post: lesswrong.com/posts/Rpq28FTg…
This is the first of much more to come, including an agentic honesty benchmark. Follow us to stay informed. And if you work on runtime interventions, honesty evaluation, or alignment auditing, we'd love to hear from you.
Andrei Mircea {at 🇰🇷 ICML} retweeted
Really excited about our new paper with @giomonea @yoavartzi @xkianteb !
Keys and Values in LMs are used for the current prediction but also for future predictions; we find that using separate KV states for the present and for the future greatly improves models 👇👇
Andrei Mircea {at 🇰🇷 ICML} retweeted
Can LLM agents figure out that their "private" chain of thought is being monitored, with no hints, no training, just from getting blocked?
Yes. And some then explicitly reason to hide their reasoning.
New paper with @FlemmingKondrup (co-first authors) & @Yoshua_Bengio: "Noticing the Watcher" 🧵
Andrei Mircea {at 🇰🇷 ICML} retweeted
Our work got accepted to #COLM2026!
Andrei Mircea {at 🇰🇷 ICML} retweeted
Thrilled to announce that I will be presenting The Illusion of Superposition at COLM! 🎉
This is my first interp paper and I really enjoyed working on it :)
Thanks again to my amazing co-authors @mariusmosbach and Guillaume Rabusseau
See yall in SF!
Andrei Mircea {at 🇰🇷 ICML} retweeted
Excited to share our latest work: Loss Smoothing for Stable Adaptation Under Distribution Shift.
TL;DR: When adapting a model, don’t abruptly switch to the new objective. Gradually smooth the transition from the old objective to the new one.
Preprint: arxiv.org/abs/2607.00634 🧵
1/n
Andrei Mircea {at 🇰🇷 ICML} retweeted
We don’t always know what problems are hard for LLMs. So devs evaluate on tasks HUMANS find hard or on broad benchmarks. What if we could instead anticipate which scenarios a model will fail on—all without evaluating specific input examples?
🧵NEW PAPER by @jenniferlumeng &al
This is an important problem that IMO is under-addressed because of how difficult it is to measure. Unlike most physical sciences, we can measure things fully and losslessly, but distilling this into measurements that are both interpretable and meaningful is the real challenge.
In film, "we'll fix it in post" is what you say when something went wrong on set and you don't want to redo it. AI research has made it our entire methodology: train the model, then patch whatever comes out. Our new ICML oral argues this can't be the basis of a science of AI. 🧵
4
13
1,718
Our works on measures of gradient alignment for anyone interested:
Gradient dissent - openreview.net/forum?id=tJj3…
Zero-sum learning - mirandrom.github.io/zsl/
Shared gradient discovery - mirandrom.github.io/sgdisco/
1
60
we've been working on gradient alignment between examples as one such abstraction, but I'm curious to know what else is out there besides e.g. influence functions and data attribution, SLT and measures of loss landscape geometry, or older lines of work on implicit regularization.
1
57
studying training dynamics on top of that just makes the problem even more high dimensional, with a limited number of clear measurable abstractions that can support new scientific understanding.
1
64
this was already a challenge for inference interpretability, and a lot of progress has come from reducing the dimensionality of the problem into abstractions like circuits and features that are simultaneously measurable, interpretable and mechanistically meaningful.
2
82
Andrei Mircea {at 🇰🇷 ICML} retweeted
Very excited to have this paper out! We show by having more parameters, larger models see reduced interference between updates. This allows them to retain memories of rarely observed samples of a task, eventually allowing them to learn even the tail-end of the distribution. (1/3)
We take for granted that larger models are better than smaller ones, but why is this so? Our new paper, led by Jing Huang and @EkdeepL, traces this to a data-induced competition for resources (neurons), using formal analysis, idealized tasks, and real pretraining.

ALT Title card for a research paper. The title reads "Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention." Authors listed: Jing Huang, Daniel Wurgaft, Rachit Bansal, Laura Ruis, Naomi Saphra, David Alvarez-Melis, Andrew Lampinen, Christopher Potts, and Ekdeep Singh Lubana. A Goodfire logo appears below the names. Author affiliations: Stanford University, Kempner Institute at Harvard University, MIT, and Anthropic.
Andrei Mircea {at 🇰🇷 ICML} retweeted
New paper:
We present a "Unified Neural Scaling Law" functional form that accurately models & extrapolates the multivariate scaling behaviors of artificial neural networks as the variables listed in this attached video are varied.
(1/N)
Andrei Mircea {at 🇰🇷 ICML} retweeted
for the bright-eyed and bushy-tailed: there's a Learning Mechanics discord! young academics who want to do research in this area should especially consider joining + starting convos.
discord.gg/GTHfUnf7hz
Andrei Mircea {at 🇰🇷 ICML} retweeted
Data used for model merging affects various parts of the merging procedure differently.
Work led by @gauraviyer99.
Poster at @scifordl, Sun 16:15
Andrei Mircea {at 🇰🇷 ICML} retweeted
Per-example gradient alignment shows how the circuits in LLMs are formed.
Works led by @mirandrom.
Poster at @scifordl, Sun 16:15
Andrei Mircea {at 🇰🇷 ICML} retweeted
Latent CoT is an alternative LLM reasoning scheme hypothesized to enable “superposition” allowing models to hold uncertainty over multiple concepts during reasoning 💭
We revisit superposition in 3 latent CoT approaches and find that it is largely an illusion 🔮!
More in 🧵
Andrei Mircea {at 🇰🇷 ICML} retweeted
Collected all responses from twitter, blauski and Slack here:
bennokrojer.com/good-papers.…
Will add over the years
Andrei Mircea {at 🇰🇷 ICML} retweeted
🚨 New Paper 🚨
TL;DR we derive scaling laws of lr, momentum, and batch size for modern first-order optimizers through the lens of recent convergence bounds for LMO, a framework that includes normalized SGD, signSGD (approximating Adam), and Muon
teapaw.org/orvieto_antonio/status…





























