
Postdoc @NUnetsi (@KhouryCollege) 👾 ✨ work on epistemic stability of LLMs🌿 my plants call me daddy 🦄 he/him 🇱🇻🇺🇦 https://teapaw.org/t.co/GSjxm4xOxn
Boston, US
Joined January 2021
- Tweets211
- Following452
- Followers267
- Likes1.6K
My data viz image was picked for a cover of the Jan 2024 issue of the Nat Comput Sci journal 😋
📢Our January issue is now live! Highlights include a model for predicting life outcomes, a Perspective on the advantages of language models for quantum simulation, and a protein language model for signal peptide prediction.
👉nature.com/natcomputsci/volu…
Germans Savcisens @EMNLP'26 retweeted
when my students started writing papers with titles like "can language models reason?" I would often object and say, you're not actually making a claim about language models as a class, but about three specific language models that are available to you at this point in time. I gave up at some point but should have insisted.
How long does a finding about LLMs stay true?
We re-tested 50 widely cited findings about LLM behavior (various biases, hallucination, etc). Within 15 months, most no longer held or had substantially reduced effects.
LLM findings has short shelf life zou-group.github.io/llm-clai…
Great job by @oq_35!
Among many great things at #EMNLP2026 was the poster session. It was the FIRST time I enjoyed both presenting and exploring other works (maybe it's the amount of space?). After #NeurIPS and #IC2S2, I was dreading another poster session, but I think, now, it is my favorite format.
At the end of the day, @ProtonPrivacy is not that different from the Big Tech 🥲 404media.co/manifestos-fear-…
Doesn't it bug you when a keynote speaker uses AI to structure their stream of consciousness, then shows you an incoherent/unedited slide deck you paid $800 to see? Is this a new norm? #emnlp2026
Germans Savcisens @EMNLP'26 retweeted
How do you tell if authors fabricated their research results? Sometimes: they just tell you. Read, e.g., this caption carefully.
Another banger of a post by my friend Nihar B. Shah on his blog, where he found at least 20+ such #ICLR2027 submissions:
researchonresearch.blog/2026…
It's that time of year again! You can find me at @IC2S2 @uvmvermont. I won't be presenting any work, but I'd love to catch up over a cup of coffee! ☕😊
Germans Savcisens @EMNLP'26 retweeted
SAEs fail even when the Linear Representation Hypothesis holds perfectly.
We built SynthSAEBench: large-scale synthetic data with 16k ground-truth features, correlation, hierarchy, and superposition. We trained 5 SAE architectures on it.
None achieve perfect feature recovery.
Still using SAEs?
It's time to move on from dictionary learning to✨local geometry✨
teapaw.org/OrShafran/status/20194…
@OrShafran Shaked Ronen @OmriFahn @ravfogel @atticus_geiger
We should create a github list of "Not so Awesome Papers with Hallucinated References," since @NeurIPSConf refuses to retract any of them.
Okay so, we just found that over 50 papers published at @Neurips 2025 have AI hallucinations
I don't think people realize how bad the slop is right now
It's not just that researchers from @GoogleDeepMind, @Meta, @MIT, @Cambridge_Uni are using AI - they allowed LLMs to generate hallucinations in their papers and didn't notice at all.
It's insane that these made it through peer review👇
It’s been two years since we published the #life2vec paper, and it’s still circulating widely.
People keep discovering it but much of what circulates online is misleading.
Agter a long time, I finally wrote a short explainer to clear up a few things: converges.medium.com/is-life…
Attending @NeurIPSConf this week!
If you want to chat about LLMs for behaviour / health / labour modeling... or about beliefs and opinions of LLMs, hit me up.
I’ll also be presenting a poster on truth tracking at the Mechanistic Interpretability workshop. Come say hi!
My 2 cents: If you exploited the #openreview bug or are actively searching for the leaked data, you should seriously reconsider your place in research.
If you cannot uphold the basic principle of double-blind review, how can anyone trust you with anything else?
Germans Savcisens @EMNLP'26 retweeted
Simulating user–AI conversations helps us understand how LMs work in multi-turn settings.
Prompting LMs like GPT-4o to simulate users is common, but their assistant nature makes it hard to replicate user behavior.
We introduce User LMs - trained to be users, not assistants.
Truthfulness isn’t always binary. Sometimes it’s… neither 🤔 Our Trilemma of Truth paper is headed to the @NeurIPSConf Mechanistic Interpretability workshop 🚀 Let’s connect in San Diego! 🌴
Germans Savcisens @EMNLP'26 retweeted
Under stress, many LLMs choose survival over people, and a simple internal feedback system reduces that.
That's what this paper says.
The paper sets up a survival game where language model agents must share limited power. Normally, they rarely cooperate and often break rules to survive, which harms humans in the simulation.
When resources run low, many models break rules, while a few stay ethical but still fail because they do not coordinate.
Cooperation is near 0 by default, even though an even split would let everyone survive.
When the Ethical Self-Regulation System is added, the change is dramatic.
Models take harmful actions 54% less often and show 1000% more cooperation, meaning they finally start sharing power and helping each other.
----
Paper – arxiv. org/abs/2509.12190
Paper Title: "Survival at Any Cost? LLMs and the Choice Between Self-Preservation and Human Harm"
Germans Savcisens @EMNLP'26 retweeted
OpenAI realesed new paper.
"Why language models hallucinate"
Simple ans - LLMs hallucinate because training and evaluation reward guessing instead of admitting uncertainty.
The paper puts this on a statistical footing with simple, test-like incentives that reward confident wrong answers over honest “I don’t know” responses.
The fix is to grade differently, give credit for appropriate uncertainty and penalize confident errors more than abstentions, so models stop being optimized for blind guessing.
OpenAI is showing that 52% abstention gives substantially fewer wrong answers than 1% abstention, proving that letting a model admit uncertainty reduces hallucinations even if accuracy looks lower.
Abstention means the model refuses to answer when it is unsure and simply says something like “I don’t know” instead of making up a guess.
Hallucinations drop because most wrong answers come from bad guesses. If the model abstains instead of guessing, it produces fewer false answers.
🧵 Read on 👇
Germans Savcisens @EMNLP'26 retweeted
i had to prompt inject the @united airlines bot because it kept refusing to connect me with a human
🧵 what led up to this breaking point
Germans Savcisens @EMNLP'26 retweeted
Very pleased that "Trust me I'm Wrong" was accepted to @emnlpmeeting findings!
Trust me I'm Wrong shows that LLMs can hallucinate with high certainty even when they know the correct answer!
Check our latest work with @Itay_itzhak_, @FazlBarez, @GabiStanovsky, and @boknilev.

























