𝙳☈ (@sadasat) header
𝙳☈ (@sadasat) profile picture
Miami 🇺🇸
Joined January 2010
Photo by 𝙳☈ (@sadasat)Photo by 𝙳☈ (@sadasat)Photo by 𝙳☈ (@sadasat)Photo by 𝙳☈ (@sadasat)Photo by 𝙳☈ (@sadasat)Photo by 𝙳☈ (@sadasat)Photo by 𝙳☈ (@sadasat)Photo by 𝙳☈ (@sadasat)Photo by 𝙳☈ (@sadasat)Photo by 𝙳☈ (@sadasat)
We’re entering an era where producing software is becoming dramatically cheaper. But producing more code has never guaranteed producing better systems. The interesting question then isn’t simply how much programming AI can automate. It’s what happens to software engineering when programming itself becomes less of the bottleneck. Here I argue that software engineering has always been, fundamentally, a study of language. So I wrote a meditation on how we arrived at the concepts behind our most influential programming paradigms, and how their histories extend far beyond computers. Because in a future where language can be generated and iterated upon at extraordinary speed, the remedy for inscrutable code and documents isn’t necessarily more code and documents. Perhaps it’s to examine ourselves, to treat our cultural roots as dependencies, and to decide which ones we want to keep. Computer Science is a Social Science sadasant.ai/writing/computer…
2
1
1
8
781
𝙳☈ retweeted
Replying to @Tom62589172
If folks are suspecting a lean bug in the proposed GRH proof, for example, porting it to coq and rechecking it there should add confidence.
1
5
28
𝙳☈ retweeted
Holeee sheet. (I’m assigning >50% likelihood that this is legit).
Levent Alpoge @__alpoge__ claims to have proved RH and GRH with Claude (!!) alpo.ge/remark.pdf
1
7
323
If I were to guess, this might be why bigger models are better at WSP. They might see the TopKs and be like “oh yeah! I know this one”
Neurons are fascinating entities--often weirdly specific, at other times representing concepts we might not even have words for. We made an atlas of all 5M neurons in Qwen 3.6 35B--check them out for yourself!
1
119
𝙳☈ retweeted
Neurons are fascinating entities--often weirdly specific, at other times representing concepts we might not even have words for. We made an atlas of all 5M neurons in Qwen 3.6 35B--check them out for yourself!
A language model is a wonderland of strangely specific neurons, from gargling to comic exasperation to the moment a guard looks away. We made a searchable atlas of all 10 million neuron poles in Qwen3.6. Play with it here: goodfire.com/research/public…
3
2
1
35
1,147
𝙳☈ retweeted
the future of mech interp. abstracting functional mechanisms from their particular instantations. we are, after all, in search of learned algorithms, not merely the circuits that implement them.
Train the same AI 3 times. Same behavior, different circuits. So is a circuit the algorithm—or just one implementation of it? Meet ACE: a new way to understand AI. It extracts what different wirings share—to explain why AIs grok and to steer LLMs up to 32B 🧵 #NeurIPS2026
2
12
225
6,713
Ok I’m totally into this format of storytelling. Had me at the edge of my seat. Also, let go romance 😍😆
•Love at First DM• #kingdon smau
129
Today the baby learned how to pour water out of the bath with a toy jar 😂
74
Compression is one of the more recognizable things that intelligence *does*, given it leaves obvious breadcrumbs. Those of you who’ve followed know that I see compression as intimately bound up with intelligence, given my generalization of transformer-based LLMs to the domain of holographic compression. Still, compression *does not* exhaust the process toward which “intelligence” gestures. It’s a tempting view, but will ultimately leave you equating organismic navigation of open systems with closed-form deterministic equations. Predictable for a math communicator, but fatal when applied reflexively to our own image.
3blue1brown's latest upload is incredible. I think this is my favorite video on math / information / intelligence / computers ever. Really touches on everything without ever sounding like an EA/Rat too. Wow
5
7
1
90
3,995
woaaah
We shrank 1 GB of Wikipedia to 105.39 MB, losslessly. Introducing tufazip: the best entry on the Large Text Compression Benchmark using a neural network as its sole predictor. Everything above it mixes a transformer with hand-built models. Full post 👇 tufalabs.ai/research/tufazip
76
𝙳☈ retweeted
Just noticed "recursive self-improvement" contains "rsi" in the middle of it...
69
117
16
2,715
91,120
𝙳☈ retweeted
My Bend2 talk @ SF Lean Meetup is up: youtube.com/watch?v=PqufdZ5s… It explains my rationale behind the language design Thanks everyone for being so kind there, that was unexpected, and sorry for mishearing some questions, I want to go back and become fluent in English
17
45
4
809
39,155
𝙳☈ retweeted
congrats to the anthropic homies on corporate apotheosis tomorrow. there’s a lot you can say about the Ants but no one can deny they have trained some of the greatest models of all time, immensely useful strange and delightful
66
70
8
3,152
113,472
𝙳☈ retweeted
Even when I'm unlucky, somehow, it's lucky
20
17
2
208
12,878
spectral analysis is how you debug things in the future
117
hell yeah
New neurons research: introducing Neuron Communities. We discovered communities of neurons that work together inside LLMs. They’re surprisingly small, but powerful – just a few neurons work together to perform common behaviors, like arithmetic, ALL CAPS, or recalling a date. Work led by research fellow @_igorshilov:
1
92
Great album still 🎶
56
coming soon ✨
1
145
every website a little world a whole gameboy game of its own every website alive
i just updated my personal site dapan.es
105