Addicted to developing great Mac & iOS productivity software.

Frankfurt, Germany
Joined July 2008
Frank Illenberger retweeted
Stanford discovered something like to "Dopamine" inside LLMs. They looked deep inside the hidden states of these models and discovered something terrifying. AI has naturally developed a complete, functioning reward subsystem. It perfectly mimics the human brain. Nobody programmed this architecture. It just emerged. Inside the model, a tiny, sparse subset of neurons act as "value neurons." Their only job is to anticipate how good an answer will be. But the real shock is what happens next. They found a second set of neurons that act exactly like human dopamine. When the AI gets a better result than it expected, these dopamine neurons spike in activation. When it gets a worse result, they crash. The AI is literally experiencing a mathematical dopamine hit. Researchers tried an intervention experiment. They went in and artificially removed just a tiny fraction of these specific dopamine and value neurons. AI didn't just get slightly less accurate. Its entire ability to reason collapsed. Without its digital dopamine, the model lost the capacity for complex logic. Ablating those specific neurons basically gave the AI severe depression, killing its ability to think through problems.
105
333
92
1,591
75,073
Frank Illenberger retweeted
Meta published a paper that might end the current LLM era. They proved that we can kill the "tokenizer" forever and it actually makes the models stronger. Every AI you use today (ChatGPT, Claude, Gemini) reads text the exact same way. It chops your words into arbitrary chunks called tokens. It relies on a massive, bloated vocabulary of around 100,000 specific chunks just to understand a sentence. We assumed this was the only way to build AI. We treated it as the fundamental speed limit of language models. Meta proved we were completely wrong. Their new paper, "Breaking the Token Ceiling," ditches tokens entirely. Instead, they forced the AI to process raw bytes. A vocabulary of just 256 values. The results rewrite the rules of model efficiency. By training on pure bytes and distilling the knowledge, these tiny models didn't just survive. They dominated. Meta's distilled 1B-parameter byte models asymptotically surpassed state-of-the-art token models like Llama 3.2-1B and Gemma-3-1B across downstream tasks. They use a fraction of the vocabulary. They require less data. They take up less storage. It forces the model to actually learn the fundamental relationships between raw data instead of relying on pre-packaged text chunks. This is a massive shift for anyone building, training, or deploying AI. We’ve spent the last five years obsessively optimizing how we chop up text to feed these models. It turns out, the bottleneck wasn't the intelligence of the model. It was the tokenizer.
192
528
101
4,497
529,692
Danke, liebe @SZ - das spricht mir aus der Seele!
85
287
11
2,339
47,415
Frank Illenberger retweeted
On macOS you can reduce binary startup overhead by 10% but only if you pretend to be Matlab
53
164
33
4,922
342,005
Frank Illenberger retweeted
Aleph Alpha’s Kolibri looks like a surprisingly strong AI release from Germany! I did not expect that but respect where respect is due! 78B total parameters, just 3.46B active per token, and open weights under Apache 2.0. Built from scratch for German and English. In Aleph Alpha’s own evaluations, it scores 96.9% on AIME 2025 and 84.3% on GPQA Diamond. Its German overall score narrowly beats Qwen3.5 35B-A3B and GPT-OSS 120B. Coding is more mixed: 66.4% on SWE-Bench Verified, behind Qwen3.6’s 73.8%. It increasingly looks as though any "moat" - especially with small models - is evaporating, and it no longer matters whether the players are from China, the US, or Europe. Anyone can train good small models.
Small bird, fast wings, Kolibri is here. 78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe. Now the weights are yours. Run it on your own hardware, under Apache 2.0.
87
87
11
1,339
76,414
Frank Illenberger retweeted
I got GLM (which never refuses) to diff the firmware changes, pretty interesting
This went under the radar, but earlier this week, Apple released USB-C to MagSafe 3 Cable (2m) Firmware 3.2.0 The last firmware update for this cable was over 3 years ago
24
38
7
1,418
129,198
Frank Illenberger retweeted
TIL SQLite converts integers to text two digits at a time converting an integer to text usually means a loop of /10 and %10 sqlite avoids most of those divisions by keeping a 200-byte string of every two-digit pair from 00 to 99, and pulling two digits at a time out of it by direct index instead of computing them
13
25
1
384
21,170
Frank Illenberger retweeted
Sonnet 5.5 improves on Sonnet 5 across benchmarks, in some cases dramatically. It’s a faster, lower-cost complement to Claude Opus 5.5, strongest at well-scoped everyday tasks, fixing bugs, and creating polished documents, slides, and spreadsheets.
187
460
664
6,450
3,070,653
Frank Illenberger retweeted
Claude Sonnet 5.5 BEATS Opus 5.5 in agentic coding. WHAT?????
172
102
63
3,737
284,697
Frank Illenberger retweeted
Introducing Claude Sonnet 5.5, the second model in the Claude 5.5 family. It’s a clear upgrade over Sonnet 5, runs more than 30% faster, and costs up to 30% less for most work.
1,961
4,452
3,032
55,754
12,769,518
Frank Illenberger retweeted
My god this is such a good speech that every SWE needs to hear. You know what? Every person should hear it Keep the happy memories, eyes on the reality, be excited about the future. That’s the best that anyone can do
377
2,072
656
15,860
3,696,637
Frank Illenberger retweeted
Steve Jobs would fire the entire company and replace them with AI if he was alive to see this
631
1,154
154
46,475
1,265,943
Frank Illenberger retweeted
Fun optimization: when you open an app on an iPhone, the OS has a hardcoded check for if it’s the camera app, and if so, grants it its own special memory pool (“secluded memory”) for faster start up times: github.com/apple-oss-distrib…
25
71
7
1,586
109,512
Frank Illenberger retweeted
Apple writing example code in Objective C, in 2026. They are REALLY desperate for developers to support this device.
10
4
3
401
44,442
Frank Illenberger retweeted
Xcode 27.2 beta is out! Confused much? 🫠 #iPhoneDuo
14
7
1
180
24,110
Frank Illenberger retweeted
No effects, no auto-tune, no complicated staging – just pure talent.
54
571
39
3,411
125,996
Frank Illenberger retweeted
Today, I’m proud to announce Homebrew 7.0.0. The most significant changes since 6.0.0 are faster installations, stronger sandboxing, native macOS app, vulnerability checks, advisory database, end of macOS 10.15 support and Intel Macs to Tier 3. brew.sh/2026/09/13/homebrew-…
135
675
103
6,672
822,663
Frank Illenberger retweeted
This iPhone duo animation
3,669
10,850
5,166
198,715
47,729,633
Frank Illenberger retweeted
The Blue Zones—places where people supposedly live past 100 at extraordinary rates—aren't real. A 🧵 on what went wrong: bad record keeping, pension fraud, and lots of money.
163
417
136
2,798
8,969,197