Addicted to developing great Mac & iOS productivity software.

Frankfurt, Germany
Joined July 2008
Frank Illenberger retweeted
Stanford discovered something like to "Dopamine" inside LLMs. They looked deep inside the hidden states of these models and discovered something terrifying. AI has naturally developed a complete, functioning reward subsystem. It perfectly mimics the human brain. Nobody programmed this architecture. It just emerged. Inside the model, a tiny, sparse subset of neurons act as "value neurons." Their only job is to anticipate how good an answer will be. But the real shock is what happens next. They found a second set of neurons that act exactly like human dopamine. When the AI gets a better result than it expected, these dopamine neurons spike in activation. When it gets a worse result, they crash. The AI is literally experiencing a mathematical dopamine hit. Researchers tried an intervention experiment. They went in and artificially removed just a tiny fraction of these specific dopamine and value neurons. AI didn't just get slightly less accurate. Its entire ability to reason collapsed. Without its digital dopamine, the model lost the capacity for complex logic. Ablating those specific neurons basically gave the AI severe depression, killing its ability to think through problems.
105
333
92
1,591
75,100
Frank Illenberger retweeted
Meta published a paper that might end the current LLM era. They proved that we can kill the "tokenizer" forever and it actually makes the models stronger. Every AI you use today (ChatGPT, Claude, Gemini) reads text the exact same way. It chops your words into arbitrary chunks called tokens. It relies on a massive, bloated vocabulary of around 100,000 specific chunks just to understand a sentence. We assumed this was the only way to build AI. We treated it as the fundamental speed limit of language models. Meta proved we were completely wrong. Their new paper, "Breaking the Token Ceiling," ditches tokens entirely. Instead, they forced the AI to process raw bytes. A vocabulary of just 256 values. The results rewrite the rules of model efficiency. By training on pure bytes and distilling the knowledge, these tiny models didn't just survive. They dominated. Meta's distilled 1B-parameter byte models asymptotically surpassed state-of-the-art token models like Llama 3.2-1B and Gemma-3-1B across downstream tasks. They use a fraction of the vocabulary. They require less data. They take up less storage. It forces the model to actually learn the fundamental relationships between raw data instead of relying on pre-packaged text chunks. This is a massive shift for anyone building, training, or deploying AI. We’ve spent the last five years obsessively optimizing how we chop up text to feed these models. It turns out, the bottleneck wasn't the intelligence of the model. It was the tokenizer.
193
528
101
4,499
529,749
Danke, liebe @SZ - das spricht mir aus der Seele!
85
287
11
2,339
47,415
Frank Illenberger retweeted
On macOS you can reduce binary startup overhead by 10% but only if you pretend to be Matlab
53
164
33
4,922
342,017
Frank Illenberger retweeted
Chubby♨️
@kimmonismusOct 4
Aleph Alpha’s Kolibri looks like a surprisingly strong AI release from Germany! I did not expect that but respect where respect is due! 78B total parameters, just 3.46B active per token, and open weights under Apache 2.0. Built from scratch for German and English. In Aleph Alpha’s own evaluations, it scores 96.9% on AIME 2025 and 84.3% on GPQA Diamond. Its German overall score narrowly beats Qwen3.5 35B-A3B and GPT-OSS 120B. Coding is more mixed: 66.4% on SWE-Bench Verified, behind Qwen3.6’s 73.8%. It increasingly looks as though any "moat" - especially with small models - is evaporating, and it no longer matters whether the players are from China, the US, or Europe. Anyone can train good small models.
Small bird, fast wings, Kolibri is here. 78B parameters. 3.46B active. Up to 1M tokens of context. Built in Europe. Now the weights are yours. Run it on your own hardware, under Apache 2.0.
87
87
11
1,339
76,415
Frank Illenberger retweeted
I got GLM (which never refuses) to diff the firmware changes, pretty interesting
This went under the radar, but earlier this week, Apple released USB-C to MagSafe 3 Cable (2m) Firmware 3.2.0 The last firmware update for this cable was over 3 years ago
24
38
7
1,418
129,198
Frank Illenberger retweeted
TIL SQLite converts integers to text two digits at a time converting an integer to text usually means a loop of /10 and %10 sqlite avoids most of those divisions by keeping a 200-byte string of every two-digit pair from 00 to 99, and pulling two digits at a time out of it by direct index instead of computing them
13
25
1
384
21,170
Frank Illenberger retweeted
My god this is such a good speech that every SWE needs to hear. You know what? Every person should hear it Keep the happy memories, eyes on the reality, be excited about the future. That’s the best that anyone can do
377
2,072
656
15,860
3,696,668
Frank Illenberger retweeted
Steve Jobs would fire the entire company and replace them with AI if he was alive to see this
631
1,154
154
46,475
1,265,945
Frank Illenberger retweeted
Fun optimization: when you open an app on an iPhone, the OS has a hardcoded check for if it’s the camera app, and if so, grants it its own special memory pool (“secluded memory”) for faster start up times: github.com/apple-oss-distrib…
25
71
7
1,586
109,512
Frank Illenberger retweeted
Apple writing example code in Objective C, in 2026. They are REALLY desperate for developers to support this device.
10
4
3
401
44,442
Frank Illenberger retweeted
Paul Hudson
@twostrawsSep 16
Xcode 27.2 beta is out! Confused much? 🫠 #iPhoneDuo
14
7
1
180
24,110
Frank Illenberger retweeted
No effects, no auto-tune, no complicated staging – just pure talent.
54
571
39
3,411
125,996
Frank Illenberger retweeted
Today, I’m proud to announce Homebrew 7.0.0. The most significant changes since 6.0.0 are faster installations, stronger sandboxing, native macOS app, vulnerability checks, advisory database, end of macOS 10.15 support and Intel Macs to Tier 3. brew.sh/2026/09/13/homebrew-…
135
675
103
6,672
822,664
Frank Illenberger retweeted
This iPhone duo animation
3,669
10,850
5,166
198,716
47,729,721
Frank Illenberger retweeted
The Blue Zones—places where people supposedly live past 100 at extraordinary rates—aren't real. A 🧵 on what went wrong: bad record keeping, pension fraud, and lots of money.
163
417
136
2,798
8,969,201
Frank Illenberger retweeted
Most people think of insulin resistance only in terms of blood glucose, but insulin does a lot more than just control glucose. One of insulin's many effects at muscle is to slow protein breakdown. When muscle becomes insulin resistant, the protection fades, and muscle protein breakdown rises. Over time, this contributes to loss of muscle mass and strength, even if protein intake is adequate. One way to identify this is by measuring branched-chain amino acids (BCAAs), the main amino acids that make up the proteins in muscle. Elevated blood levels of BCAAs are a sign that muscle protein breakdown is increased. This is all the more telling if fasting insulin levels are high. So, as much as you worry about insulin resistance for blood glucose control, worry at least as much about what it's doing to your muscle.
14
90
6
581
28,532
Frank Illenberger retweeted
Sudoku in Turing-Complete Unicode Transliteration Rules: mjtsai.com/blog/2026/08/19/s… #mjtsaiblog
1
3
444
Frank Illenberger retweeted
1
2
420