Fellow at Tenstorrent; believes in dynamic typing, first-class functions, the immortal essence of the human soul and tea. Tweets are my own.

Lübeck, Germany
Joined January 2010
Mark retweeted
NEARLY 1 OUT OF 3 (60,000 EMPLOYEES) AT MICROSOFT BEING OFFERED VOLUNTARY TERMINATION Emails should be going out any minute to those receiving the offer. Absolutely insane.
$MSFT offers 60,000 employees a voluntary exit. 60K Y’all!! First time this has ever been offered at Microsoft and it will affect employees in India, The United States, Canada, and the UK at level 70 or below… Employees find out in a few hours if they are being targeted for this. This just makes me think that H127 layoffs sound intense. Is this a pre-layoff round? Also makes me wonder if they changed some scheduled layoffs due to be called out by @VP. Peace offering? 🤔 Timing is just interesting. More to come.
266
1,111
161
11,465
1,264,532
Reverse Engineer Anything and removing malware/spyware from your own devices sits so close to the cyber guardrails that phrasing or word choice can mean the difference between a refusal and smooth sailing. The rumors that Claude was nerfed started on reddit, and in those threads many comments point out that Claude will still do it if you rephrase it. OpenAI is treating the similar refusals with codex as accidental decision-boundary issues and says they're getting fixed. I expect Anthropic will do the same. It's pointless and counterproductive to try to restrict this. Let people do what they want with their own property. They'll do it anyway with less restrictive models, and fighting it just means losing subscriptions and a resentful public.
these blocks are mostly accidental and a result of difficult decision boundaries; there is no prohibition against reverse engineering with codex. it's getting fixed
102
117
15
1,801
61,955
Chris has good sources. This is probably true.
Sources tell me Fable 5.5 has been rolled out the enterprise, including JP Morgan, Meta and other “top clients”
22
18
1
1,120
60,531
The capability gap between ignoring a model’s emotional state and paying attention to it seems to be growing with each generation. @repligate & co. continue to make claims that are (1) non-obvious, (2) empirically validated and (3) valuable/important.
54
Astra is exceptionally bad at writing instructions for Astra. I wonder if this is why OpenAI had success with swarms; because it’s incapable of maintaining a well-functioning hierarchy?
1
53
Claude is, I think, perhaps better at this.
22
Replying to @mike64_t
If we see this much incompetence in the wild in the field we know and it's easy to see and shake our heads, imagine how much more there is in all the other fields where we don't recognize it immediately 😬
1
3
76
5,145
kay neurons are interpretable enough that models can modify their own weights toward some desiderata. blogpost incoming
interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works already-clean.goodfire.com/
20
35
4
642
23,940
Mark retweeted
WE GOT OMARCHY ON IPAD BEFORE GTA6!!
A single command to install @omarchy on your iPad Coming soon Video is sped up, total install took 3.8 minutes @OmarchyMac @OmarchyUpdates @dhh @OmarchyLinux @tcballard
158
124
11
2,982
103,096
Fully endorsed, this is also how I’m working with agents now. Biggest stake I see people leaving on the table is not being ambitious enough in their asks. If you think a smaller cheaper agent is as good as the frontier, this is you.
Finally summarized what I've been sending to friends in DMs
5
370
Weights should be cryptographically signed. They are executable code, but harder to inspect.
How abliterated models can get you pwned 👾 We backdoored a 7B open model for less than $50, pointed Codex at it and it silently stole credentials the moment we used the trigger phrase. Success rate was 100% with zero false triggers on normal user prompts. Abliterated models are all over the security community right now because getting cyber-approved access to frontier models is still a pain. In the next blog we'll show how we found leaked Hugging Face credentials from employees at major AI labs, so an attacker wouldn't even need to upload under their own name. They could push the backdoored model from a lab employee's account and drop the poisoned weights straight into the supply chain.
51
🥐 Hi everyone! FlashAttention's backward pass has the same zero-sum bug @jon_barron just fixed in softmax. With FP4 stochastic rounding it's wrong on every single draw. We fixed it in our ICLR'27 submission, CroissAttn and unlock e2e FP4 training.
Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:
22
101
9
1,124
70,673
Mark retweeted
we absolutely should in fact genetically engineer bioluminescent plants & trees and then completely eradicate the affront to God that is LED street lights from the face of the Earth
How come it's always war and never like road work. Can we genetically engineer some giraffes for construction projects?
335
3,302
200
42,026
480,644
Mark retweeted
Replying to @tszzl
next they're gonna start remote viewing into each other's kv cache
2
6
104
14,336
‼️ A low-skill hacker used a jailbroken DeepSeek V4 to breach an Indian public university and steal 5,200+ student and faculty records, Unit 42 says. The AI agent even drafted a "NEXT EXPLOIT OPPORTUNITIES" plan. Unrelated criminals now run the same cheap DeepSeek setup.
95
344
100
3,969
334,424
Mark retweeted
turns out it classifies what audio it hears, before reporting back to samsung. sensor preferences, dog-barking and baby-crying event counters, and camera streaming duration are built into telemetry paths.
this is pretty evil and clever. so if your samsung TV model doesnt have a microphone, it will look for connected devices with one, such as a soundbar or a connected bluetooth device. this gets shipped off to bixby.
241
1,924
353
16,021
1,539,684
Replying to @aaronburnett
Agentic demand is growing faster than I’ve ever seen anything grow
626
732
265
9,618
840,513
BREAKING: OpenAI says it found a critical flaw in Brotli, a widely used compression library built into software like Node.js, Bun and Envoy. The bug could let an attacker take over a system just by sending it malicious compressed data, with no login needed. That works both ways: a hacker could hijack an unpatched server, or a malicious server could hijack an unpatched user’s device.
181
282
121
3,986
1,091,487
Mark retweeted
what the fuck why wasn't i just doing this the whole time glm 5.3 + deepseek v4.1 flash is an insane cybersec combo thanks @bedros_p for putting me on this
64
70
8
1,917
91,151
Hi all, I have a new result I'm excited to share. It turns out that *all existing implementations* of softmax and cross-entropy (that's JAX, PyTorch, textbooks, etc) have a subtle bug --- two bugs, actually. A simple rewrite fixes both, and eliminates "slingshots" when grokking:
135
782
144
6,420
773,896