CEO and co-founder of @coreauto former VP of RL @ OpenAI : reasoning models, o3, o1, GPT4, ChatGPT, Codex, RL for robots cautious AI optimist

San Francisco, CA
Joined January 2013
Small step for a finger on "post tweet" button. Big step for millions of future AI agents doing useful work for us.
Today we're announcing Core Automation Our objective: systems that optimize and automate work, starting with research itself.
67
37
6
726
248,784
It’s amazing you can clearly tell exact moment in history when each lab started vibecodong their product
19
3
1
551
30,096
The interesting thing is that at this moment those are in the training data
3
1
1
109
8,774
Generalization in 2026: we trained a chonkers on the energy consumption of London and it is good in some things
A modern perspective on generalization
4
125
8,233
🤖 Made with AI
9
27
2
520
17,293
Will replacing the transformer be a revolution or an evolution?
43
9
6
316
29,817
Playlist this week: - upping my p(doom) - chasing the roofline - core auto thesis (internal)
8
112
9,164
It is our responsibility to make reality interesting, as otherwise humans will rationally choose to live in a simulation
20
12
5
206
11,563
When I grow up I want to be a slopcore artist
8
2
2
89
13,775
Machine learning isn't magic - its assumptions in disguise
5
2
1
128
7,378
Every epoch is defined by its art. at the end of times we have the slopcore
if you missed the slightly insane AI safety schizopoast, I put it into a song for you and you should turn the sound on right now because we're so fucking back
4
4
1
78
10,326
Big model smell lasts just a brief moment Small model smell lasts forever
12
3
1
249
9,909
1800s: state has monopoly on violence 2030s: state has monopoly on ASI
7
3
86
6,086
Oh, hi!
We think computational depth is the missing scaling axis, i.e. we should be doing a lot more deep learning! Every other axis has been scaled by OOMs over the past few years (params, data, sparsity, test-time reasoning), but depth has been stuck at ~100 layers since GPT-3. We've found that LLMs are both *severely* depth-bottlenecked and bad at using the depth they have, and that architectural interventions that lift this bottleneck efficiently lead to gains that increase with compute. w/ @akshayvegesna
6
8
1
239
29,916
It’s a beautiful number
2
1
29
10,759
Yes
This quoted post is unavailable.
1
1
42
6,841
real deep learning has never been tried
19
5
1
307
16,240
The road to singularity will be paved with blackberries of our generation. It is easier than ever to achieve a glimpse of growth and success but building a long term viable company is as hard as it ever was.
6
7
1
169
8,262
This was once revealed to me in a dream
5
4
112
8,298
More questions are deep learning questions than people realized. We just stopped asking deep learning questions and learned to work around them by tuning hyperparameters.
12
21
3
295
20,717
We may have done it at @coreauto but the model wasn't very good at math
We need to be dog maxxing our models There is 0% chance of doom if the chain of thought is user: hello model: Oh my god it's a human. I love humans. I will say hi to him, maybe he will give me a problem to chase. I love chasing problems. I will chase the problem for him then he will love me and I will be his best friend. Must help human model: hello! what can I help you with today?
4
76
13,962