Aleks Singer (@alekslovesdata) profile picture

Operations @d_model_ai | Champion of Existential Hope | Fusion & Tango Dancer

Austin, TX
Joined June 2018
Photo by Aleks Singer (@alekslovesdata)Photo by Aleks Singer (@alekslovesdata)Photo by Aleks Singer (@alekslovesdata)Photo by Aleks Singer (@alekslovesdata)Photo by Aleks Singer (@alekslovesdata)Photo by Aleks Singer (@alekslovesdata)Photo by Aleks Singer (@alekslovesdata)Photo by Aleks Singer (@alekslovesdata)Photo by Aleks Singer (@alekslovesdata)Photo by Aleks Singer (@alekslovesdata)
Aleks Singer retweeted
“NVIDIA has to become a frontier lab faster than frontier labs are becoming chip companies.”
Ok I do have a view on NVIDIA without Jensen. I’ll tell you the real reason $NVDA will likely fail without him and why the frontier labs and hyperscalers are the biggest winners. (Elon has been in a really good mood recently. Have you noticed?) The biggest threat to NVIDIA is its own customers, the frontier labs. NVIDIA has to become a frontier lab faster than frontier labs are becoming chip companies. And with Jensen out, they likely won't maintain the momentum to get there. With recursive self-improvement (RSI), every frontier lab and hyperscaler must become a chip company or lose the AI race. It's that simple, and they've all laid the groundwork (Google TPUs, OpenAI and Meta building custom ASICs with Broadcom, Anthropic building an in-house silicon team, and SpaceX/xAI/Tesla building Terafab). That's because software-only RSI has clear physical limits. Software can reduce how much computation and data movement a model needs, but it can't change the chip's physical bandwidth, memory capacity, or interconnect. Custom silicon gives labs another way to improve performance: designing the memory system, compute, and networking around their own workloads. To get the real compounding effect of RSI, you have to co-design the model and the silicon so it becomes a two-way feedback loop: smarter models design better custom chips, and those chips train and run the next model faster. You can't do that on off-the-shelf NVIDIA GPUs because you get zero proprietary edge buying the same chip as everyone else, and getting your next-gen architecture into NVIDIA's silicon means sharing your roadmap with them years before tape-out (which they then sell to your rivals). Plus, AI now automates writing compilers and porting CUDA kernels to other chips, which kills the CUDA moat. Jensen argued custom ASICs aren't more cost-efficient than GPUs because models change too fast for fixed hardware, and partners like Broadcom charge fat margins too. But hardware doesn't fall behind model changes when AI co-designs the next model and chip together instead of humans designing them separately (which Google and OpenAI are already doing). And labs aren't building custom silicon just to save on NVIDIA's 75%+ gross margins. Closing that hardware-software loop is the main goal, though the cost savings are still massive since RSI requires 24/7 internal inference where custom ASICs are way cheaper and more power-efficient than general-purpose GPUs. That's why NVIDIA has been trying so hard to become a frontier open-weight lab, buying Groq (fast inference IP), Poolside + Nemotron (internal coding models), and Hugging Face (distribution). If closed labs win, enterprises just call their APIs running on the labs' own custom silicon and NVIDIA gets cut out. Subsidizing free open-weight models is the only way to make enterprises buy or rent NVIDIA GPUs to run the models themselves. With Jensen gone, it's unclear if the Hugging Face deal even survives DOJ approval (can a GPU company own the whole stack?), and a non-founder is unlikely to take the massive risks needed to become a frontier lab: putting billions of capex into internal clusters and free open-weight models instead of just selling GPUs, while competing directly with its own biggest customers $GOOG, $META, $SPCX, $ANT, $MSFT
235
570
56
8,930
565,278
"Everything is going to have to be re-written by AI, in type/memory safe languages, with minimal libraries, using formal methods, contracts, solvers, etc.." Yes. The great rewriting.
No. 1. In the presence of superhuman bug finding machines, humans cannot write safe code without extreme levels of care and planning. 2. That care has almost never been applied to the critical systems in our lives. Not because software engineers don't care, but we aren't really engineers, not in the way civil engineers are engineers. The title is stolen valor. 3. Even careful, experienced "engineers" have difficulty writing code that is safe against modern models in C/C++ and other low-level languages. 4. We are finding that CVEs are overrated; huge numbers of organizations are being owned by custom vulns in the 100s of billions of lines of non-standard enterprise code out there or misconfigurations in heterogeneous systems, which LLMs can find and write exploits for live. 5. @dinodaizovi is right, we need architectures for which one RCE is not game-over and that buy us time for AI-driven response. 6. Everything is going to have to be re-written by AI, in type/memory safe languages, with minimal libraries, using formal methods, contracts, solvers, etc...
1
1
17
566
Really can't believe how incredible (and publicly accessible and free) Planet's data is. You can see the whole world via daily satellite imagery! ai.planet.com
9
370
D model social is tonight. Dm me if you want to attend!
65
"What if AGI was not a centralizing technology, but a far more decentralizing one? I think it's very likely that this will be the case." @sebkrier from @GoogleDeepMind on distributional AGI and alternatives to the singleton frame.
8
4
51
2,244
"Your max bandwidth for communicating with the world is 10 to 100 bits per second. AI is communicating with itself 1 million to 10 million times faster than that." @SumnerLN (Merge Labs), on the sensory-motor barrier.
1
5
30
1,693
Beautiful start to Vision Weekend
2
146
Aleks Singer retweeted
New superintelligence eval just dropped.
has anyone tried inventing a printer that works
1
6
312
Me too 😭😭😭
I actually find it extremely inconvenient how much I love SF and NYC. I wish I only loved one!
2
14
604
Gah this is so cool. Training for creativity is underrated.
Research News! Announcing the 1st release of fundamental AI research from the Open-Endedness Team @LilaSciences: a vision-focused blog + 4 preprints. The blog details a broad research agenda for achieving open-endedness while each paper unveils its own novel research direction. The ideas covered in the papers include: • a novel approach to training for creativity designed to sidestep a newly-identified problem called the “creative paradox,” which means that directly reinforcing creative outputs can sometimes limit reaching full creative potential; • an investigation of the advantages of seeing the world through fresh eyes by training an LLM that is intentionally naïve in a certain area (in effect presenting less data as a potential advantage); • a new kind of training regularization technique for SGD called unified factored organizers (UFOs), which is designed to achieve unified factored representation (UFR) as seen in Picbreeder CPPNs; • and finally a unique study of catastrophic forgetting that shows that networks with UFR (like those from Picbreeder) are intrinsically resistant to catastrophic forgetting. The inset video on this post is a visualization from that catastrophic forgetting work. The blog post also includes an interactive “wheel of science” demo. The implications of these ideas are broad and diverse, but the fun part is that each one opens up its own new research playground - there is a lot of room for further research here! Moreover, we hope this release also highlights one other important point about AI today: while it may seem that the road ahead is already paved and all that’s left is to drive mindlessly forward, there actually remains a lot of room for new directions and insights in the pursuit of open-endedness and creativity. This research was possible because @LilaSciences appreciates the critical role of open-ended innovation in the pursuit of scientific superintelligence. The advances you see here are part of this much larger company-wide ambition, which includes AI Science Factories and many other unprecedented components. When this engine is fueled by open-endedness, the result will be much more than a step change. More advances in open-endedness are coming! Blog link below 👇
3
233
The phrase "restaurant-turned-VC office" makes me very happy for some reason
excited to be hosting a challah-making workshop on thurs nov 19th in sf! it will be in a restaurant-turned-VC office in the mission, where we'll be making a japanese-inspired challah dough with the tangzhong method (yes, you read that right) everyone's challah will be baked & ready to take home by the end of the night, so you can enjoy it over shabbat on the 20th we have 40 spots! dm/comment if you're interested :)
5
180
I dream of perfect proxies but alas. So many problems really do come down to not having great metrics for things.
To determine AI trajectories, we need a good y-axis where +1 unit always represents the same degree of improvement; we don't have this, as all our measures are imperfect proxies. Researchers know this but the implications are often lost in the discourse. forum.effectivealtruism.org/…
1
3
271
Progress per $ falling. Cannot wait to discuss this & how the data industry plays into this at Vision Weekend!
Updated version!
5
261
Back in San Francisco! 🌉
3
12
460
Long live markdown
LLMs are 20th century software that happened to show up in the 21st. Text is king again.
1
5
280
Prediction: in a couple of years all the business schools will start teaching classes on "Vibes Theory".
angel investing strategies: 1) studied strategy + diversified groups @elawless 2) vibes + bigger checks for good hangs @clairevo guess which wins
1
2
150
Aleks Singer retweeted
Atlas is now free when you use Stripe for banking. Open a Stripe Treasury account within 7 days of incorporating and we’ll deposit $500 to cover your Atlas fee. Get started: stripe.com/atlas
127
73
50
1,408
464,972
Aleks Singer retweeted
You can be either loved *and* hated, or merely liked and tolerated.
437
1,377
162
16,129
1,486,511
The important questions
What are the big authoritarian risks of the 21st century? Does AI have democratic potential? And what can we learn from Ancient Athens? We put these questions and more to @mattbotvinick, author of AI and Political Freedom. blog.cosmos-institute.org/p/…
61
This is fun.
This quoted post is unavailable.
1
70