TPUs go brrrr :) – at Islington, London
Do you want to accelerate chip design with AI? Are you passionate about ML accelerators? Do you want to make FLOPs cheap and abundant?
DM me the coolest thing you've ever done. – at Islington, London
linkedin post:
lnkd.in/p/eTMgTGUm – at Islington, London
Iman Hosseini retweeted
I’m proud to share our latest milestone. Following our Google I/O demo, we’ve pushed our Antigravity agent, /teamwork (powered by Gemini) from a helpful assistant into a true research partner from CS theory to high-performance coding and hardware simulation.
Here is what we’ve been building 👇 antigravity.google/blog/team…
🔹 Designed a cycle-level RISC-V CPU simulator with minimum human intervention that successfully boots an OS to shell (< 1% average error vs. golden reference)💻⚙️
🔹 Math & TCS (via Long-proof Pattern): We hit 71% on TCSBench and solved multiple open problems—including sparse convex optimization (JMLR), subspace approximation (FOCS), provable LLM quantization, vector embeddings, and Prefix-Matrix Factorizations. We also generated a simplified construction of Knuth’s Cycles Conjecture (verified in Lean) and a reproof of the Erdős Unit Distance Problem. 🧮🧠
🔹 Open Source: /teamwork writes production code. We landed performance optimizations directly into major C++ libraries, including ParlayHash and up to a 32× speedup in Eigen. ⚡🚀
What excites me isn't just the benchmarks—it's our shift from Thinking Graphs to Graph Engineering. We’ve moved past rigid prompt engineering and sequential flows. /teamwork treats long-horizon research as a dynamic execution graph: decoupling agent specifications from orchestration logic, running parallel tournament synthesis trees, and dynamically adjusting agent topologies at runtime as complex problems unfold. 🕸️🤖
We’re releasing several new harness patterns today to solve a variety of problems (iterative coding, document review, Long Proof, and Aletheia). I'm thrilled our team can share these agents via AGY with our users. Stay tuned for more!
Read the full technical deep-dive on the blog here: antigravity.google/blog/team…
#AI #Gemini #AI4Systems #AI4Math #AI4Science #ComputerArchitecture #Systems #FormalVerification #OpenSource
Jeff was my (dotted-)skip. He is one of the coolest, most down to earth people I've ever seen. Absolute legend. 🫡
P.S. phew, I also got my Sanjay# to 1 just in time. – at Islington, London
Tomorrow will be my last day at Google after 27 years, and watching it grow from 25 people to 190,000+ has been an amazing journey. Below is a note I shared with many people internally at Google today. An excerpt is:
It has been an absolute pleasure to work with you and to help build some of the most widely used and impactful products of all time. As a kid, I dreamed of helping build software that would be used by many people, and Google now has thirteen products used by more than a billion people (amazing!). Our work has had a tremendous impact in the world, and I have been lucky enough to collaborate and form friendships with many colleagues that I deeply admire, respect, and enjoy. It still brings me joy every time I see people out in the world using our products to find information, handle email, translate documents, watch videos, learn new things, navigate and understand the physical world, browse the web, use their phone, run large-scale computations on our infrastructure, ride in an autonomous vehicle, or perform complex tasks with the help of our AI systems. I hope you all share this sense of joy, because it is a shared accomplishment! Thank you to all of my colleagues at Google over many years!
Now I'm excited to go start @DiscoLoopAI with my longtime friends and colleagues @Sanjay_Ghemawat, @OriolVinyalsML, and @quocleix.
(Updated post: slightly redacted to not have some personal info)
Cool work! – at Islington, London
Parallel O(sqrt(n)) Overhead LSD Radix Sort
arxiv.org/abs/2607.05302
Did someone say... DREAM?
Check out this recent paper by @behrouz_ali:
arxiv.org/abs/2606.03979 – at Islington, London
What does the next training paradigm look like?
0:00:00 – The big research bet the labs are making
0:02:12 – Grindability is just as important as verifiability
0:06:10 – Will RLVR alone generalize?
0:08:41 – Getting the learning back to the weights
0:15:22 – Dreaming
0:17:23 – What 2027 looks like
Also on YouTube, pod feed, and Substack.
Iman Hosseini retweeted
I was on the board of @ehsanik's company before Anthropic acquired it.
She is a force of nature. Brilliant. Relentless. Deeply caring.
No one should have to miss their wedding because their family is trapped in a war zone. No one should live with constant uncertainty about the safety of the people they love. No one should have to live with immigration uncertainty while giving so much to the country they call home.
Iranians have contributed enormously to America and the world. My heart goes out to them.
Today I was supposed to be on my way to Türkiye for my wedding, to meet up with my family and have them finally meet my partner and husband. We had everything planned. We chose Turkiye since it's close to Iran and my partner and I could both go there and have our families meet each other. We were supposed to get married with our close family and a small group of friends on a boat on the Mediterranean Sea at sunset. Because of the war, all flights to and from Iran are cancelled and my family can’t leave Iran, so we had to call off the wedding.
Instead, this is how my day looked like.
I woke up to a reminder to call my grandma (I used to call her every Friday morning). I snoozed the reminder until next Friday, just like I have done for the past many years. I can’t call her like our tradition these days because there is no way to call home. All international calls to Iran are blocked, and the internet is fully shut down by the regime.
I got to work and right as I opened my computer I received an email I had scheduled to send to myself 5 years ago: “Apply for citizenship.” This summer marks 11 years of being in the US and 5 years of being a green card holder. I am now eligible to file for citizenship, but it doesn’t matter because an executive order was signed a few months ago that banned all Iranians from applying for any visa or citizenship.
At lunch I opened Twitter just to see what’s up in the world and saw the news that those who don’t have a green card now need to leave the US before they can get one. This means every one of my Iranian friends who are here on a visa now has to go back home (on which flight?) to get a green card??? As if it’s that easy? We all know getting back to the US for Iranians is a huge challenge (months and months of waiting for a visa, with a chance of never being able to come back).
And this is just a normal Friday for an Iranian. These days, when people ask how I’m doing and how I’m handling everything, I just say:
It’s okay, it’s okay. It will be okay some day. But the reality is: nothing is okay. I’m in constant pain. I haven’t seen my family and loved ones in years, I barely hear about their wellbeing, and I’m constantly worried about them. I’m just burying myself in work because that’s the only distraction that can save me from losing my mind.
I’m not okay. None of us are okay. We are just barely holding it together…
Iman Hosseini retweeted
How to land a job at a frontier lab
vladfeinberg.com/2026/05/10/…
The vibes in SF feel pretty frenetic right now. The divide in outcomes is the worst I've ever seen.
Over the last 5yrs, a group of ~10k people - employees at Anthropic, OpenAI, xAI, Nvidia, Meta TBD, founders - have hit retirement wealth of well above $20M (back of the envelope AI estimation).
Everyone outside that group feels like they can work their well-paying (but <$500k) job for their whole life and never get there.
Worse yet, layoffs are in full swing. Many software engineers feel like their life's skill is no longer useful. The day to day role of most jobs has changed overnight with AI.
As a result,
1. The corporate ladder looks like the wrong building to climb.
Everyone's trying to align with a new set of career "paths": should I be a founder? Is it too late to join Anthropic / OpenAI? should I get into AI? what company stock will 10x next? People are demanding higher salaries and switching jobs more and more.
2. There’s a deep malaise about work (and its future).
Why even work at all for “peanuts”? Will my job even exist in a few years? Many feel helpless. You hear the “permanent underclass” conversation a lot, esp from young people. It's hard to focus on doing good work when you think "man, if I joined Anthropic 2yrs ago, I could retire"
3. The mid to late middle managers feel paralyzed.
Many have families and don't feel like they have the energy or network to just "start a company". They don't particularly have any AI skills. They see the writing on the wall: middle management is being hollowed out in many companies.
4. The rich aren’t particularly happy either.
No one is shedding tears for them (and rightfully so). But those who have "made it" experience a profound lack of purpose too. Some have gone from <$150k to >$50M in a few years with no ramp. It flips your life plans upside down. For some, comparison is the thief of joy. For some, they escape to NYC to "live life". For others still, they start companies "just cuz", often to win status points. They never imagined that by age 30, they'd be set. I once asked a post-economic founder friend why they didn't just sell the co and they said "and do what? right now, everyone wants to talk to me. if i sell, I will only have money."
I understand that many reading this scoff at the champagne problems of the valley. Society is warped in this tech bubble. What is often well-off anywhere else in the world is bang average here.
Unlike many other places, tenure, intelligence and hard work can be loosely correlated with outcomes in the Bay. Living through a societally transformative gold rush in that environment can be paralyzing. "Am I in the right place? Should I move? Is there time still left? Am I gonna make it?" It psychologically torments many who have moved here in search of "success".
Ironically, a frequent side effect of this torment is to spin up the very products making everyone rich in hopes that you too can vibecode your path to economic enlightenment.
Iman Hosseini retweeted
We're not over with scaling. The path to million chips run is clear.
You need to be distributed across many datacenters.
You need to be resilient to hardware failures.
We simulate extreme levels of hardware failures as if we were using 2M chips and show Decoupled DiLoCo can achieve the same ML performance while having superior infra robustness!
We’re introducing our eighth generation of TPUs. This time, we’re taking a dual chip approach: TPU 8t, optimized for training, and TPU 8i, optimized for inference.
💪TPU 8t achieves nearly three times the compute performance per pod over our previous generation, Ironwood.
⚡TPU 8i connects 1,152 TPUs in a single pod to deliver the massive throughput and low latency needed to concurrently run millions of agents cost-effectively.
These new TPUs are a crucial part of our fully integrated AI stack — from the chips all the way up to the models, developer tools, agents and applications. By designing the hardware and software in tandem, we’re able to deliver scale and efficiency. #GoogleCloudNext
Iman Hosseini retweeted
The growing KV-cache of attention is the key component for the long-context understanding of LLMs, but what holds back long-term memory modules (e.g., Titans)? What if we could have the compression power of Titans but with a growing memory similar to Transformers?
Memory Caching: A class of architectures that compress the context into a slow growing memory (not as fast as Transformers, but not as static as RNNs), resulting in recurrent neural networks with non-fixed-sized memory (hidden states). Building on this formulation, we present Sparse Selective Caching, an architecture with growing effective memory (similar to attention) but with almost constant inference cost per token (similar to RNNs).
Iman Hosseini retweeted
POV: about to drop the Ring into Mount Doom. Why didn't the Fellowship just use a fighter jet?
Because your pet already thinks the universe revolves around them… why not create one that actually does?
With Project Genie, upload a picture of your pet and have them explore infinitely diverse worlds.
Learn more: labs.google/projectgenie
A while ago I was looking at a problem and thought man I wish I could ask @jonmasters.
Then I realized I literally can. We are colleagues :)
Iman Hosseini retweeted
⚠️ Update: #Iran has now been offline for 96 hours, limiting reporting and accountability over civilian deaths as Iranians protest and demand change; fixed-line internet, mobile data and calls are disabled, while other communication means are also increasingly being targeted ⌛️






























