California
Joined September 2018
Super excited to Introduce our latest work: Squeeze Evolve. We unify test-time scaling methods into one evolutionary framework — then orchestrate many models across it. 3x lower cost. 10x throughput. 97.5%(SoTA) on ARC-AGI-V2. No verifier required. Framework: squeeze-evolve.github.io/
3
16
8
106
113,520
Great work @MahitNamburu! Congrats on the launch
Introducing Probe: The Agent-Native Research Stack. Our goal is simple: help AI/ML teams run better experiments, faster. Teams run research with agents now, but their work is disordered. They lose hours verifying what their agents actually did, managing environments and compute, and re-explaining company context their agents should already know. So we rebuilt the research stack from the ground up for agent-driven research. Probe brings core research tools, shared context from past experiments, and visibility into each run together in one platform. Teams can spend less time setting up infrastructure, supervising agents, and catching teammates up, and more time testing ideas. If you’re a research lab, scale your research team without sacrificing speed. If you’re an AI/ML team, stand up a research capability with the infrastructure of a frontier lab. See Probe for yourself: useprobe.ai/
110
Really nice work! This supports some of my ad-hoc observations and intuitions from working on evolutionary systems and self-verification over the past year. - While experimenting with verifier-free evolution methods combining parallel and sequential reasoning (RSA/PDR: arxiv.org/abs/2509.26626, arxiv.org/abs/2510.01123), I found that truncating the reasoning traces and keeping only the final answers (or a summary + final answers) before aggregation (roughly analogous to the communication step in multi-agent systems) often worked better. IIRC, @sudomonish also noticed something similar with SqueezeEvolve (arxiv.org/abs/2604.07725). We also observed that removing the reasoning traces made models reason for longer during aggregation, whereas retaining them made models more conservative and more likely to terminate early. This seems closely related to the papers finding that forgetting increased median reasoning tokens from 2.9k to 9.4k per proposal and leads to larger code edits as well. - While working on self-verification (our V1 paper: arxiv.org/abs/2603.04304v1), I also noticed that self-verification performance improved when we removed the original reasoning trace and gave the model only the final answer to verify. My intuition was that models become more biased toward their own answers when they see the reasoning that led to those answers. This is consistent with @Jacklu_me's paper on verification (arxiv.org/abs/2512.02304), which shows that models are more likely to accept solutions resembling their own, while cross-family verification tends to work better. Truncating the original reasoning trace might make the answer feel more "alien" to the model during self-verification, potentially reducing this bias. The model might then spend more tokens independently verifying the answer rather than relying on the earlier reasoning. Interestingly, autoresearch agents also might be implicitly or explicitly self-verifying their own ideas and proposed changes, even when external evaluators score the resulting candidates. So I wonder if better self-verification after forgetting might also be contributing to the improvements observed in the autoresearch loops of the paper.
Autoresearch with coding agents can now run for days on a single problem, but we've seen an increasing number of cases where they stop improving early. We address this issue with a simple idea: forgetting. Introducing our new paper: "Scaling Discovery Requires Forgetting"
3
7
1
27
2,325
Monish Maheswaran retweeted
While exploring diffusion language models (DLMs), we kept asking ourselves: given speculative decoding, a lossless acceleration technique, why do we still need DLMs? 🤔 Our latest work, ORL, tries to answer this question: AR optimizes intelligence 👆, speculative decoding optimizes speed 👉, and DLMs optimize the Pareto frontier of speed and intelligence 🚀. Through co-design across the algorithms, the training and inference engine, and the kernels, ORL pushes out a new Pareto frontier of intelligence and speed. Similar performance, much faster than speculative decoding. You say lossy spec? ORL-DLM is better too! 😎 🌐 Project + live demos: introspective-diffusion.gith…
4
22
3
68
21,184
Monish Maheswaran retweeted
Hi, I'm Felix. I'm an eng lead working on Claude. I love watching people take flight and do things they never thought possible. We often describe that as "being more ambitious" when using AI, which is tricky advice to follow. I wrote a tutorial: felixrieseberg.com/how-to-be…
405
2,544
581
24,266
5,390,881
Amazing work! Congrats @Harman26Singh! Highly recommend reading this 🚀
🤖 How well do agents learn from experience? We study agents that amortize experience into reusable artifacts and introduce Agent Plasticity to measure how efficiently they improve on held-out environments. Top performer ≠ most efficient learner.
8
579
The only citation that matters is research → prod.
Fun fact about (some) AI researchers / academics: the more senior you get, the more convinced you become that every new AI idea is something you already invented 20 years ago. Or, even better: wait until something actually works and then try convincing everyone that this is exactly what you’ve been saying all along. I was at a conference where a speaker was presenting their research. One academic stood up and said: what you’re doing is actually something I did a few years ago. The speaker was very polite and said thank you for pointing this out. Then a second researcher stood up and said, well I already did it this 10 years ago, you should cite my work. Then a third person said, I already did all of this about 20 years ago. It was the funniest thing ever.
1
10
565
Monish Maheswaran retweeted
Our I-DLM work will be presented as an Oral Spotlight at #COLM2026 this Thursday! 🎉 📍 Introspective Diffusion Language Models 🗓 Thu, Oct 8 4:15–4:30 PM PDT at Grand Ballroom Come join us to see how introspective consistency helps DLMs match AR quality while keeping fast parallel decoding. 🚀 Amazing work with @Yifan_YYU , Yuqing Jian, @_junxiong_wang , @ZhongzhuZhou, @Donglin07326431 , Xinyu Fang, @srivyanamandra, @XiaoxiaWShirley , @QingyangWu1, @Leon75421958, @tri_dao, @ben_athi, @james_y_zou, Fan Lai, see you at COLM! Happy to chat more about Diffusion Language Model :)
8
2
63
7,637
Monish Maheswaran retweeted
Catch @shulynnliu and me presenting the EvoX poster at #COLM2026 on Thursday at 11:00 AM! 🧬💥 We’re expanding from evolving algorithms to actually building large-scale systems with agents 🤖⚙️ Stop by to chat meta-evolution & the future of autonomous systems! 👋
Researchers spend hours and hours hand-crafting the strategies behind LLM-driven optimization systems like AlphaEvolve: deciding which ideas to reuse, when to explore vs exploit, and what mutations to try. 🤖But what if AI could evolve its own evolution process? We introduce EvoX, a meta-evolution pipeline that lets AI evolve the strategy guiding the optimization. It achieves high-quality solutions for <$5, while existing open systems and even Claude Code often cost 3-5× more on some tasks. Across ~200 optimization problems, EvoX delivers the strongest overall results: often outperforming AlphaEvolve, OpenEvolve, GEPA, and ShinkaEvolve on math and systems tasks, exceeding human SOTA, and improving median performance by up to 61% on 172 competitive programming problems. 👇
1
5
31
1,458
Monish Maheswaran retweeted
We'll be spending a lot more time trying to understand the outputs of language models. A few thoughts, tips & tricks: Writing. Something I've had success with: Ask your LLM to explain something in ASD-STE100, it's a controlled language specification originally developed for aerospace maintenance documentation. LLMs well-versed in this language and it comes with heavy constraints on clean writing style that I often find a lot more readable. Sometimes I've tried to soften it a bit e.g. ask for "80% of the way to ASD-STE100" because the spec is quite stringent. But even better: Diagrams / images. Instead of writing, ask your LLM to create a diagram. These can be a lot easier to process, parse, and understand. But even better: Web pages. Ask for output "in HTML" to get a beautiful, interactive webpage. LLMs are getting really good at frontend and can create beautiful experiences, animations, etc. But even better: Explainer videos. The output format I am most bullish on is fully custom / bespoke explainer videos generated on any arbitrary topic. Experiment with things like "Create a 3b1b style video explainer on X. Use my ElevenLabs API key for audio narration". (you'd need an API key for the latter or you can ask your LLM to find you decent free alternatives that use your local compute). This is actually starting to work! In summary: - As LLMs get better, they will do more and more of the legwork autonomously, and a lot more of our work will rise up the abstractions into oversight and understanding. - Luckily, LLMs can help here too because as intelligence and code are increasingly abundant, you can ask for large, custom, discardable software artifacts (e.g. web apps, video explainers) that would have never made sense to create before. Push the boundaries here and you'll be surprised.
1,674
6,646
1,542
56,033
7,990,390
Monish Maheswaran retweeted
Flash-KMeans has been accepted to NeurIPS 2026 as a poster! 🎉 Really happy to see the work getting interest from the community. Nice collaboration with @Andy_ShuoYang !
𝗞-𝗺𝗲𝗮𝗻𝘀 𝗶𝘀 𝘀𝗶𝗺𝗽𝗹𝗲. 𝗠𝗮𝗸𝗶𝗻𝗴 𝗶𝘁 𝗳𝗮𝘀𝘁 𝗼𝗻 𝗚𝗣𝗨𝘀 𝗶𝘀𝗻’𝘁. That’s why we built Flash-KMeans — an IO-aware implementation of exact k-means that rethinks the algorithm around modern GPU bottlenecks. By attacking the memory bottlenecks directly, Flash-KMeans achieves 30x speedup over cuML and 200x speedup over FAISS — with the same exact algorithm, just engineered for today’s hardware. At the million-scale, Flash-KMeans can complete a k-means iteration in milliseconds. A classic algorithm — redesigned for modern GPUs. Paper: arxiv.org/abs/2603.09229 Code: github.com/svg-project/flash…
7
8
99
8,788
Monish Maheswaran retweeted
All seven Databricks co-founders began our journey together at UC Berkeley. We started the company in a room in Soda Hall, moved to a small office on Addison Street, and spent our first few years in Berkeley before eventually heading to SF. Two of our co-founders are still on the faculty. Today we announced Databricks Field at California Memorial Stadium, our first collegiate athletics sponsorship. Berkeley shaped everything about how this company thinks, and this is our way of investing in the next generation of students and builders who'll do their best work on that campus. Go Bears! databricks.com/company/newsr…
125
220
53
2,342
228,702
Monish Maheswaran retweeted
Claude has discovered a previously unknown enzyme system hidden in the DNA of bacteriophages. Beside the enzyme’s gene sits a long array of repeating DNA—a structure that looks somewhat similar to CRISPR. We don’t yet understand what this system does, but only a handful of known systems share its features, and all of them are able to cut, copy, and paste DNA. Historically, the discovery of such programmable systems has helped revolutionize medicine. CRISPR, for instance, is now the foundation of genetic medicines. But it will take much more work to learn what this system does, and whether it can be put to similar use. Read more: anthropic.com/news/claude-di…
1,557
5,300
2,640
40,828
25,660,277
Monish Maheswaran retweeted
"stochastic parrot" was a mimetically-fit cognitive virus that spread from 2021-2025; it temporarily blinded many gifted people to the nature of AI progress, burning up crucial years in which they could have helped think through the response to the situation.
275
350
170
3,447
762,324
Monish Maheswaran retweeted
Super excited that #VirtualBiotech is published in @ScienceMagazine today! Tens of thousands of AI scientist agents work together across drug discovery + development, from target discovery to clinical trial design. Our blueprint for agentic R&D 🧵
20
100
20
597
98,916
humans are the weak supervisor. we add less and less to the how. we're still the only source of the what.
Humans with AI are still more productive than AI with AI
1
7
460
ai with ai already wins when there's a verifier. most real work doesn't have one, so human judgment is all there is.
3
104
Monish Maheswaran retweeted
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: darioamodei.com/post/we-must…
10,621
16,366
11,364
87,712
76,978,144
Monish Maheswaran retweeted
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics. The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra. The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
5,682
20,059
14,802
120,074
75,303,814
Monish Maheswaran retweeted
Open-source video generation is now faster than playback without compromising quality. Introducing Video Delta Net (VDN): hybrid attention for live text-to-video with near-lossless quality. VDN accelerates Minimax-H3 by 75 - 90 x, generating 14 seconds of 768p video in 11 seconds on 8× NVIDIA B200 GPUs. Checkpoints + training/inference code + Technical Blog ⬇️ (1/6)
70
172
54
1,229
443,593
Monish Maheswaran retweeted
Today, we're kicking off the first phase of the research preview for Model Hardware Standard (MHS): a new standard for AI agents to safely operate physical equipment in scientific research and advanced manufacturing. Read more: anthropic.com/news/model-har…
548
1,450
837
11,154
3,246,460