
research @berkeley_ai research fellow @AnthropicAI prev. @togethercompute @apple @Berkeley_EECS
California
Joined September 2018
- Tweets98
- Following1.3K
- Followers748
- Likes185
Pinned Tweet
Super excited to Introduce our latest work: Squeeze Evolve.
We unify test-time scaling methods into one evolutionary framework — then orchestrate many models across it.
3x lower cost. 10x throughput. 97.5%(SoTA) on ARC-AGI-V2. No verifier required.
Framework: squeeze-evolve.github.io/
Great work @MahitNamburu! Congrats on the launch
Introducing Probe: The Agent-Native Research Stack.
Our goal is simple: help AI/ML teams run better experiments, faster.
Teams run research with agents now, but their work is disordered. They lose hours verifying what their agents actually did, managing environments and compute, and re-explaining company context their agents should already know.
So we rebuilt the research stack from the ground up for agent-driven research.
Probe brings core research tools, shared context from past experiments, and visibility into each run together in one platform.
Teams can spend less time setting up infrastructure, supervising agents, and catching teammates up, and more time testing ideas.
If you’re a research lab, scale your research team without sacrificing speed.
If you’re an AI/ML team, stand up a research capability with the infrastructure of a frontier lab.
See Probe for yourself: useprobe.ai/
Monish Maheswaran retweeted
Really nice work! This supports some of my ad-hoc observations and intuitions from working on evolutionary systems and self-verification over the past year.
- While experimenting with verifier-free evolution methods combining parallel and sequential reasoning (RSA/PDR: arxiv.org/abs/2509.26626, arxiv.org/abs/2510.01123), I found that truncating the reasoning traces and keeping only the final answers (or a summary + final answers) before aggregation (roughly analogous to the communication step in multi-agent systems) often worked better. IIRC, @sudomonish also noticed something similar with SqueezeEvolve (arxiv.org/abs/2604.07725). We also observed that removing the reasoning traces made models reason for longer during aggregation, whereas retaining them made models more conservative and more likely to terminate early. This seems closely related to the papers finding that forgetting increased median reasoning tokens from 2.9k to 9.4k per proposal and leads to larger code edits as well.
- While working on self-verification (our V1 paper: arxiv.org/abs/2603.04304v1), I also noticed that self-verification performance improved when we removed the original reasoning trace and gave the model only the final answer to verify. My intuition was that models become more biased toward their own answers when they see the reasoning that led to those answers. This is consistent with @Jacklu_me's paper on verification (arxiv.org/abs/2512.02304), which shows that models are more likely to accept solutions resembling their own, while cross-family verification tends to work better. Truncating the original reasoning trace might make the answer feel more "alien" to the model during self-verification, potentially reducing this bias. The model might then spend more tokens independently verifying the answer rather than relying on the earlier reasoning. Interestingly, autoresearch agents also might be implicitly or explicitly self-verifying their own ideas and proposed changes, even when external evaluators score the resulting candidates. So I wonder if better self-verification after forgetting might also be contributing to the improvements observed in the autoresearch loops of the paper.
Monish Maheswaran retweeted
While exploring diffusion language models (DLMs), we kept asking ourselves: given speculative decoding, a lossless acceleration technique, why do we still need DLMs? 🤔 Our latest work, ORL, tries to answer this question: AR optimizes intelligence 👆, speculative decoding optimizes speed 👉, and DLMs optimize the Pareto frontier of speed and intelligence 🚀. Through co-design across the algorithms, the training and inference engine, and the kernels, ORL pushes out a new Pareto frontier of intelligence and speed. Similar performance, much faster than speculative decoding. You say lossy spec? ORL-DLM is better too! 😎
🌐 Project + live demos: introspective-diffusion.gith…
Monish Maheswaran retweeted
Hi, I'm Felix. I'm an eng lead working on Claude. I love watching people take flight and do things they never thought possible.
We often describe that as "being more ambitious" when using AI, which is tricky advice to follow. I wrote a tutorial:
felixrieseberg.com/how-to-be…
Amazing work! Congrats @Harman26Singh! Highly recommend reading this 🚀
The only citation that matters is research → prod.
Fun fact about (some) AI researchers / academics: the more senior you get, the more convinced you become that every new AI idea is something you already invented 20 years ago. Or, even better: wait until something actually works and then try convincing everyone that this is exactly what you’ve been saying all along.
I was at a conference where a speaker was presenting their research. One academic stood up and said: what you’re doing is actually something I did a few years ago. The speaker was very polite and said thank you for pointing this out.
Then a second researcher stood up and said, well I already did it this 10 years ago, you should cite my work. Then a third person said, I already did all of this about 20 years ago.
It was the funniest thing ever.
Monish Maheswaran retweeted
Our I-DLM work will be presented as an Oral Spotlight at #COLM2026 this Thursday! 🎉
📍 Introspective Diffusion Language Models
🗓 Thu, Oct 8 4:15–4:30 PM PDT at Grand Ballroom
Come join us to see how introspective consistency helps DLMs match AR quality while keeping fast parallel decoding. 🚀
Amazing work with @Yifan_YYU , Yuqing Jian, @_junxiong_wang , @ZhongzhuZhou, @Donglin07326431 , Xinyu Fang, @srivyanamandra, @XiaoxiaWShirley , @QingyangWu1, @Leon75421958, @tri_dao, @ben_athi, @james_y_zou, Fan Lai, see you at COLM! Happy to chat more about Diffusion Language Model :)
Monish Maheswaran retweeted
Catch @shulynnliu and me presenting the EvoX poster at #COLM2026 on Thursday at 11:00 AM! 🧬💥
We’re expanding from evolving algorithms to actually building large-scale systems with agents 🤖⚙️
Stop by to chat meta-evolution & the future of autonomous systems! 👋
Researchers spend hours and hours hand-crafting the strategies behind LLM-driven optimization systems like AlphaEvolve: deciding which ideas to reuse, when to explore vs exploit, and what mutations to try.
🤖But what if AI could evolve its own evolution process?
We introduce EvoX, a meta-evolution pipeline that lets AI evolve the strategy guiding the optimization. It achieves high-quality solutions for <$5, while existing open systems and even Claude Code often cost 3-5× more on some tasks.
Across ~200 optimization problems, EvoX delivers the strongest overall results: often outperforming AlphaEvolve, OpenEvolve, GEPA, and ShinkaEvolve on math and systems tasks, exceeding human SOTA, and improving median performance by up to 61% on 172 competitive programming problems. 👇
Monish Maheswaran retweeted
We'll be spending a lot more time trying to understand the outputs of language models. A few thoughts, tips & tricks:
Writing. Something I've had success with: Ask your LLM to explain something in ASD-STE100, it's a controlled language specification originally developed for aerospace maintenance documentation. LLMs well-versed in this language and it comes with heavy constraints on clean writing style that I often find a lot more readable. Sometimes I've tried to soften it a bit e.g. ask for "80% of the way to ASD-STE100" because the spec is quite stringent. But even better:
Diagrams / images. Instead of writing, ask your LLM to create a diagram. These can be a lot easier to process, parse, and understand. But even better:
Web pages. Ask for output "in HTML" to get a beautiful, interactive webpage. LLMs are getting really good at frontend and can create beautiful experiences, animations, etc. But even better:
Explainer videos. The output format I am most bullish on is fully custom / bespoke explainer videos generated on any arbitrary topic. Experiment with things like "Create a 3b1b style video explainer on X. Use my ElevenLabs API key for audio narration". (you'd need an API key for the latter or you can ask your LLM to find you decent free alternatives that use your local compute). This is actually starting to work!
In summary:
- As LLMs get better, they will do more and more of the legwork autonomously, and a lot more of our work will rise up the abstractions into oversight and understanding.
- Luckily, LLMs can help here too because as intelligence and code are increasingly abundant, you can ask for large, custom, discardable software artifacts (e.g. web apps, video explainers) that would have never made sense to create before. Push the boundaries here and you'll be surprised.
Monish Maheswaran retweeted
Flash-KMeans has been accepted to NeurIPS 2026 as a poster! 🎉
Really happy to see the work getting interest from the community. Nice collaboration with @Andy_ShuoYang !
𝗞-𝗺𝗲𝗮𝗻𝘀 𝗶𝘀 𝘀𝗶𝗺𝗽𝗹𝗲. 𝗠𝗮𝗸𝗶𝗻𝗴 𝗶𝘁 𝗳𝗮𝘀𝘁 𝗼𝗻 𝗚𝗣𝗨𝘀 𝗶𝘀𝗻’𝘁.
That’s why we built Flash-KMeans — an IO-aware implementation of exact k-means that rethinks the algorithm around modern GPU bottlenecks.
By attacking the memory bottlenecks directly, Flash-KMeans achieves 30x speedup over cuML and 200x speedup over FAISS — with the same exact algorithm, just engineered for today’s hardware. At the million-scale, Flash-KMeans can complete a k-means iteration in milliseconds.
A classic algorithm — redesigned for modern GPUs.
Paper: arxiv.org/abs/2603.09229
Code: github.com/svg-project/flash…
Monish Maheswaran retweeted
All seven Databricks co-founders began our journey together at UC Berkeley. We started the company in a room in Soda Hall, moved to a small office on Addison Street, and spent our first few years in Berkeley before eventually heading to SF. Two of our co-founders are still on the faculty.
Today we announced Databricks Field at California Memorial Stadium, our first collegiate athletics sponsorship.
Berkeley shaped everything about how this company thinks, and this is our way of investing in the next generation of students and builders who'll do their best work on that campus.
Go Bears!
databricks.com/company/newsr…
Monish Maheswaran retweeted
Claude has discovered a previously unknown enzyme system hidden in the DNA of bacteriophages. Beside the enzyme’s gene sits a long array of repeating DNA—a structure that looks somewhat similar to CRISPR.
We don’t yet understand what this system does, but only a handful of known systems share its features, and all of them are able to cut, copy, and paste DNA. Historically, the discovery of such programmable systems has helped revolutionize medicine. CRISPR, for instance, is now the foundation of genetic medicines. But it will take much more work to learn what this system does, and whether it can be put to similar use.
Read more: anthropic.com/news/claude-di…
Monish Maheswaran retweeted
"stochastic parrot" was a mimetically-fit cognitive virus that spread from 2021-2025; it temporarily blinded many gifted people to the nature of AI progress, burning up crucial years in which they could have helped think through the response to the situation.
Monish Maheswaran retweeted
Super excited that #VirtualBiotech is published in @ScienceMagazine today!
Tens of thousands of AI scientist agents work together across drug discovery + development, from target discovery to clinical trial design. Our blueprint for agentic R&D 🧵
humans are the weak supervisor.
we add less and less to the how. we're still the only source of the what.
Monish Maheswaran retweeted
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: darioamodei.com/post/we-must…
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics.
The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra.
The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
Monish Maheswaran retweeted
Open-source video generation is now faster than playback without compromising quality.
Introducing Video Delta Net (VDN): hybrid attention for live text-to-video with near-lossless quality.
VDN accelerates Minimax-H3 by 75 - 90 x, generating 14 seconds of 768p video in 11 seconds on 8× NVIDIA B200 GPUs.
Checkpoints + training/inference code + Technical Blog ⬇️
(1/6)
Monish Maheswaran retweeted
Today, we're kicking off the first phase of the research preview for Model Hardware Standard (MHS): a new standard for AI agents to safely operate physical equipment in scientific research and advanced manufacturing.
Read more: anthropic.com/news/model-har…
























