
Dad, Chief AI Officer (Nutanix), Board Advisor (MLCommons), PhD Computer Science (@ashishgoel), Btech (IIT Kharagpur), all tweets my own.
Santa Clara CA USA
Joined April 2008
- Tweets375
- Following267
- Followers283
- Likes217
Pinned Tweet
This will be a boon for the traditional enterprise that was grappling with the cost of genAI.
This quoted post is unavailable.
(Debo)jyoti Dutta retweeted
NVIDIA's OpenShell uses the Z3 theorem prover to verify agent actions. When denying a path, it returns the exact constraint adjustment needed.
Binary guardrails just halt the loop. Returning structured counterexamples turns a block into a solvable recovery step.
nvidia.github.io/OpenShell-R…
(Debo)jyoti Dutta retweeted
Does your Claude model really need Claude Code…? 🤔
We evaluate 7 models on Claude Code, Codex, and Pi. Three surprising findings emerge:
1️⃣Harness choice has little effect on task success rate, but can significantly affect the cost
2️⃣A simple harness can be competitive
3️⃣The native harness isn’t always the best.
Millions of people are using coding agents, but the impact of harness choice remains unclear.
(1/n) More details in the thread. 🧵
(Debo)jyoti Dutta retweeted
Dario has written that we need to “pace the frontier,” and Sam has agreed. People may be surprised by my response: go ahead.
You guys are the frontier. By any reasonable metric — market share, revenue growth, model capability — the two of you have a duopoly on frontier intelligence. You’ve also claimed the lead is widening because of recursive self-improvement.
I don’t see what you see in the lab. If the unreleased models are scary enough that you think you should slow down, I support your decision to be responsible.
But stop pretending you need anyone else’s permission. Stop pretending antitrust law has to be suspended so you can form a cartel. Stop pretending you need a regulatory approval process that supersedes product liability. Stop pretending METR is independent when it is intertwined with Anthropic’s investors and staff. Stop pretending you need those same evaluators to police competitors who aren’t even at the frontier.
Most of all, stop pretending the motivation to slow down is purely altruistic. You face massive product-liability exposure if your products enable a truly damaging cyberattack. The market already punishes models that behave in unpredictable or unauthorized ways. After the Hugging Face episode, it is simply good business for OpenAI and Anthropic to trade some raw power for reliability and predictability. Call it alignment if you want. It is also just giving customers what they want.
Pacing the frontier would also create breathing room for a more intelligent conversation about regulation than Bernie Sanders’ “shut it all down.” China is very unlikely to join a global agreement, as you know, and that has to be taken into account as well.
So go ahead and pace the frontier. You are the ones setting it. The easiest way not to build superintelligence is for you to agree not to build it. Demanding your preferred regulatory framework as the price of that will look like blackmail of the public and the political system. So just do it.
If you do, you’ll buy goodwill for the next conversation. If you don’t, we’ll know this was just another bid for regulatory capture — or an election-season psyop.
What an impactful post and a letter. Thank you. Open source and open weight models will be critical for accelerating AI adoption in the society in a safe, fair and equitable manner.
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter.
AI will transform every industry, power every company, and be built by every country.
Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty.
The world needs both frontier closed models and frontier open models.
images.nvidia.com/pdf/Open-W…
Fantastic to see the support for open source and open models from the industry leaders. Thank you!
Very happy to support this on behalf of Google. We have long benefited from open source, are big contributors to open source and in fact have consistently made open weights models with Gemma available from @GoogleDeepMind @demishassabis . Onwards!
The world is deeply unfair.
Some of the most talented people I know are stuck in dead end desk jobs while some of the snarkiest narcissistic tyrannical workhorses are in positions of great power.
This has always greatly saddened me.
After a lot of analysis, I think there are 5 reasons this happens:
1. Refusal to believe / fear of failure. Loss of belief that where there is a will (to enact change), there is a way e.g. “I am just a cog in the wheel. If I say something, no one will listen.” or “if I do this, I will upset somebody”
2. Lack of purpose. You don’t really understand what you’re fighting for and what you believe in. You fight for inconsequential, often selfish, goals. e.g “Will doing this get me a promotion? Should I completely change everything to do this other project cause it will get me a promotion?”
3. Lack of self awareness. I will stand up to this thing I believe in and they will listen to me. e.g intern saying: “why doesn’t the ceo like my view on company strategy?”
4. Refusal to play. The failure to acknowledge that your worldview is only as powerful as your ability to influence others of your worldview OR a complete repudiation of the will to interact with those who don’t share your worldview e.g. “these guys just do what they want. They won’t listen to me. what will happen if I do this?”
5. Refusal to strategize or concede. The unwillingness to play and win a side quest that will ostensibly further your vote because you find the interim goal pointless. Or the inability to concede a battle to fight the war. e.g. “this direction is wrong. I need to fight it (even though it’s a small issue)”
Almost everyone who is bitter or feels stuck in their career boils down to one of these 5 failure modes 1, 2 and 3 are the most common. Many suffer consequences of 2-5 and end up in 1. I’ve personally seen some of my sharpest friends land up in 1 because they just don’t believe they can win.
One privileged part of my job is getting to interact with people who are willing to, against all odds, believe in something heretical, know why it’s important, know what needs to be done to make it real, do it, and make side quests to get it done. I think it applies to everyone doing anything.
linkedin.com/posts/dedutta_a… what do you think?
We need to “own” our own intelligence in a healthy, fair and equitable way.
Over the last two weeks, both the U.S. Government and Anthropic took significant actions that demonstrated their power to control access to AI by restricting what others can do with frontier models. This has been one of those moments that, once seen, will be hard to unsee, and it is significantly accelerating many businesses’ and nation states’ efforts to ensure reliable access to AI that no one else can terminate.
Anthropic first released Claude Fable 5, a version of its Mythos model with additional guardrails, including some restrictions that seem well justified on safety grounds (such as limitations on applying it to hacking, bioweapons, and so forth). However, it also restricted developers’ ability to use it to build competing LLM technology. This move was concerning, given that the whole AI community, including Anthropic, has benefitted tremendously from open research — indeed, the AI revolution was kicked off by my former team (Google Brain) freely publishing the Transformers paper!
Imagine if Microsoft’s terms of use barred anyone from using their tools to build competitive software, or if Google barred using it to search for information to work on competing search engines. Anthropic’s argument that it was unsafe for others to be able to make advances in AI also rang hollow. Initially, Anthropic silently degraded Fable 5’s performance for users detected to be working on LLM research through invisible interventions that weakened the model’s outputs without notifying the user. After significant backlash, it walked back this decision and decided to be transparent when it did this, but it still refuses to use its latest capabilities to help AI researchers.
This move represents a raw demonstration of power by Anthropic. It has used “safety” arguments to hinder potential competitors. Platforms succeed when they are viewed as stable, reliable partners that one can build on. The sudden rule changes by Anthropic (including a mandatory 30 day data retention policy for Fable usage) have made developers wonder about the stability of building on any one proprietary LLM provider, not just Anthropic.
The U.S. Government then shortly followed with an even greater demonstration of power. It used the Commerce Department’s authority to regulate technologies that may be national security threats to restrict exports of Mythos and Fable, requiring a license for use by any foreign national, whether inside or outside of the U.S., including employees of Anthropic. This led Anthropic to disable access to Fable to all users worldwide.
Sam Altman pointed out, referring to Anthropic, “It is clearly incredible marketing to say, ‘We have built a bomb, we are about to drop it on your head. We will sell you a bomb shelter for $100 million.’” But when one engages in this type of fear-based marketing, it increases the odds that the U.S. Government will agree with you and slap export controls on the bomb you say you have built.
To be clear, I don't think Anthropic has built anything like a bomb, and I don't think export controls on Fable are appropriate.
However, following the U.S. Government making this move, many nations, including U.S. allies, saw how the U.S. can suddenly yank their access to AI models. In many capitals around the world, this has spurred discussions on AI sovereignty and how others can ensure uninterrupted access to this critical technology.
For decades, many nations were comfortable having many parts of their supply chain rely on the U.S., China, and other major producers. Once a nation issues a threat, or takes action, to limit other nations’ access, other nations will rationally try to secure alternatives. For decades, semiconductor manufacturing in China made slow progress; once the U.S. moved to limit China’s access, China’s efforts kicked into high gear. Similarly, once China threatened U.S. access to rare earth minerals, U.S. efforts to secure alternatives accelerated. Now that it has become crystal clear that private U.S. companies and the U.S. government can limit, in short order, other nations’ access to frontier AI models, the incentive of others to invest more in alternatives like open source grows significantly. Of course, training frontier models is not easy, so it remains to be seen how successful they are, but we have crossed the rubicon.
Satya Nadella wrote an essay about the importance of building a healthy ecosystem on top of frontier AI technology. I heartily agree with him, and hope this week’s events will ultimately prove to be constructive steps toward this.
I hope we can build a more free, more open world, where research is freely shared, and laws and societal norms shape a level playing field that allows everyone to make progress. A silver lining of the events of these past two weeks is now that everyone better realizes key points of instability of the current system, we can all work to create a more stable foundation.
[Original text: The Batch newsletter]
Couldn’t agree more. Two tier intelligence is the AI strategy and every LLM call should go through gateway or a router. Own/control your intelligence!
Your margin is my opportunity: AI version…
The biggest surprise of 2026 is that the capability gap between the best open-weight/source models and the best closed models has narrowed much faster than the pricing gap. The pricing gap remains enormous while the capability gap is quite narrow.
What does this means in practice?
For a company consuming 1 billion input tokens and 1 billion output tokens per month:
GPT-5.5 Pro: ~$105,000
Claude Opus 4.8: ~$30,000
DeepSeek V4 Pro: ~$5,220
DeepSeek R1: ~$2,740
I asked ChatGPT what it thought about this and it answered as follows:
“If I were building a company today, the economic frontier would look roughly like:
DeepSeek V4 Pro / R1 for high-volume inference.
Claude Opus for premium agent workflows where reliability matters.
GPT-5.5 Pro only for workloads where its incremental capability demonstrably produces enough business value to justify a 20–40× token premium.”
Most CEOs have no idea that, instead of this nuanced approach, their teams are running amok internally by picking the most expensive models in most cases and burning through massive budgets with zero governance, audit ability and control.
As control planes like our Software Factory become more standard, you can expect the run rate revenue growth of the frontier labs to go down meaningfully and the revenues of the open models to skyrocket.
Why? Because we can implement the nuanced approach above and be agnostic to model - instead focusing on customer intent, model task and cost management among other things.
This is great to see. The scientific community & the general public should be in the habit of celebrating amazing scientific achievements with standing ovations 🎉
This is not simply a new pancreatic cancer drug.
It is a reminder that even “undruggable” biology can become treatable with persistence.
Daraxonrasib doubled median OS vs chemotherapy in RAS G12 metastatic pancreatic cancer: 13.2 vs 6.6 months.
A remarkable ASCO moment.
#ASCO26
@DrChoueiri @TiansterZhang @CathyEngMD @montypal @tompowles1 @brian_rini @cdanicas @GlopesMd @PGrivasMDPhD @nataliagandur @yekeduz_emre @neerajaiims @ASCO @ONCOassist @OpenMedicineHQ @MedwatchKate @scserendipity1 @CParkMD @urotoday @OncLive @crisbergerot @urologysummit @SuyogCancer @Larvol @IMG_Oncologists
Billionaire Michael Milken joked “if a US company replaces the US-born CEO with a CEO born in India, I buy the stock”
But he reveals he hasn’t backtested the idea.
So we did.
In the last 15yrs, that would’ve 50x’d your money: 7.5x more $$ and >2x IRR vs S&P500: 30% vs 14%!
The future is here
Personal AI is nigh
tested out @antirez' ds4.c this morning. so impressive and delivers.
on a M3 max, 128GB, stock ds4 settings:
- 14–15 t/s at 62K pre-filled actual coding conversation
- memory usage was flat during gen ~85GB res
- disk cache is ~8GB for a full 100K context window
- thermals were normal, light fan activity
- inference server is rock solid so far
biggest constraint: anytime there's a compact, we pay the wait-time price of a fresh prefill (~1min per 10k context) before we are back in action.
sequential inference + multiple agents in parallel performance is unclear, will report back.
I'm so amped.
The thesis is simple: the future belongs to individuals who build compounding AI systems, not to individuals who use corporate-owned centralized AI tools.
I'm trying to build these in open source so you can have them for free. That's what GBrain is.
(Debo)jyoti Dutta retweeted
An update regarding the future at @Cloudflare. I’ve shared my full message to the team and details on the support we're providing those departing here: blog.cloudflare.com/building…
Very relevant discussion. How do we build trust with ai agents for developing complex systems and infrastructure?
Coding agents are accelerating different types of software work to different degrees. When we architect teams, understanding these distinctions helps us to have realistic expectations. Listing functions from most accelerated to least, my order is: frontend development, backend, infrastructure, and research.
Frontend development — say, building a web page to serve descriptions of products for an ecommerce site — is dramatically sped up because coding agents are fluent in popular frontend languages like TypeScript and JavaScript and frameworks like React and Angular. Additionally, by examining what they have built by operating a web browser, coding agents are now very good at closing the loop and iterating on their own implementations. Granted, LLMs today are still weak at visual design, but given a design (or if a polished design isn’t important), the implementation is fast!
Backend development — say, building APIs to respond to queries requesting product data — is harder. It takes more work by human developers to steer modern models to think through corner cases that might lead to subtle bugs or security flaws. Further, a backend bug can lead to non-intuitive downstream effects like a corrupted database that occasionally returns incorrect results, which can be harder to debug than a typical frontend bug. Finally, although database migrations can be easier with coding agents, they’re still hard and need to be handled carefully to prevent data loss. While backend development is much faster with coding agents, they accelerate it less, and skilled developers still design and implement far better backends than inexperienced ones who use coding agents.
Infrastructure. Agents are even less effective in tasks like scaling an ecommerce site to 10K active uses while maintaining 99.99% reliability. LLMs' knowledge is still relatively limited with respect to infrastructure and the complex tradeoffs good engineers must make, so I rarely trust them for critical infra decisions. Building good infrastructure often requires a period of testing and experimentation, and coding agents can help with that, but ultimately that’s a significant bottleneck where fast AI coding does not help much. Lastly, finding infrastructure bugs — say, a subtle network misconfiguration — can be incredibly difficult and requires deep engineering expertise. Thus, I’ve found that coding agents accelerate critical infrastructure even less than backend development.
Research. Coding agents accelerate research work even less. Research involves thinking through new ideas, formulating hypotheses, running experiments, interpreting them to potentially modify the hypotheses, and iterating until we reach conclusions. Coding agents can speed up the pace at which we can write research code. (I also use coding agents to help me orchestrate and keep track of experiments, which makes it easier for a single researcher to manage more experiments.) But there is a lot of work in research other than coding, and today’s agents help with research only marginally.
Categorizing software work into frontend, backend, infra, and research is an extreme simplification, but having a simple mental model for how much different tasks have sped up has been useful for how I organize software teams. For example, I now ask front-end teams to implement products dramatically faster than a year ago, but my expectations for research teams have not shifted nearly as much.
I am fascinated by how to organize software teams to use coding agents to achieve speed, and will keep sharing my findings in future posts.
[Original text: deeplearning.ai/the-batch/is… ]
(Debo)jyoti Dutta retweeted
Hello. How are you? Thank you. I love you. Please.
Some of the most frequently translated phrases of the past 20 years!
Google Translate began twenty years ago with a mission to help people understand one another, regardless of the language they speak. What started as a small experiment has become a global tool that helps over 1 billion users every month.
In that time Translate has evolved from simple pattern matching to true understanding. In 2006, it relied on statistical machine learning to look for patterns in small word clusters. By 2016, we pioneered a shift to neural networks to move beyond literal word-for-word translations, and today we’re using our powerful Gemini models to make Translate even more helpful.
We are moving from text to fluid, real-time conversations. With our latest models, you can even use your headphones as a personal interpreter that preserves your original tone and cadence - it’s an amazing experience!
One of the interesting things about AI is that as we make progress, we begin to take it for granted. If you met a person who could translate across a hundred languages faster than any human can, you would be so impressed. Today, one product does that for nearly 250 languages, and we kind of just shrug.
Being able to say thank you in 250 languages is not something I take for granted. So to the 1 billion who use Google Translate - merci, dhanyavaad, arigatō, gracias, and thank you! Let’s see what the next 20 years will bring.
(Debo)jyoti Dutta retweeted
If you want to make sense of where the AI inference stack is heading, look at three releases in the last few days.
GLM-5.1 - open weights, 744 billion parameters. Beats the king (aka Claude Opus 4.6) on several coding tasks.
Gemma 4 - open weights, runs on a single GPU or on-device. The 31B model ranks #3 among all open models globally, while smaller variants run natively on consumer hardware.
Mythos - closed, restricted, and a dramatic change in performance from everything currently available. Priced 10x more than its open counterparts.
Three releases. Three completely different bets on what AI should be.
What we are likely going to see is bifurcation across every dimension. Smaller models will keep shrinking while getting smarter. Open-weight models will keep scaling toward the frontier. Closed frontier models keep breaking the ceiling and become more restrictive.
In many ways, this will be similar to the computing infra that has led to this moment. Except much faster and roughly at the same time.
Mobile, cloud, and PCs didn't kill each other. Each expanded the niche it occupied and created new markets. The model landscape is heading in the same direction with extreme diversity instead of consolidation. In retrospect, we will find the whole current discussion of open vs closed vs on-device to be as stupid as debating mobile vs cloud vs PCs.
Mobile banks on connectivity, web and individual empowerment.
PC users are more prosumers and creatives doing professional work and creating value from the computing infra.
Cloud quietly forms the backbone on top of which modern society runs and comes with more capability and security.
I assume a similar dynamic will happen across these different classes of models.
This is good for the ecosystem and opens a slew of opportunities for companies building on top of it. By combining them in different ways, you end up with a much bigger combinatorial space of systems. The systems that win won't be the ones that bet on open or closed, big or small. They'll be the ones who can move fluidly across the frontier as it shifts.
More folks need to try this experiment out. We need more open weights near SOTA models. Don’t rent your intelligence, own and control it!
I burned 84 million tokens on February 28th. Researching companies, drafting memos, running agents.
That’s running Kimi K2.5, a serverless model via API. At Claude or OpenAI rates — roughly $9 per million tokens blended — equivalent usage would cost $756 for a single day’s work. My peak days hit 80 million tokens. My average days run 20 million. Cloud inference at frontier-model pricing adds up fast.
we're making @blocks smaller today. here's my note to the company.
####
today we're making one of the hardest decisions in the history of our company: we're reducing our organization by nearly half, from over 10,000 people to just under 6,000. that means over 4,000 of you are being asked to leave or entering into consultation. i'll be straight about what's happening, why, and what it means for everyone.
first off, if you're one of the people affected, you'll receive your salary for 20 weeks + 1 week per year of tenure, equity vested through the end of may, 6 months of health care, your corporate devices, and $5,000 to put toward whatever you need to help you in this transition (if you’re outside the U.S. you’ll receive similar support but exact details are going to vary based on local requirements). i want you to know that before anything else. everyone will be notified today, whether you're being asked to leave, entering consultation, or asked to stay.
we're not making this decision because we're in trouble. our business is strong. gross profit continues to grow, we continue to serve more and more customers, and profitability is improving. but something has changed. we're already seeing that the intelligence tools we’re creating and using, paired with smaller and flatter teams, are enabling a new way of working which fundamentally changes what it means to build and run a company. and that's accelerating rapidly.
i had two options: cut gradually over months or years as this shift plays out, or be honest about where we are and act on it now. i chose the latter. repeated rounds of cuts are destructive to morale, to focus, and to the trust that customers and shareholders place in our ability to lead. i'd rather take a hard, clear action now and build from a position we believe in than manage a slow reduction of people toward the same outcome. a smaller company also gives us the space to grow our business the right way, on our own terms, instead of constantly reacting to market pressures.
a decision at this scale carries risk. but so does standing still. we've done a full review to determine the roles and people we require to reliably grow the business from here, and we've pressure-tested those decisions from multiple angles. i accept that we may have gotten some of them wrong, and we've built in flexibility to account for that, and do the right thing for our customers.
we're not going to just disappear people from slack and email and pretend they were never here. communication channels will stay open through thursday evening (pacific) so everyone can say goodbye properly, and share whatever you wish. i'll also be hosting a live video session to thank everyone at 3:35pm pacific. i know doing it this way might feel awkward. i'd rather it feel awkward and human than efficient and cold.
to those of you leaving…i’m grateful for you, and i’m sorry to put you through this. you built what this company is today. that's a fact that i'll honor forever. this decision is not a reflection of what you contributed. you will be a great contributor to any organization going forward.
to those staying…i made this decision, and i'll own it. what i'm asking of you is to build with me. we're going to build this company with intelligence at the core of everything we do. how we work, how we create, how we serve our customers. our customers will feel this shift too, and we're going to help them navigate it: towards a future where they can build their own features directly, composed of our capabilities and served through our interfaces. that's what i'm focused on now. expect a note from me tomorrow.
jack

























