SVP/Head of Eng at https://xitter.cf/t.co/y26hKoaPqH ex-{Snowflake, Google, FB/Meta, Uber, Apple, AMD}

Palo Alto, CA
Joined October 2008
This is the unlock for real-time coding agents. DeepSeek just wrote a full Tetris game in ~5 seconds. No more context switching while the model thinks - agent loops are about to feel completely different.
DeepSeek V4.1 Flash 1017 runs at 1,521+ tok/s on Fireworks Ultrafast. Fast enough to ship Tetris in 11 seconds, 7x faster than Claude Opus 5.5. Join the Ultrafast waitlist: bit.ly/3UA0wKq
1
3
125
This is research done in the right direction. The question wasn’t “can we make it smarter.” It was “can we make it stop talking so much and still be just as good.” Apparently yes. 40% fewer tokens. And now it’s sitting on top of HN.
Ember-1 is hot on HN, our research team cooked it’s Kimi K3 post trained to be 40% more concise in reasoning same quality, 40% faster and cheaper
1
7
577
The expensive part of a reasoning model is not the answer. It’s the tokens spent getting there. Ember-1 is what happens when research and serving are the same stack: shorter traces, same quality, live on serverless.
Ember-1 is a specialized model from Fireworks Research designed to make every token go further. Built on Kimi K3, it produces shorter reasoning traces, using roughly 40% fewer tokens while maintaining top-tier quality. fireworks.ai/models/firework…
4
664
Generic leaderboards answer "who’s smartest." SII answers "smartest at what, at what cost, in production."
Today we're launching the Specialized Intelligence Index (SII): one destination for real-work benchmarks across industries, built by the teams that use them every day. Hear from Fireworks co-founder @the_bunny_chen on the importance of specialized benchmarks:
3
446
Dwarak Rajagopal retweeted
Many assume that agent spend goes toward output tokens. When we ran DeepSWE on Astra vs. DeepSeek V4.1-Flash, input tokens outnumbered output 174 to 1. 99.6% were cache hits. Those hits are 60% of the bill. Net result? Same quality. $0.43/task vs $6.52.
34
17
8
199
24,179
Dwarak Rajagopal retweeted
Meet Gen-1 Slides, Genspark’s first model designed for knowledge work. Trained with @FireworksAI_HQ from an open-weight base, Gen-1 Slides now powers Standard mode in Genspark AI Slides, delivering frontier quality decks at roughly 1/17th of Opus 5’s price. Fewer midnight fixes. Better decks by default. Read the full blog: genspark.ai/blog/gen-1-slide…
15
26
13
180
69,881
Specialized models just got a real training API. GA today.
The most ambitious companies are training models to outperform the frontier on the capabilities that differentiate their business. Today, we announce the general availability of our Training API and Fireworks Lab, making model specialization accessible to all organizations.
1
301
Dwarak Rajagopal retweeted
I am the product lead for the training platform at @FireworksAI_HQ . Today the Training API and Fireworks Lab are GA. I won’t walk you through all the features. I want to tell you why teams train with us, because it's usually not the reason you'd expect. Some teams treat training like a project. Pick a model, tune it, ship it. Done. The teams that win don't think that way. For them it's a long-term bet on owning their AI. And a bet like that needs a partner across the whole development cycle, not one piece of it. The silent killer is getting the infrastructure wrong. In RL at scale, training and inference stop being two systems and become one loop. The challenges start with model choice, GPU procurement, and room to scale when the run grows. They get harder once the loop is running. Numerics drift between the trainer and the rollout engine, and your learning signal corrupts while every dashboard says the run is fine. GPUs sit at synchronization barriers waiting on a handful of long completions. Weight sync eats the step time you thought was going to training. Most teams find this weeks in, after stitching compute, inference, and training together themselves. The second gap is expertise, and few organizations hold frontier-lab talent at every layer of the stack. Harness, eval, and reward design. Synchronous or async RL. How much weight staleness the algorithm tolerates. Every one of those is a place to stall, and none of them is the actual problem you set out to solve. The problem was the thing you wanted the model to do. The rest is tax. That's the difference between a product and a partner. We bring the frontier lab-grade infrastructure and meet you wherever you are. Start on Managed Training, bring your data or evals, we run the loop. Want more control, use the Training API on Serverless and iterate on your reward or recipe fast. Ready to scale, move to Dedicated for full-parameter runs. Want people in the room, Fireworks Lab embeds researchers, engineers, and a PM with your team, from co-design all the way to a custom build we hand over. Same platform the whole way up, every model already enabled for training on elastic compute. You're not locked to one model, one GPU type, or one cluster size. The pushback I sometimes get is "we'll just do this in-house," and my answer is "at what cost?" How much do you value time to market? And where do you draw the line on quality? Customers tell us they get 2-4x more iteration on the same budget with us than with DIY or other setups. For most, the higher-ROI move is to put their people on data, evals, and product taste and let us do the rest better, faster, and cheaper. Because none of it matters if the model isn't good enough to ship. That's the part people miss. Done right, a specialized model doesn't just keep up with the frontier on your task. It beats it. One more thing on cost, because people benchmark it wrong. It's not about cheap GPU-hours. It's quality per GPU and how fast you iterate on performance/quality. We've had large tech teams run full-parameter RL on Fireworks with a fraction of the GPUs their in-house setup needed. Cheap hours don't help if you need twice as many and move half as fast. We've run RL on 10,000+ GPUs, so this holds at real scale. Full-parameter, not just LoRA. Renting intelligence gets you the average of everyone's tasks, at a premium, on someone else's roadmap. Owning yours is a bet you should make with the right partner. Build your own frontier → fireworks.ai/training
The most ambitious companies are training models to outperform the frontier on the capabilities that differentiate their business. Today, we announce the general availability of our Training API and Fireworks Lab, making model specialization accessible to all organizations.
6
13
1
147
20,892
Quality with speed isn’t day-0 at all costs. If we can’t explain the tokens, we don’t ship the model.
GLM-5.3-Flash is live on Fireworks on day… 2 Why? Because we take quality very seriously. We found a benchmark discrepancy we couldn’t explain, so we delayed the launch to investigate. Day 0 (Wed): we saw 2x longer thinking on reasoning-heavy benchmarks (AIME & GPQA) for open source engines compared with @Zai_org API. Same scores, worse token efficiency. Agentic benchmarks looked good. We decided to investigate further, as overthinking might become a quality problem if max_tokens are reached Day 1 (Thu): as other non-official providers launched, their APIs had thinking in the range of open-source engines: longer than Z.ai. We launched a private preview endpoint with disclaimers to a few customers and worked with them to assess quality Day 2 (Fri): the official Z.ai API updates. We rerun benchmarks: reasoning is now similarly long, consistent with vllm/sglang. Rest of the benchmarks, both public and internal, check out too. We launched GLM-5.3-Flash publicly: fireworks.ai/models/firework… More details below
5
765
RT @lqiao: Excited about Ox Alpha! Will get it on Fireworks.
1
10
Dwarak Rajagopal retweeted
You can only be considered a post-training provider if you work with Harvey
8
6
5
256
29,685
Dwarak Rajagopal retweeted
Replying to @github
📣 @Kimi_Moonshot's Kimi K3, an open-weight model, is now generally available and rolling out in GitHub Copilot. The model shows frontier-level abilities on agentic coding with highly cost-effective pricing. It is hosted by @FireworksAI_HQ. Learn more. 👇 github.blog/changelog/2026-0…
2
4
21
1,718
Dwarak Rajagopal retweeted
Running fast is not enough, you need fast AND correct An excellent addition from @ArtificialAnlys to make sure that the flashy speed numbers are backed by 100% matching accuracy
Announcing the Artificial Analysis Endpoint Accuracy Index, measuring how much of an open weights model's accuracy each serverless API endpoint preserves. We are initiating coverage with GLM-5.2, gpt-oss-120b and DeepSeek V4 Pro, with Kimi K3 coming soon Providers trade off accuracy to optimize for speed and cost. They quantize weights, write custom kernels and tune their inference stacks, and sometimes they simply ship bugs. We are bringing the rigor of our Artificial Analysis Intelligence Index to measuring endpoints, so developers can pick providers on accuracy, not just price and speed We benchmark each serverless endpoint against our own self-hosted reference deployment of the official weights, where 100% represents matching the reference. An endpoint is at reference parity when its result falls within the 95% confidence interval of the reference. Coverage is live for GLM-5.2, gpt-oss-120b and DeepSeek V4 Pro, with Kimi K3 accuracy coverage launching soon Key elements of the Endpoint Accuracy Index: ➤ Three areas, equally weighted: tool calling (BFCL-500, 500 questions, 3 repeats), scientific reasoning (HLE-250, 250 questions, 10 repeats) and long context recall (AA-LCR-25, 25 questions, 10 repeats). Each subset separates endpoints on the serving choices that drive accuracy differences, with repeats sized for tight confidence intervals ➤ Reference deployment: we self-host the official weights at the lab's recommended precision, following the lab's serving recipe, and publish the complete commands for each reference ➤ Inference parameters: we run the model's highest supported reasoning mode and each endpoint's highest supported output length and context window ➤ Confidence intervals: the parity test accounts for uncertainty in both the endpoint's runs and the reference's runs ➤ Rotating coverage: models enter once sufficient number of providers serve them and exit when a newer version in the same family supersedes them. We benchmark new endpoints as providers launch them and refresh all listed endpoints periodically ➤ Point in time: each result carries the date it was measured, with multi-day benchmarks dated to their final day Key results for GLM-5.2 ➤ Output token limits restrict accuracy. Restrictive limits cut responses off before the model finishes reasoning, and the most restrictive endpoints score half the reference or less on HLE-250 Key results for gpt-oss-120b ➤ Tool call handling separates endpoints. Providers parse and format tool calls differently, and some endpoints score 22% on BFCL-500 against 37% for the reference ➤ Serving configuration changes what the model does at the same requested settings. Some endpoints produce far fewer reasoning tokens at the same configured level, and restricted context windows truncate long context tasks Key results for DeepSeek V4 Pro ➤ DeepSeek V4 Pro endpoints are more in line with the reference. Majority of the endpoints are at reference parity, and DeepSeek's own first-party endpoint scores slightly above the reference
8
12
2
139
18,878
I’m excited to share my next chapter: I’ve joined @FireworksAI_HQ . From AMD, Apple, Uber, Meta, Google, and most recently Snowflake, I’ve worked on many of the foundational technologies that power modern compute and AI. Back at Meta, I had the privilege of being in the trenches alongside @lqiao and other early team members building PyTorch. Reuniting with that crew makes this an incredible full-circle moment. Lin Qiao and I share a fundamental belief: the future of AI won’t be defined by one or two general-purpose models, but by specialized intelligence tailored to every enterprise, product, and domain. That shared vision is why you may have seen some big news about Fireworks recently! Building specialized intelligence requires more than just great open models; it requires a platform that makes training, serving, optimizing, and operating specialized intelligence practical at scale. That is exactly what the team here has built, matching a world-class infrastructure stack with an engineering culture that rivals any I’ve ever worked with. We are just getting started. Thrilled to be back building with old friends. Let’s build.
9
4
1
49
19,224
This is an insanely good model!!
Introducing Kimi K3: Open Frontier Intelligence 🔹 2.8 Trillion Parameters, 1 Million Context, Native Multimodal 🔹 Kimi Delta Attention enables up to 6.3x faster decoding in million-token contexts 🔹 Attention Residuals deliver ~25% higher training efficiency at <2% additional cost 🔹 Built for long-horizon agentic coding and self-evolving workflows Kimi K3 is now live on on Kimi.com, Kimi Work, Kimi Code, and the Kimi API. Open Weights by July 27, 2026. 🔗 API: platform.kimi.ai 🔗 Tech blog: kimi.com/blog/kimi-k3
1
827
Satya is right about the Reverse Information Paradox. You pay for the model with money and by giving it your proprietary prompts, corrections, traces, and evals. The richer your data, the more your edge leaks into their system. This is exactly why owning vs renting intelligence is such an important distinction. Use the powerful models, but keep your closed learning loops private: your evals, memory, feedback, and adaptations inside your own boundary. Decouple orchestration so you can swap bases without losing your tuned behavior. Great thread.
1
3
1,503
Dwarak Rajagopal retweeted
If you are on the verge of AGI or ASI, why isn’t your model smart enough to recognize espionage distillation in real time? You say “cure cancer in a few years.” Isn’t sniffing illicit distillation quite a bit easier than curing cancer? Why write letters to DC? Just use AGI.
269
442
107
5,863
521,623
I’m excited to share new research work from the Snowflake AI Research Team focused on advancing enterprise AI systems. Arctic-Text2SQL-R2 is a reasoning model designed for enterprise SQL generation. Trained on Snowflake-native data and optimized for real-world enterprise SQL workloads, the specialized model outperforms larger frontier models on difficult SQL benchmarks despite being 30–150x smaller than other high-performing models. To make specialized models like Arctic-Text2SQL-R2 practical at scale, the team also introduced ZoRRo (Zero Redundancy Rollouts), a set of optimizations that eliminate redundant computation in long-context RL workflows. ZoRRo accelerated RL training by up to 3.5x, reducing runtime from over five days to only 1.5 days. It also reduced memory consumption enough to support 3.2x longer context windows, enabling more efficient training on complex enterprise reasoning workloads. Together, this work demonstrates how the next wave of enterprise AI innovation will be driven by both stronger domain-specific models and more efficient training systems. Read more in the blog posts in the comments: Arctic-Text2SQL-R2: snowflake.com/blog/engineeri… ZoRRo: snowflake.com/blog/engineeri… @yao_zhewei @yuxionghe @samyamrb @jeffra45 @StasBekman
3
10
1,088
Dwarak Rajagopal retweeted
Conference didn't share the attendee list until I arrived. No problem. Pasted the CEO list into @SnowflakeDB Intelligence. 2 minutes later: customers, prospects, ARR — all mapped. This is what AI + your own data looks like in practice. Not a demo. Not a deck. Just answers.
4
6
44
4,654