Meet Simba 3.5: one model, 48 languages, streaming-native. Compatible with every voice, including cloned voices.
Congrats to the @SpeechifyAI team, we're proud to be your partner for inference!
Today we’re releasing two decision models, elephant-1 (9B) and mammoth-1 (27B), trained by the @baselabs team, available for free for one week on our Model APIs.
mammoth-1 is #1 on the Jev Decision Index and elephant-1 is tied for #1 on the Artificial Analysis Decision Index.
It’s a new model, but more importantly, this is an open-source model you can access, deploy, and post-train on Baseten (or wherever you do your best work).
The free week ends 10/27/26 at 11:59 PM PT. Try it and let us know what you think.
Try mammoth-1 here: baseten.co/library/mammoth-1…
Try elephant-1 here:
baseten.co/library/elephant-…
Check out the Jev Decision Index rankings here: huggingface.co/spaces/multim…
See the live @ArtificialAnlys rankings for elephant-1 here: artificialanalysis.ai/evalua…
Agent security belongs in the infrastructure layer.
We’re proud to partner with @nvidia on the OpenShell Reference Architecture, an open architecture for running AI agents with security enforced at the infrastructure level.
We build safety into how we serve models. Base Labs is building open safety infrastructure with @huggingface and @GoodfireAI, and we're bringing Goodfire’s safety monitors in line with inference on Baseten.
We also joined the Open Secure AI Alliance and partnered with NVIDIA on the Open Agent Safety Platform launch.
We’ll keep working with NVIDIA and our partners to give teams the controls they need to confidently run agents in production.
AI agents need fast tool calls and security controls they can’t rewrite.
NVIDIA OpenShell Reference Architecture combines the compute to run agents at scale with runtime controls that govern their access to tools and data.
See how the hardware and software work together: nvda.ws/4BiJBfY
The NVIDIA Nemotron Retriever collection of models is now on Baseten!
Nemotron 3.5 Embed, Parse, and Rerank help agents retrieve useful evidence across text and visual enterprise data.
Try them today: baseten.co/library/family/ne…
Benchmark performance doesn’t matter if it can’t hold up in production.
Major open models launched this month live on Baseten on day zero: DeepSeek v4.1 Flash, Reflection Beam 1.0, and NVIDIA Nemotron Super 3.5 VL.
We're proud that each ranks best on both Artificial Analysis benchmarks and OpenRouter production traffic.
The standard we’re building toward is straightforward. Whichever model you choose, you should expect consistently high performance on Baseten. From your first token to your trillionth.
We're excited to bring Mercury 3 to Baseten!
- Outperforms GPT-6 Luna, Claude Haiku 5.5
- 1,000+ tokens/sec, 4–8x faster
- 1M token context
Get access through our model library: baseten.co/library/mercury-3…
Mercury 3 is live: the most capable diffusion LLM released to date.
It outperforms GPT-6 Luna and Claude Haiku 5.5 across a range of benchmarks while running at over 1,000 tokens per second.
More than 40x the size of Mercury 1, 3x more intelligent across standard benchmarks, and just as fast, with a 1M-token context window.
Available today on the Inception API, @baseten, and @OpenRouter .
How do you build and serve a multi-trillion-parameter model?
A deep dive using Kimi K3 as the case study, from Stable LatentMoE and Attention Residuals to hybrid KDA and MLA attention, plus how they're served in production:
Proud to support the training and serving for Extend Verify, the first document fraud detection API built for agents.
Congrats to the @ExtendHQ team!
AI-generated fake documents grew 500% last year, and humans can no longer tell the difference
That's why we’re launching Extend Verify, the first document fraud detection API built for agents
Verify catches the fastest growing types of document fraud, including:
- fully AI-generated documents
- localized AI edits (down to a single modified character)
- patched text, overlays, and in-painting from Photoshop, PDF editors, and coding agents
- digital tampering after a document was signed
- and many more
In our internal evals, Verify detected over 96% of AI-generated and tampered documents.
Verify is available today: extend.ai/verify/request-acc…
Open models now perform close to frontier closed models on coding, at a fraction of the cost. So which tasks are they right for, and how do you test them on your own codebase?
Join Alex Ker and Molly Elfers on Oct 28 at 11 AM PT for a practical evaluation framework, plus a template to run your own.
baseten.co/resources/webinar…
public benchmarks rarely tell you how a model does in your repo and the full story. so how do you decide which model is optimal for each engineering task?
next week, molly and I will walk through the framework we use with development teams to evaluate open models for coding agents, powering the fastest growing ai applications in the world.
we'll cover which models to shortlist, how to run a successful pilot without changing your harness, and how to measure cost per successful task on your own merged PRs. we hope you can join us!
baseten.co/resources/webinar…
DeepSeek's latest model, DeepSeek V4.1 Flash 1017, is live on Baseten.
At just 763bn parameters, this model delivers better performance and lower cost (through shorter outputs) with stronger intelligence.
Try it here: baseten.co/library/deepseek-…
The gathering grows. @bneyshabur, co-founder and CEO of @mirendil, is speaking at All-Gather!
We've been overwhelmed (in the best way) by how many of you have applied. Our team is reading every application and we can't wait to see you there.
Seats are extremely limited, but if you haven't applied yet, you can here: baseten.co/all-gather/
We are thrilled to serve @reflection_ai's first open-weight model, Beam, on day 0.
At 500B parameters, Beam is optimized for the frontier workloads in the enterprise today: writing and maintaining code, executing long-horizon, multi-step tasks with tools.
Check it out on Baseten Model APIs: baseten.co/library/beam/
Both of the new PhoneLLM models (30B and 120B, optimized for conversational voice AI) are available as one-click deploys from our Model Library.
Another great example of the impact of fine-tuning open-weight models (Nemotron in this case).
Fast is better than slow.
We've got two new PhoneLLM models optimized for conversational voice AI.
PhoneLLM Mini (30B) — When you need the lowest possible latency (sub-100ms TTFAT), smallest model size, and lowest cost. Good multi-turn conversation behavior and tool-calling accuracy in a model that can run >100 concurrent agents on a B200 and fits on an RTX 5090.
PhoneLLM Max (120B) — A "microthinking" model for complex conversational tasks. Sub-200ms TTFAT. SOTA task completion performance at 1/10th the latency and cost of models with similar capabilities.
Both of these models are full-weights fine-tunes of @NVIDIAAI Nemotron models. Mini is based on Nemotron 3 Nano. Max is based on the brand new Nemotron 3.5 Super VL.
Both of these models are available as open weights on HuggingFace, and from four inference partners: AWS, Baseten, Cloudflare, and Modal.



















