A matching prefix doesn't always mean reusable state. As AI agents tackle longer, multi-step tasks, modern LLM architectures are changing how inference works. Explore how MLA, hybrid architectures, and smarter caching are reshaping inference for agentic workloads. 🚀 🔗 friendli.ai/blog/llm-archite…

A faster model doesn't always mean a faster coding agent. AI coding performance depends on 4 layers: 🤖 Agents 🧠 Models ⚡ Inference 🖥️ GPUs The real goal? Better task success, faster completion, and lower cost per task. Explore the full stack 👇 friendli.ai/blog/ai-coding-a…

🌟 Special Guest Speaker: @MiniMax_AI Joins Us in Seoul! We're excited to have Ethan Wei, Global Business Lead Solution Architect at MiniMax, as a special guest speaker at the Ollama × FriendliAI Seoul Meetup on November 5! With extensive experience in cloud infrastructure and AI deployment, Ethan has led cloud and AI initiatives at Alibaba Cloud International and ByteDance. Since joining MiniMax in 2024, he has spearheaded the deployment of large-scale AI models and helped leading AI-native applications worldwide bring next-generation AI experiences to life. At MiniMax Open Platform, he drives end-to-end technical architecture for large-scale AI implementations, bringing hands-on expertise in turning frontier AI capabilities into real-world applications. 🎤 Session: Inside M3.1-Flash: Frontier Capabilities for Devs What does it take to build powerful, production-ready AI agents with frontier open models? Ethan will take us inside MiniMax M3.1-Flash, exploring how three frontier capabilities come together in a single open-weight model: 🔹 1M-token context window for efficient long-context reasoning 🔹 Advanced coding and agentic performance for real-world software development 🔹 Native multimodality for next-generation AI applications He'll also dive into the sparse-attention architecture powering M3.1-Flash, how it enables efficient long-context reasoning, and what it takes to build long-horizon AI agents ready for enterprise-scale deployment. Join us in Seoul to hear directly from the frontier model labs pushing the boundaries of open AI! 📍 Seoul, South Korea 📅 November 5, 2026 🔗 Save your spot: luma.com/ollama-friendliai-m…

🎤 Meet the speakers joining us for the Ollama × FriendliAI Seoul Meetup! On November 5, speakers from @ollama, @friendliai, and @MiniMax_AI are coming together in Seoul to share insights on building production agents with open models. 🔹 @jmorgan | CEO, Ollama 🔹 @bgchun | CEO, FriendliAI 🔹 Ethan Wei | Global Business Lead Solution Architect, MiniMax Building an AI agent or LLM application with open models—or planning to? Join us to explore real-world development and production challenges, bring your questions to the open Q&A, and connect with the teams and fellow developers. 📅 November 5, 2026 📍 Seoul, South Korea 👉 Register: luma.com/ollama-friendliai-m… #Ollama #FriendliAI #MiniMax #OpenModels #AIAgents

Not every workload needs a frontier-sized model. Hugging Face's Carbon-X shows what domain-specialized open models can achieve. A 14B model approaching frontier performance on specific DNA benchmarks, while offering a path to much lower inference costs and private deployment. This is another important dimension of open-weight AI. reddit.com/r/LocalLLaMA/comm…

Another strong result for the open-weight ecosystem. Kimi K3.1 Pro scored 55 on Artificial Analysis's Intelligence Index, just 3 points behind the leading proprietary model. What's notable is that this comes from an independent evaluation across multiple capabilities, not just a cherry-picked benchmark. Looking forward to the weights release!

Dynamic sparse attention reads fewer tokens per query. So why doesn’t the KV cache necessarily shrink to match? Sliding-window attention only looks at recent tokens. Once a token falls outside the window, that layer no longer needs its KV state to continue the sequence, so the runtime can release it. Dynamic sparse attention works differently. Each query selects which tokens to attend to from across the history. A token skipped by this query may be exactly what the next one needs. So the runtime may still need to keep the full KV history, even though each step reads only a subset. And selecting positions and gathering noncontiguous KV entries adds its own cost. Fewer attention reads ≠ a smaller cache. For long-context agents, compute and memory are two different budgets. Our deep dive covers what this, and hybrid models like Kimi K3, mean for prefix reuse, caching, and speculative decoding: friendli.ai/blog/llm-archite…

Ultra-fast inference ⚡ open weights 🤗 food and drinks 🍻 An evening at the FriendliAI SF office, Wed Nov 18 6–8pm — one block from Moscone, during Ignite week 📍 RSVP: luma.com/cch7p7pw

🚀 30% lower LLM costs. 25% faster responses. By moving from a closed model to GLM on FriendliAI, Liner Scholar achieved both in an online A/B test. Better economics. Faster inference. Powered by open models. Read the story 👇 🔗 friendli.ai/customers/liner

FriendliAI supports @NVIDIAAI Nemotron 3.5 Embed 1B, Embed 8B, and Rerank 8Btriever from Day-0. #agentknowledgefoundation Nemotron 3.5 Embed (1B & 8B) makes text and visual content searchable in one embedding space, and ranks #1 across Q2D-Web, MMTEB, ViDoRe, and RTEB, and more. Rerank 8B puts the strongest evidence first and ranks #1 on ViDoRe v3 Rerank. Better evidence, better agents. Now on Friendli Dedicated Endpoints. 👉 Get started: friendli.ai/models/nemotron 🤓 Blog: friendli.ai/blog/nvidia-nemo… 🚀 More Models: friendli.ai/models

🎃 Just in time for Halloween, what's better than a classic "whodunit"? Hosted by @aivalleyio, FriendliAI will be participating in a truly horrific DevTools murder mystery in SF entitled "Who Killed the Build?" 🗡️ Won't you join us? luma.com/aivalley-lqjv

A huge thanks again to Anaconda, Inc. and MiniMax for participating in our SF office event last week for #SFTechWeek. 🏅 To mark the occasion, we built a quick demo that showcases our 3 layers of the AI stack: agent/harness, model, and inference engine. 🚀 Wishing you good fortune! 🥠 Kilo Code #minimax #inference

🇰🇷 @Ollama x @friendliai are coming together in Seoul! This November, Ollama co-founders @jmorgan and @mchiang0610 are coming to Korea, and we’re teaming up for an evening with the developer community around open models, AI agents, and building for production. Join Ollama × FriendliAI Developer Meetup in Seoul to explore how the latest open models are being used to build AI agents and real-world applications. As frontier open models continue to advance, developers have more choice than ever. The question is no longer just which model to use, but how to turn that choice into something fast, reliable, and production-ready. That's where Ollama and FriendliAI come together. Ollama makes it easy for developers to get started with open models, while FriendliAI provides the high-performance inference infrastructure to run them reliably and efficiently at scale. Together, we're bringing these conversations to Seoul through two events focused on open model sovereignty, enterprise adoption, and real-world applications. 💡 Read more about our collaboration: friendli.ai/blog/friendliai-…

A coding benchmark score reflects more than just the model. GLM-5.3-Flash achieved 63.4% on DeepSWE v1.1 with mini-SWE-agent, while 8090 Labs observed substantial performance differences across agent harnesses. Even within the same harness, configurations like context management, tool setup, and execution mode can significantly affect performance. The model matters. So does the harness, and how it's configured. Worth looking beyond leaderboard scores and experimenting with different setups to find what works best for your model.