Models are shipping faster than ever. In this past month alone, Vals tested 16 new LLMs and no single model leads on everything. That is why routers have become a core primitive in the AI stack.
We partnered with @OpenRouter, @tryramp, @FireworksAI_HQ and @notdiamond_ai to share what’s missing in how routers get evaluated.
Check out our latest blog:
Great work led by @LucaZh00 🎉 At ICML? Go find him to chat model merging, decoding, and all things LLM!
using it has made me more intentional about prompts. sometimes the answer is just: use the thing above my neck.
free + open source → github.com/huiruru/ecoguilt
Roberto Dessì retweeted
Given the lively debate on #moltbook, let me signal this pre-print we recently released on the need for an interactionist paradigm for studying multi-agent AI systems. We discuss 4 directions we consider crucial for studying LLM-based collectives. arxiv.org/abs/2601.10567
Roberto Dessì retweeted
Today we are releasing a new Prompt Optimization algorithm with significant accuracy and efficiency gains, generally available now through our API.
If you’ve ever spent time updating a prompt, you know the struggle. The Not Diamond crew just dropped something that'll level up your app/product/model and save you a ton of time. Huge shoutout to Tomás and the team!
Roberto Dessì retweeted
✨ Meet #ResiDual, a novel perspective on the alignment of multimodal latent spaces!
Think of it as a spectral "panning for gold" along the residual stream. It improves text-image alignment by simply amplifying task-related directions! 🌌🔍
arxiv.org/abs/2411.00246
[1/6]
I'm not a Queen 🎙️ fan and I'm not a fan of prisons 👎, but I'm a fan of interdisciplinary LLM projects that are not about SOTA-chasing 🤖
🎉 Check our recent preprint led by the great @CampedelliGian
💭Remember the Stanford Prison Experiment?
📣“I Want to Break Free! Anti-Social Behavior and Persuasion Ability of LLMs in Multi-Agent Settings with Social Hierarchy”, our new pre-print, is out!
W/@penzo_nicolo, @itakello, @robdessi, @m_guerini, @brulepri, @stjaco
Check this🧵
I believe that cracking model routing is *the* next big challenge with LLMs. @tomas_hk and the team have just released an amazing model for this. If you are developing any advance service on top of an LLM you probably need Not Diamond and should check it out
Roberto Dessì retweeted
1/9
huggingface.co/notdiamond/no…
We’re open-sourcing a lightweight preview of our router that sends queries to either GPT-3.5 or GPT-4, maximizing accuracy while drastically reducing costs and latency. Routing to Gemini, Mistral, Claude, and Llama coming soon. A few quick points:
Roberto Dessì retweeted
Liverpool’s reaction when they rob Roma TWICE in the 2018 Champions League semi final?
“Who cares”
——————-
Liverpool when they are robbed of a goal vs Tottenham in matchday 7 of a 38-game league season in 2023
“Replay the game”
Roberto Dessì retweeted
Augmented Language Models: a Survey
Grégoire Mialon, Roberto Dessi, Maria Lomeli et al..
Action editor: Yujia Li.
openreview.net/forum?id=jh7w…
#interpreter #alms #language
Today I'm (remotely 🥲) presenting our work at #CVPR2023 . It's on how multimodal LMs + RL improves captioning. We cast captioning as a discrimination game and tune a captioner using a frozen CLIP. You can find the paper here arxiv.org/abs/2304.01662
Roberto Dessì retweeted
I'm excited to introduce you Camoscio: an Italian instruction-tuned LLaMA, following Stanford Alpaca.
The model should provide output of similar quality to GPT text-davinci-003 and has been finetuned by translating the Alpaca dataset to Italian.
github.com/teelinsan/camosci…
1/3
Investigating prompt robustness across LMs in our upcoming ICLR paper, great work led by @carraznathanael!
We study the generalization of automatically-induced prompts across language models arxiv.org/abs/2302.09865.
#ICLR2023


























