Frontier-grade inference APIs for open source models.

Earth
Joined February 2024
mixlayer retweeted
1/ Today, I'm excited to announce ✨Mixlayer✨. Two years ago, I reoriented my life around a singular mission: to build the best inference platform for open source AI.
1
5
2
16
2,156
100% I'm demoing this difference using @getmixlayer several times a week at this point 🙌 Qwen3 8B is my goto demo for tool calling and reasonable cost reasoning on Mixlayer, but I wouldn't dare demo Together's implementation because of how inconsistent it is at reasoning and tool calling
I agree that this is a huge problem for OSS models right now. Working really hard to ensure @getmixlayer is on par with reference implementations. If anyone tries our models out and notices issues like this, please reach out to me directly!
4
2
5
1,660