Pinned Tweet
Personalized Arxiv feed
I built a system that allows you to create a personalized feed or search over recent listings. I use a two tower architecture with a preference model and a re-ranker.
uror.io
It's funny that eating bugs was implied to be like physically eating bugs and not the ever growing hunt for bugs in code using human brains to power ai. You will live in the pods (matrix) and you will eat the bugs (phpshell) and you will be happy
Sol 6.1 is the type of guy that's incredibly capable but doesn't listen so the work it does is useless because of stupid decisions it made from not listening
The goal of @typesafeai Jev model is to unlock Jevon's paradox. I wanted to play around with decision models so I trained TERN-35B-A3B. The goal is price frontier.
On an H100 PCIE I got it to $0.0116/Mtok. Modifications got me to cost-score pareto frontier at $0.00773/Mtok
The model could be a lot better. It was undertrained and I have a lot more data to feed it. The next steps are to improve the data and play with some Deepseek inspired architectural changes. If you want to play around with it in the meantime:
HF - huggingface.co/matthewagi/Te…
Github - github.com/Matthew-agi/Tern
One final note: Speeds used optimized batch sizes. That likely doesn't reflect the reality of serving but does reflect the reality of serving for RL as a judge and some other tasks.
H100 assumed a price of $2.35 which is what I was renting off @PrimeIntellect



