
jack of all trades @isomorphiclabs 🧬 fan of physics, eng, cog sci. forever carolinian, hobbyist caledonian
Raleigh 🇺🇸 ➡️ 🇬🇧London
Joined November 2014
- Tweets8.8K
- Following6.6K
- Followers2.1K
- Likes85.4K
Replying to @jayvonjem
Formative London experience was having a KX train to Glasgow get canceled and having to walk with an ancient irate Scottish lady to hellish Euston station for an alternative route
I guess this gets messy bc (a) each model will respond differently to template “harnesses” and (b) so will each eval
I’m sure this is a naive question but what would it look like to do best-effort cost-matched perf?
I.e. for a model comparison where one is much better but orders of magnitude more expensive, you can try all sorts of multi-agent setups (parallelization, search, review) while coming well under cost. Some tasks would still fail, but others wouldn’t.
I guess ppl show this with reasoning effort but it’s far from the only knob available.
4-Argon Minecraft win related
Replying to @teortaxesTex
It’s always faster than I expected, somehow 😅










