running brand and vibes @scale_ai
Austin, TX
Joined April 2009
- Tweets1.4K
- Following320
- Followers509
- Likes12.5K
Tim Bauer retweeted
We're releasing HLE-Diamond: a refined version of Humanity's Last Exam, built with @CAIS.
A year of review and community feedback went into refining this subset to make it more reliable for measuring frontier models.
Top model tested 60.6% overall. We expect HLE-Diamond to carry signal for the next 6-12 months.
Tim Bauer retweeted
there is one (1) major firm that’s friendly with the gov + F500 and has done embedded eval consulting for years and has a real track record of ai safety expertise but is now largely divested from commercial conflicts with the leading labs
why is nobody talking about scale ai
Tim Bauer retweeted
we're building a world class design team at @modal
here in new york to build the future of ai infrastructure.
we're looking for a sr/staff brand designer to join our team: folks who want to build new systems and tools, and rethink how brands are made from the ground up.
DMs open, listing in the thread.
Tim Bauer retweeted
📣Call for contributions + co-authorship!
RSI Bench is our ongoing effort to evaluate whether AI agents can develop the capabilities required to advance AI R&D.
Got a frontier AI research problem on your mind? Submit it to RSI Bench, and set the standard the whole industry uses to measure progress!
Contributors receive:
→ Co-authorship on the RSI Bench research paper
→ $2,000 per accepted task for the initial 50 tasks
→ Modal compute credits to build + iterate
→ Access to the RSI Bench research community
Register below for full requirements.
Launching rsi-benchmark.com:
The work of AI R&D has always belonged to humans. For the first time, though, it no longer seems certain that it always will.
Recursive self-improvement is within a line of sight. It may still be far, but it is close enough that we should start measuring it.
Tim Bauer retweeted
Welcome @fdesouza to @scale_AI as CEO!
I started Scale a decade ago at 19, and it has grown to be the backbone of the AI world, powering frontier labs, Fortune 500 companies, and the US Government.
Francis is an exceptional leader and the right steward. After spending a lot of time together, I have no doubts he’ll take Scale to greater heights.
Thank you @jdroege for your leadership as interim CEO 🙏
Big News: I’m joining @scale_AI as CEO, starting August 10. Scale sits at a rare intersection, working with the top AI labs to push the frontier while helping enterprises and governments actually deploy AI they can verify and trust. I’m excited to lead a company with a mission to develop reliable AI systems for the most important decisions. More to come.
Tim Bauer retweeted
This is where I think the market has @scale_AI wrong. People still see us as a "data company". We are so much more!
We're the eval and reward layer behind most of the frontier labs. We're the ones who work out what "good" even means for a model. That's exactly what enterprises need now, except it has to run inside their own walls!
Tim Bauer retweeted
My first vibe coded project is live: brand.scale.com/
I always wanted to build a brand guide with some quality-of-life features that were accessible to partners/vendors/rank and file at the company.
Hopefully this leads to fewer DMs asking where the logo files are. 😅
Tim Bauer retweeted
To understand our story, you have to go back to the beginning.
It started with self-driving cars. Ten years later, it's the architecture underneath AI that actually works, across frontier labs, enterprises, governments, and mission-critical systems around the world.
Tim Bauer retweeted
When Alexandr Wang left the company he founded almost a year ago, most figured the startup was as good as dead. Under new CEO Jason Droege, Scale says its sales have rebounded and it expects to top $1 billion in revenue this year.
Read more: forbes.com/sites/richardniev…
Photo: Ian Tuttle for Scale AI
Tim Bauer retweeted
Breaking: @AIatMeta just released Muse Spark — now live across @ScaleAILabs leaderboards.
Here’s how it stacks up:
Tied for 🥇on SWE-Bench Pro
Tied for 🥇on HLE
Tied for 🥇on MCP Atlas
Tied for 🥇on PR Bench - Legal
Tied for 🥈on SWE Atlas Test Writing
🥈on PR Bench - Finance
🥉on SWE Atlas QnA
Tim Bauer retweeted
Welcome to the home of all things @scale_AI research — focused on data, evaluation, safety, and post-training that moves frontier models forward.
We’ll share benchmarks, insights, and work intended to be useful to the broader research community.
labs.scale.com?utm_source=hu…
Tim Bauer retweeted
We’re introducing SEAL Showdown, the AI leaderboard that actually captures real preferences, powered by a platform used by real people.
Public benchmarks today rely on contrived tasks or narrow user groups. That leaves us guessing which models are actually preferred by people.
SEAL Showdown changes that.
Model performance can now be segmented by demographics and domains. Rankings aren’t just a single global average, they can be broken down by region, profession, education level, age and more, giving a nuanced view of how models work for different people.
SEAL Showdown sets a new bar, because AI should be judged by how well it works for everyone.
Tim Bauer retweeted
looking for someone who loves designing in @framer and wants ownership of the work they ship here @perplexity_ai
bring your links, bring your craft.
apply below 👇
Tim Bauer retweeted
We're just getting started.
Scale AI not 'winding down' following Meta deal, interim CEO tells employees and customers cnbc.com/2025/06/18/scale-ai…
Tim Bauer retweeted
I'm hiring creative people that give a shit. Eng, Design, Motion, etc
harvey.ai/blog/lexisnexis-ha…
