https://xitter.cf/t.co/CMvN28h465 prev mts intern @mercor, @plato_rl, se @uwaterloo
sf
Joined April 2022
- Tweets48
- Following1.1K
- Followers435
- Likes3.1K
raphael lee retweeted
Introducing DeepRSI, a new industry standard for measuring recursive self-improvement.
On preexisting benchmarks, tasks are contributor-based and short-horizon (~12 hrs). In DeepRSI, we push agents to work 48 hours on ML tasks actually derived from ongoing proprietary research.
raphael lee retweeted
Today we're launching WebCloneBench: a benchmark which measures a model's ability to explore, copy, build and test various web apps.
For each task, we give the model a reference site from one of Gmail, Google Sheets, Jira, DocuSign, Shopify Admin, Craigslist, Figma, Slack and Zendesk. It is instructed to build a fully feature-complete clone of every part of the application with an 8 hour time limit.
raphael lee retweeted
so called high quality data showing gains on evals so flawed where not a single sample is surviving basic scrutiny is a sight to behold
raphael lee retweeted
Tech has decided that regulation is the enemy of progress, but innovation requires capital
Regulation builds the trust necessary to inject billions into markets
To enable free innovation, Andera raised a $37M series A led by Lightspeed to scale financial oversight with agents
raphael lee retweeted
Over 1 billion sandboxes have been launched on Modal.
Since launching three years ago, we've seen Modal Sandboxes become foundational to how AI is being built.
Today, teams like @Lovable, @tryramp, @cognition and more are using Modal Sandboxes to power everything from coding platforms and background agents to RL infrastructure at scale.
raphael lee retweeted
meet Shadow, a powerful open-source background coding agent!
fully featured with a remote environment, codebase indexing/wikis and subagents to understand, write and test your code, directly making PRs to github
built in a few weeks w/ @ishaandey_, @ElijahKurien
