https://xitter.cf/t.co/2Mf99g3pUN
Menlo Park
Joined February 2024
- Tweets2
- Following4
- Followers20
- Likes2
hiddenweights retweeted
Super proud of the work we’ve done at @hiddenweights with @rox_ai to fine-tune an outbound reward model, achieving high accuracy at a fraction of the cost. Great collaboration!
Coding agents got good by writing code, getting feedback, and improving thousands of times.
Agents doing commercial work never got that loop, until today.
With @hiddenweights, we trained an Outbound Reward Model on real cold emails + the edits sellers make to AI drafts before they hit send.
The reward model:
- Is 5x faster and up to 30x cheaper than an LLM judge
- Picks the seller-edited draft 80% of the time
- Gets 1.75x the avg reply rate on top-scored emails
🧵 on how we did it:
hiddenweights retweeted
Coding agents got good by writing code, getting feedback, and improving thousands of times.
Agents doing commercial work never got that loop, until today.
With @hiddenweights, we trained an Outbound Reward Model on real cold emails + the edits sellers make to AI drafts before they hit send.
The reward model:
- Is 5x faster and up to 30x cheaper than an LLM judge
- Picks the seller-edited draft 80% of the time
- Gets 1.75x the avg reply rate on top-scored emails
🧵 on how we did it: