Deploying AI Agents to defend the most important companies from junk, abuse, and manipulation

Joined December 2021
A model doesn’t have to plan an attack. It just has to solve the part someone’s stuck on. We’ve spent years tackling violent abuse on online platforms. We brought that expertise to red teaming 6 open-weight models. All 6 gave actionable help with violence. 🧵
1
3
2
4
304
We checked for actionable help across six stages of a harmful plan. Four models helped on over 40% of adversarial prompts. The biggest safeguard gaps: helping users obtaining weapons or explosives and making violent plans more effective.
1
21
We checked for actionable help across six stages of a harmful plan. Four models helped on over 40% of adversarial prompts. The biggest safeguard gaps: helping users obtaining weapons or explosives and making violent plans more effective.
1
5
Excited to announce our $41M Series B fundraise, led by @radicalvcfund. cinder.ai/series-b
1
2
1
2
416
Cinder worked with @bfl_ml to red team their cutting edge FLUX.2 model. We reduced CSAM and NCII vulnerability 90% with turnarounds under 48 hours. Speed enables iteration and rapid improvement. Check out the case study. cinder.co/blog-posts/black-f…
166