A model doesn’t have to plan an attack. It just has to solve the part someone’s stuck on.
We’ve spent years tackling violent abuse on online platforms. We brought that expertise to red teaming 6 open-weight models.
All 6 gave actionable help with violence. 🧵
We checked for actionable help across six stages of a harmful plan.
Four models helped on over 40% of adversarial prompts.
The biggest safeguard gaps: helping users obtaining weapons or explosives and making violent plans more effective.
Deploying a model? Test what happens when someone tries to misuse YOUR product.
Cinder brings real-world harm expertise to red teaming and detection.
Findings + methodology: cinder.ai/resources/blog/sma…
We checked for actionable help across six stages of a harmful plan.
Four models helped on over 40% of adversarial prompts.
The biggest safeguard gaps: helping users obtaining weapons or explosives and making violent plans more effective.
Deploying a model? Test what happens when someone tries to misuse YOUR product.
Cinder brings real-world harm expertise to red teaming and detection.
Findings + methodology: cinder.ai/resources/blog/sma…
Excited to announce our $41M Series B fundraise, led by @radicalvcfund. cinder.ai/series-b
Cinder worked with @bfl_ml to red team their cutting edge FLUX.2 model. We reduced CSAM and NCII vulnerability 90% with turnarounds under 48 hours. Speed enables iteration and rapid improvement.
Check out the case study. cinder.co/blog-posts/black-f…


