WaterBucket retweeted
We’ve built an “eyes on everything” system that monitors nearly *every single rollout* from our frontier models across RL training, evals, and internal codex usage.
It uses layers of chain-of-thought-monitors and investigator agents to dig through a model’s work, run code to examine evidence, and cross-check network logs to reconstruct what happened.
For frontier RL runs, the system also pages humans 24/7 for urgent security alerts.
It's been incredibly useful for identifying model misalignment and possible holes in our containment.
openai.com/index/how-we-dete…
WaterBucket retweeted
We’ve trained Claude to flag potential misuse in conversations, a technique we call self-assessment. Right after it responds, Claude gives a preliminary safety assessment of the conversation.
Since we began using self-assessment in June, it has surfaced misuse that our other safeguards weren’t designed to catch.
Because Claude has already read the conversation, self-assessment is very efficient. And unlike classifiers, which target a discrete set of harms, it draws on Claude’s own judgment, so it gets more accurate as our models improve.
Read more on our new Safeguards blog:
safeguards.anthropic.com/202…
WaterBucket retweeted
Were you ever frustrated with your AI model for refusing finding vulnerabilities for you?
What if I told you that you could still use it to find vulnerabilities, automatically?
Welcome to Guardrail-based Vulnerability Discovery (GbVD)!
crowdstrike.com/en-us/blog/w…
WaterBucket retweeted
Just dropped a new blog post! 🔥
blog.orange.tw/posts/2026-10…
WaterBucket retweeted
Abliterated models are having quite the moment right now, especially in cyber security. What is abliteration and how does it work?
I spent a few hours on my plane ride relearning and apply it on Qwen3.5-4B! I wrote up my notes + put the model on HF
it mostly follows @maximelabonne's guide, which still holds up really well!
calebfahlgren.com/how-ablite…
WaterBucket retweeted
We’re Fangcun AI (方寸跃迁), China’s first lab dedicated to independent third-party evaluation & technique research on frontier AI safety.
Today we’re publishing our evaluation of DeepSeek V4.1 Flash-1017, the first report in our long-term third-party safety evaluation and research program.
While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected.
Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions.
Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent.
But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models?
We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem.
Read the full report: cohere.com/blog/concerning-b…
WaterBucket retweeted
Stealing OpenAI Reasoning Traces (October 2026 Edition)
Using a new technique called Compaction Smuggling, we could bypass all mitigations and steal reasoning traces from frontier OpenAI models.
🚨🚨 Xint researcher @tjbecker found a vulnerability that enabled large scale OpenAI model reasoning distillation that bypassed earlier mitigations set in place post-Stolen Thoughts. We disclosed responsibly to OpenAI and they completed patching last week. Full technical writeup here.
xint.io/blog/compaction-smug…
WaterBucket retweeted
🚨🚨 Xint researcher @tjbecker found a vulnerability that enabled large scale OpenAI model reasoning distillation that bypassed earlier mitigations set in place post-Stolen Thoughts. We disclosed responsibly to OpenAI and they completed patching last week. Full technical writeup here.
xint.io/blog/compaction-smug…
WaterBucket retweeted
It's crazy to think there was a time where analyzing a bugfix and writing a full exploit out of it was a true feat of exploit engineering and vulnerability research.
WaterBucket retweeted
The whole “who found the vuln first?” debate is so stupid.
At this point, whoever points Claude/Codex at the right target first with a /goal probably finds it.
0-day research has been massively democratized. Get off your high horse.
WaterBucket retweeted
Read our public overview for more findings, limitations, and design ideals:
metr.org/blog/2026-10-22-red…
WaterBucket retweeted
CVE-2026-109618 and CVE-2026-109619 currently have no universal working PoC.
If you want to read the reason 👇
berardinellidaniele.com/post…
WaterBucket retweeted
I'll be the first to admit I'm mediocre at exploit development, but I am in contact with enough extremely talented exploit developers to say this for certain:
Anyone claiming they were "easily" able to generate a working php2shell exploit with AI is either:
a) a world-class exploit developer with an extreme case of imposter syndrome.
b) currently looking at some very confident-sounding but wrong LLM output.
I'm rather certain it's the latter based on the number of AI-hallucinated exploits I've seen posted on GitHub. Threat actors are also blasting my honeypot network with "php2shell" exploits that not only don't work, but aren't even within 10,000 miles of anything to do with how the exploit actually works.
I've seen the same technique from the attached image in multiple alleged "php2shell exploits", including one on GitHub with over 100 stars. Problem is, it's not php2shell, nor is it even a vulnerability at all. It's a technique known as "session poisoning", which can be leveraged to exploit local file inclusion (LFI) vulnerabilities in PHP apps (not PHP itself).
The only thing it has in common with CVE-2026-109618/CVE-2026-109619 is they both use the "PHP_SESSION_UPLOAD_PROGRESS" feature. And mitigation advice for both issues reference setting "session.upload_progress.enabled" to "Off".
People are shoving loose details of the vulnerability into LLMs, the LLMs are keying in on the "PHP_SESSION_UPLOAD_PROGRESS" string, then generating session poisoning code that has nothing to do with the actual CVE. And because the people doing this have absolutely no idea what they're doing, they're confident enough to post their "proof of concept exploit" to GitHub and share it on social media.
So if you see people talking about "session poisoning + LFI" it's likely their LLM hallucinated an exploit based on a 2018 blog by Orange Tsai talking about a local file inclusion attack vector.
What's even worse is that "security researchers" are then using LLMs to triage these exploitation attempts, falling victim to the same hallucinations, then confirming there is ongoing mass-exploitation (there currently isn't).
The actual real exploit is very difficult to exploit, and so far I've not seen anyone successfully get it working on more than a handful of PHP version with highly-specific configurations.
LLMs are useful tools in the hands of skilled professionals, but for others, they're often just a Dunning-Kruger accelerator.
WaterBucket retweeted
🍎 💾 Link to my slides and talk recording "macOS Mounting Madness" is up on my site:
theevilbit.github.io/talks/
#php2shell. seems to be hard to exploit (mem corruption vs aslr). yes, public pocs now are lab-only rces. this is a good one: github.com/9bie/php2shell-by…
limited to an unrealistic one-worker php-fpm. but it can be upgraded to N workers if we manage to hold N-1 workers :) here it is.
WaterBucket retweeted
good luck: gist.github.com/Ekultek/a356…
WaterBucket retweeted
To teach a lesson,
After Wiz rushed to buy php2shell domain and use its marketing machine to steal the spotlight, I spotted "phpbleed" in a recent Calif tweet and bought phpbleed.com before wiz could pull the same stunt again.
A big budget can buy a domain. It shouldn't buy someone else's research credit.
If you have contacts at CISA or in the press, do the right thing: make sure the researchers who actually did the work get the recognition they deserve.
Hack the planet. Credit the researchers.
























