Cybersec Lead @ GE Vernova | 25+ yrs RE/vuln/exploits (embedded/defense). Ex-n.runs/Recurity. AI research since 2017 - (EP3726776A1). Author on AI attacks.

Berlin, Germany
Joined December 2008
This
This is true: "Digital security has quietly rested on the fact that skilled attackers are rare and targets are nearly endless, so most systems were safe because no capable attacker ever got around to them." I am deeply concerned about all of the attacks becoming cheap at scale.
97
Sergio ‘shadown’ Alvarez retweeted
We're open sourcing SPACE, the sandbox platform that runs every task in Perplexity Computer. SPACE gives each agent task its own Firecracker microVM and controls credentials and outbound traffic from outside the VM. Available now under Apache 2.0: github.com/perplexityai/SPAC…
147
216
96
2,524
312,118
I really love reading this. This is in my opinion how security research used to work, and I believe that now it even accelerated. When ever you had an idea you just went after it and you had peers to discuss about those ideas, get feedback, improve them and get them implemented and tested. That’s why I believe most researchers adopted AI naturally. Same goes for Andrej Karpathy auto-research, people were amazed about it, I doubt it had the same impact in the security community, that’s what Michal Zalewski @lcamtuf essentially did with afl and what evolution fuzzing was about, among other things in the security community. Am I wrong?
A retired NASA engineer who had worked on the Space Shuttle program for 25 years was hired by SpaceX at age 62. He described the first week as the most disorienting experience of his professional life. At NASA, a design change required 3 meetings, 2 committees, a review board, and 6 to 18 months of documentation. At SpaceX, his new supervisor said "if it works, build it. If it doesn't, change it by Friday." He sat at his desk after the first day and called his wife. He told her he felt like a man who had been swimming with ankle weights for 25 years and someone just cut them off. He could move. He could decide. He could build something in the morning and test it in the afternoon. The constraint that he had accepted as the nature of aerospace engineering turned out to be the nature of bureaucracy. Within 6 months he had contributed to more design iterations than he had completed in his last 5 years at NASA. Not because he was working harder. Because the time between having an idea and testing the idea collapsed from months to hours. The same brain. The same knowledge. A different operating system. He described a specific moment where he proposed a modification to a Raptor engine component. At NASA, the proposal would have entered a queue. At SpaceX, the modification was machined by the end of the day and tested by the following morning. He watched his idea become a physical object in 18 hours. At NASA, 18 hours would not have been enough to schedule the first meeting to discuss whether to schedule a meeting. He told an interviewer: "I didn't get smarter when I went to SpaceX. I got faster. The intelligence was always there. The system was in the way." The difference between SpaceX and NASA is not talent. NASA has extraordinary talent. The difference is the time between a thought and a test. SpaceX compresses it. NASA elongates it. The same engineer produces 10x more at SpaceX than at NASA because the bottleneck was never the engineer. It was the meetings about the meetings about the work.
1
1
170
Sergio ‘shadown’ Alvarez retweeted
That is a *wild* demo...
Today, @washingtonpost covered critical vulnerabilities @depthfirstlabs found in TikTok. These vulnerabilities allowed hackers to access anything on a user’s device that TikTok itself could access, including the camera, microphone, payment information, photos, and the user’s entire TikTok account. Read more in the thread 🧵
6
23
4,876
This
In the immortal words of chief engineer John Ray Arnold in "Jurassic Park" :
160
Sergio ‘shadown’ Alvarez retweeted
I'm so glad Intel finally added unlimited hardware breakpoints.
8
34
1
338
21,172
This
Now that frontier AI is getting better than humans at reverse engineering binary code, finding vulnerabilities, exploiting and chaining them, and penetration testing, what should we be presenting at security conferences instead? This: defenses that scale across vuln classes.
1
161
So the problem seems to be that the PoCs are being analyzed as attacks and rejected by the email server…how am I supposed to send security vulnerabilities + PoC exploits?
Replying to @X
@X @elonmusk I'm trying to report some security flaws I've found the only contact I've found was [email protected]. I've got the response that the email account [email protected] doesn't exist anymore or that it is no longer in use. How do I report you guys what I've found in Grok Bot?
1
1
2
403
This a 100%
I believe the exact opposite. LLMs can only use the tools that we provide them. The actual implementation is that the harness calls the tools when the LLM emits the "magic words." We haven't even solved universal alignment among all of us humans, how can we assume we can for AI?
3
282
Sergio ‘shadown’ Alvarez retweeted
Less than 400 lines of nix, that's all it took:
1
1
5
3,138
I believe we are all willing to help. Care to elaborate a bit more in detail? I’ve been designing and implementing a defense system for some time already, I’m sure many people I know are doing the same.
this is a critically important moment for cyber defense with AI; there is not much time to act. we are happy if you want to work with us or any of our competitors or partners, but please take this moment seriously. only an urgent and intense collective response will work.
1
170
What in the past required highly skilled people and time to research, develop the tools and techniques to generate advanced and persistent attacks, now in the era of AI, reconnaissance, resource development, initial access, privilege escalation, persistence, lateral movement, data collection and exfiltration, and the utilization of covert channels, finding unexpected places to store data and execute code, are available to anyone with specific goals. Having the guidance of people with expertise increases those capabilities even more (though it is required until all that know-how and alternative thinking has been embedded in the knowledge base/skills/documentation the models will rely on afterwards). In this blog I cover some covert communication that many still consider science fiction, but that is totally possible/doable/feasible today for anyone using AI, including evil model behavior. Most don’t even consider them in their infrastructure defense; in my opinion this will have to change drastically in the near future. shadown.github.io/blog/posts…
4
4
351
Sergio ‘shadown’ Alvarez retweeted
This:
The vulnerability tsunami is coming in just a few months and there won’t be enough time to patch critical infrastructure. Network isolation described below (air-gaps and data diodes!) needed now!
2
1
4
4,880
My take on LLM has been keeping track on how things are evolving over the time. This is the latest report: The AI Impact - A Comprehensive Analysis Across All Domains of Society shadown.github.io/blog/posts…
1
2
4
295