This isn't really a sensical tradeoff. We know how to build secure systems, but the cost/risk tradeoff didn't make sense until the advent of capable models both lowered costs and raised risk to the point where we can and must fix those systems.
Besides, most of the adversarial activity is coming from jurisdictions that won't be party to restrictions on open models, so that approach would solve nothing while hamstringing anyone trying to fix vulnerabilities.
So, the problem is that it really isn’t tenable to let anyone download a superhuman hacker to their computer and use it to commit cybercrimes. That’s actually not something that society can tolerate, and the open weights people never had a good answer for this
To the extent that solving this problem necessarily privileges a small oligopoly of AI labs, this is a logical foundation for *more* democratic control over this technology, not less.
“Yes, because the thing you’re building is too dangerous, we will in fact drive your competitors out of business—but consequently, you have ceased to be a normal firm and we cannot simply apply normal regulatory permissiveness anymore. This is not a free market, by your own design.”
That’s a reasonable political premise from which to justify extensive regulation, including “extreme” policies like freezes on development, or nationalization (neither of which is really extreme in the context of a technology that can cause civilizational collapse)
5
165
Jade A. retweeted
I will never give up on my belief that a kinder world is possible and that technology can be harnessed to such a purpose.
Jade A. retweeted
we hear about the New deal all day from leftist but the only ones trying to really get the party back to it's new deal traditions are Normie Libs and Abundance Libs not leftist
Jade A. retweeted
token capex > token opex
Jade A. retweeted
Connecting commercial refrigerators and other industrial equipment to a network seems uncontroversial to me. No one can manage the scale of modern industrial equipment across hundreds of geographic locations any other way.
The issue is that manufacturers build these interfaces with almost no investment in product security, no plan for updates, and then abandon it while it’s still running in their customer environments. Most of this firmware doesn’t take a sophisticated attacker to compromise, so it should not surprise us when nation state attackers show up.
Customers are told to isolate the equipment from the internet which of course is good advice, but it’s a cost they pay for the manufacturer’s negligence, and it often isn’t fully in their control. A lot of this equipment connects back to the manufacturer on its own which can require weakening egress controls.
So why does this keep happening? Nearly all cybersecurity law and regulation is about protecting personal data records. When a company loses customer data records they face consequences in the market and with regulators. But a company that sells an insecure product doesn’t. As a result companies spend on protecting themselves and your average enterprise security team structure reflects this. Only in some big tech companies have I seen security teams expanded to secure products. Until this change happens in every industry, customers will be left holding the risk.
Jade A. retweeted
Replying to @LuzLavoid
ebay is a magical place where you can turn money into fucked up hardware
You can do absolutely wild things with qemu's record/replay/reverse debug features.
Poke at a service until crash, rewind, try again to see if it crashes differently, see if useful side-effects happen instead of crashes, etc.
Caught my agents using it for vuln verification.
Jade A. retweeted
but only because...i actually do want the world to have tons of memory and people to put as much as they want in their computers, and it is fucking annoying that this was taken out of context.
i have been arguing for the world to ramp up memory production for a long time.
Jade A. retweeted
I think in general it's better to be a strict conservative in theory and a soft hearted lib in practice than the other way around
Trying to use an iPad wifi+cell model with keyboard as a laptop replacement (my other computer is a datacenter) and the UX is so close to macOS except in little frustrating ways.
I cmd+shift+4 hoping to get a rectangle select->screenshot and instead screenshots the whole page. I try to drag a photo from the Photos app to Signal and if Photos doesn’t have focus it just scrolls instead.
So close and yet… not.
2
6
471















