This is so familiar and so true
Security called me at 6:12 AM today.
"Patch every PHP server immediately."
I asked what happened.
"Two critical vulnerabilities. Remote code execution. No authentication required."
Cool.
How many PHP servers do we have?
According to inventory: 12
According to reality:
Nobody knows.
We found one running WordPress.
Three running old internal tools.
One under someone's desk.
Two inside vendor appliances.
A forgotten employee directory from 2016.
And a server named:
PHP-OLD-DO-NOT-TOUCH
Naturally, that one runs payroll exports.
Then we found a PHP 5.6 box.
I asked who owned it.
The documentation said:
BRIAN.
Brian left in 2019.
We called Brian.
He said:
"Oh wow, that's still running?"
Excellent.
By 8 AM, leadership joined the incident call.
CEO:
"Can hackers actually get in?"
Security:
"Potentially yes."
CEO:
"Without a password?"
Security:
"Yes."
CEO:
"Then why do WE need passwords?"
Not the lesson.
Finance asked if we could wait until the weekend to patch because downtime affects revenue.
Security explained that the alternative was letting strangers execute code on our servers.
Finance asked for a cost comparison.
At 9:17, someone suggested temporarily taking the vulnerable websites offline.
Marketing refused.
"Our campaign is live."
So for the next hour, the company officially decided maintaining a landing page for 20% off webinar registration was more important than preventing remote server takeover.
We finally patched everything we could find.
Then our scanner discovered another PHP server.
Hostname:
TEMP-PHP-2014
Uptime:
4,512 days.
Nobody knows what it does.
Nobody owns it.
Nobody can shut it down.
But every time we block network access, the warehouse stops printing shipping labels.
Security has classified it as critical infrastructure.
It is running PHP 5.4.
The vulnerability has existed longer than half our employees.
The emergency patch took four hours.
Finding out what PHP actually runs took eleven.
The internet isn't held together with code.
It's held together with servers everyone is afraid to turn off.
22
Mark Robinson retweeted
Feeling anxious about the changes AI is bringing to work? Listen to @lennysan interview with @molly_g
Feeling like you are fully AI pilled? Also! Listen to the pod.
Truly the podcast I didn’t know I needed to hear
overcast.fm/+AA6K1GyX618
Mark Robinson retweeted
Still processing from yesterday's event (one of the most meaningful days of my life)— more to come—but a few quick things for now:
1. Thank you to everyone who came. You are what made it special.
2. There's so much need for IRL community. I've rarely felt this kind of pull for anything I've done. Wow.
3. All of the talks will be posted to my YT channel in the coming weeks. Get excited.
4. An unbelievable thank-you to the @Stripe team for helping me put this event on. It takes something special to create an event with 1,000+ PMs that has such great vibes. If you think they're great at payments infra, they might be even better at design and event production. High talent density over there. It's no coincidence that I've had more people from Stripe on my podcast than any other company. Thank you, Stripe.
(A few photos from the event, more to come.)
I’m going to Lenny & Friends Summit in September to meet people whose work has taught me product for years.
It feels like a reunion for a school I attended through books, articles and podcasts. So I made an unofficial yearbook.
1
76
The questions I’m bringing:
1) If AI makes it possible for almost anyone to build almost anything, what is a product team for?
2) How do we make each person’s work reusable by the team so its capability compounds over time?
markedobservations.substack.…
2
18
Mark Robinson retweeted
Little art dump because I haven’t posted anything in forever, anyway here’s what I’ve been working on
Watching these awesome helicopter teams fighting these fires. #NSFire
Mark Robinson retweeted
youtu.be/_RGuJ-Ujr2Y cool video about Gartic Phone highly recommend
There’s something hypnotic about swim tournament warmups. A pool packed with a ton of swimmers all getting into the zone.
Mark Robinson retweeted
As new devices are invented, we want React Native to be there for everyone. Today we're sharing our updated many-platform vision:
reactnative.dev/blog/2021/08…
Mark Robinson retweeted
Flight attendant: Is there a doctor onboard?
Dad: *nudging me* that should've been you
Me: Not now Dad
Dad: Not asking for a Product Manager to help, are they?
Me: Dad, there's a medical emergency happening right now
Dad: Go and see if “let’s have a follow-up meeting" helps
I just wrote the first review for Firehouse Subs on #Yelp!
My first time at Firehouse Subs and we thoroughly enjoye… yelp.ca/biz/firehouse-subs-l…
Sooo much *better* not having numbered bags for a LEGO build - all sets should be like this! @LEGO_Group @LEGOIdeas
"Nobody’s writing Medium posts admitting, “After months of toil, confusion, fights, despair, dead ends and exhausting effort, we’re relieved to finally get this compromised piece of shit out the door.”
intercom.com/blog/design-in-…























