Open Source Technologist @ Red Hat, father of dragons, author of books, breaker of guitar strings. Opinions are my own.
Cork, Ireland
Joined May 2008
- Tweets2.5K
- Following322
- Followers440
- Likes1.7K
Pinned Tweet
'Bout time, I was wondering when the announcement was going out 😜. Very glad to be involved with this.
Thrilled and proud to share that my book, "DevOps Culture and Practice with OpenShift: Deliver continuous business value through people, process and technology", written with @eformat, @noeloc, @spring_do and beautifully illustrated by @ilaria66 has been published by @PacktPub
Noel O'Connor retweeted
LLM inference is too slow, too expensive, and too hard to scale.
🚨 Introducing llm-d, a Kubernetes-native distributed inference framework, to change that—using vLLM (@vllm_project), smart scheduling, and disaggregated compute.
Here’s how it works—and how you can use it today:
Noel O'Connor retweeted
Dear @ZelenskyyUa, dear Ukrainian friends, you are not alone.
Noel O'Connor retweeted
Honestly - a few of the replies to this little tribute to engineering excellence exhibit a level of stupidity that suggests to me that it won’t be long before our spacecraft are the only thing that remains of our increasingly dim-witted civilisation. Until recently my guess has been that the answer to the Fermi Paradox might be found in biology - complex biological systems are rare. I’m increasingly of the view that the reason for The Great Silence is that civilisations are inevitably crushed by the weight of nobheads shortly after inventing the internet.
Noel O'Connor retweeted
Paul Mcgrath, Phil Babb, Chris Hughton, Adam Idah, Clinton Morrison, Gavin Bazuna, Curtis Fleming, Caleb Folan, Terry Phelan, Darren Randolph, I'd have them over the racists any day of week 🇮🇪
Noel O'Connor retweeted
If you're born and raised in Tallaght, and go to school in Tallaght and Terenure, and are proud to drape yourself in the tricolour, then regardless of your race or ethnic heritage you're as Irish as I am. A smart country embraces all those who embrace it in return.
It's epic and a real ear-worm. The very best of luck @Bambiethug
Noel O'Connor retweeted
Petition for the lads to reply to the @AllBlacks Haka with the Riverdance on Saturday 🤣💚💪🏻
#RugbyWorldCup @rugbyworldcup #COYBIG @IrishRugby ☘️ – at Kerry, Ireland
Noel O'Connor retweeted
With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates:
- Input & Output across modalities (text, audio, vision)
- Code interpreter, ability to write & run programs
- Browser / internet access
- Embeddings database for files and internal memory storage & retrieval
A lot of computing concepts carry over. Currently we have single-threaded execution running at ~10Hz (tok/s) and enjoy looking at the assembly-level execution traces stream by. Concepts from computer security carry over, with attacks, defenses and emerging vulnerabilities.
I also like the nearest neighbor analogy of "Operating System" because the industry is starting to shape up similar:
Windows, OS X, and Linux <-> GPT, PaLM, Claude, and Llama/Mistral(?:)).
An OS comes with default apps but has an app store.
Most apps can be adapted to multiple platforms.
TLDR looking at LLMs as chatbots is the same as looking at early computers as calculators. We're seeing an emergence of a whole new computing paradigm, and it is very early.
It'd be great to see a lions-esque tour of Europe by the Pacific rugby nations. Fiji, Tonga, Samoa would be epic
