The GeekNarrator - Databases, Distributed systems, Stream Processing, Language internals. Software Engineer(Flink Engine) @Confluentinc. Opinions are my own.
Berlin, Germany
Joined April 2022
- Tweets3.6K
- Following490
- Followers8.2K
- Likes4K
Pinned Tweet
The JVM internals series is growing 👇
The JVM Internals - Basics (Episode 1)
youtu.be/Yg69qM0iZa4
JVM Internals: Heaps, Stacks, Program Counters and more
youtu.be/MCTTg8VPaBY
Peek into your Class file? JVM Internals
youtu.be/15sz5yvQ-Po
How is memory allocated on the heap?
youtu.be/qfcnB8kciCE
JVM Internals - Garbage Collection Types and Their Internals
youtu.be/p1Yamdly0QE
How do Garbage Collection Algorithms work?
youtu.be/LeYssTeCSFg
Are Garbage Collection Algorithms Complex?
youtu.be/1TH7NZisw3o
G1GC - Low Latency High Throughput Garbage Collector
youtu.be/SkZxGFnTK3Y
ZGC : The Java Garbage collector explained
youtu.be/hGrWF1Pk4Dk
Please join the membership to watch the full series and get access to other member-only playlists 🚀
Kaivalya Apte - The Geek Narrator retweeted
I don't think so. The problem with Big Upfront Planning wasn't that the plan went cold; it was that the plan was wrong, and we invested lots of effort building things before we found that out. If we're talking about the shape of the product itself, I don't think AI does anything to reduce that uncertainty other than being an especially well-read thought partner. It still can't tell us how people will react to what we make (or, in the case of much embedded software, how the constraints of the physical universe differ from our expectation).
Every project has always needed a vision, but the far-off view of what we hope to have built in a year or two should still be expressed in less detail than what we're feeding to our agents this week.
I like your question, though. I've been thinking about waterfall in relationship to agentic engineering recently as well. This is important stuff to work out together!
Key Takeways : Building Databases on top of S3 (A quick summary)
youtu.be/eJu72VV976U
Cool new features released
1/ SlateDB v0.18.1 is now available! Since v0.17.0, we’ve added:
- Local SST mirroring
- Experimental incremental compaction
- Faster reads
- Two-phase checkpoints
- More language binding features
- Correctness fixes
github.com/slatedb/slatedb/r…
4
495
Really cool! Lets talk about this in depth on my podcast @chaaai
(bonus: we can call it Chaaai k sath charcha 😅)
Today I'm announcing Workers IO to solve the slowest part of engineering, verification!
AI agents can now write years’ worth of code in days, but it still takes significant engineering effort to verify what’s being built.
It’s impossible to predict all scenarios that could lead to a failure and that’s why most expensive failures are found in production.
Workers IO runs millions of simulated production scenarios on your entire system, including dependencies. These simulations run inside a deterministic hypervisor which injects faults like network delays, disk errors, clock skew, and process failures to verify how your system handles these conditions.
Deterministic execution allows us to systematically explore the state space of the system and perfectly reproduce failures.
We are already helping customers do years worth of production hardening in days and build confidence in what they’re shipping.
If you are working on systems that you can never afford to break, DM me and we can help you battle test them!
1
8
1,108
The best way to handle a mistake is to completely accept and own it. No ifs and no buts.. no nuanced justification.. no playing with words….
A simple “we messed up and we will do better” works just fine.
in 2024 when I did a podcast on SlateDB with @criccomini I never imagined I would contribute to SlateDB...
exactly 2 years later (was also October) I joined SlateDB as a committer. 🥳
Such an honour. Such a friendly community. Excited to contribute further.
Excited to have @thegeeknarrator join SlateDB as our latest committer! He's been doing a bunch of work on splitting/merging DBs and also did some dataloss edge case fixes for us. :) Welcome!
Writing is Thinking.
If you feel you are losing your ability to think, you are not alone.
I feel something similar from time to time, if I don't write something on my own.
To avoid getting worse at it, try to be alone with a notebook or an editor with NO AI access and write on a topic that is new to you and a bit challenging for at least 30 mins a day.
I am sure you will start thinking again.
2
15
704
Top 5 bottlenecks:
- Human imagination
- Human attention bandwidth
- Human articulation
- Legacy processes made for humans, used for agents
- Legacy infrastructure made for humans, used for agents.
Massive 🚀 congratulations @apurva1618 @almoggavra
I’m excited to announce that Responsive has been acquired by Databricks to accelerate the development of Lakebase and Neon!
We couldn't be more excited to join the Lakebase team. We've long admired their technical vision, and the more we got to know them, the more impressed we became by their ambition, execution, and momentum. It feels like a natural home for us.
I want to thank Responsive’s customers, investors, and especially the team. More than anything, I’m grateful for the trust you’ve placed in us through the good times and the tough times.
Onward and upward!
1
17
1,582
Kaivalya Apte - The Geek Narrator retweeted
I could easily lose an afternoon clicking through these topics. That visual layout makes technical podcasts much easier to browse.
I work on Distributed systems so naturally my interests are all over the place 👋
Hey I am Kv/Kai - an engineer working on Distributed systems and Databases, and someone who finds himself asking "but how does it actually work?" a lot.
Asking that question has led me to create 150+ technical podcast episodes and tutorials. Kafka, database internals, the JVM, streaming systems, engineering and AI.. plenty of rabbit holes with great company of experts along the way.
I refactored my website to help you easily find the right rabbit hole for you. Something I chose to call "Knowledge Atlas"
Give me a follow and have a look at the website to find some great episodes on the channel aligning with your interest.
Feel free to comment and introduce yourself so I can follow you back!
Cheers,
Kv
I work on Distributed systems so naturally my interests are all over the place 👋
Hey I am Kv/Kai - an engineer working on Distributed systems and Databases, and someone who finds himself asking "but how does it actually work?" a lot.
Asking that question has led me to create 150+ technical podcast episodes and tutorials. Kafka, database internals, the JVM, streaming systems, engineering and AI.. plenty of rabbit holes with great company of experts along the way.
I refactored my website to help you easily find the right rabbit hole for you. Something I chose to call "Knowledge Atlas"
Give me a follow and have a look at the website to find some great episodes on the channel aligning with your interest.
Feel free to comment and introduce yourself so I can follow you back!
Cheers,
Kv
Kaivalya Apte - The Geek Narrator retweeted
This is now also available on my website as a blog.
Visuals and examples all from the video. Check it out!
geeknarrator.com/blog/skip-l…
In this world, where AI can explain you anything you need, I think a human touch is needed. So I created a video explaining how:
A linked-list + Coin Flips = expected O(log n) search.
Skip Lists are one of those ideas that make you stop and ask: "How does that actually work?"
Watch here: youtu.be/2JJIqJ31oSo
This is now also available on my website as a blog.
Visuals and examples all from the video. Check it out!
geeknarrator.com/blog/skip-l…
In this world, where AI can explain you anything you need, I think a human touch is needed. So I created a video explaining how:
A linked-list + Coin Flips = expected O(log n) search.
Skip Lists are one of those ideas that make you stop and ask: "How does that actually work?"
Watch here: youtu.be/2JJIqJ31oSo