@JasonSeibel

Co-creator of pgrust: https://xitter.cf/t.co/AIOEC49svY - MIT 2020

 San Francisco
Joined March 2013
  • Tweets93
  • Following249
  • Followers366
5Media
new @pgrustdb
Michael Malis
@mmalisperOct 22
Introducing @pgrustdb 0.4 beta. 0.4 includes: - Our new Gravity query engine that's as much as 3x faster than ClickHouse - pgrcolumnar now supports updates and deletes with full ACID compliance - Automatic memory tuning so work_mem and shared_buffers adapt to your workload
6
295
Jason Seibel retweeted
Dan Luu@danluuOct 24
We should be more ambitious with the software we build: danluu.com/ambitious/
Since early this year, Michael Malis (of pgrust) has been showing me interesting things he's done and saying [W]e should be more ambitious1 with the software we build There is, understandably, a lot of skepticism about projects like pgrust because there are so many low-quality AI-generated projects out there. If I didn't know Malis and didn't look into it, I would just assume that pgrust was another vibe slopped project that's never going to work. But I know Malis well enough to trust his work without looking into it, and if you look into it a bit, you'll see that in testing pgrust, he's testing thoroughly enough that he's even uncovering real bugs in Postgres, such as this numerical bug that can cause valid SP-GiST operations to fail, this format cache bug that can cause incorrect results from JSONPath, this pgcrypto bug that can cause later operations to fail, multiple memory safety bugs in the dictionary loader, this money overflow bug, etc. This isn't to say that pgrust i...

ALT Since early this year, Michael Malis (of pgrust) has been showing me interesting things he's done and saying [W]e should be more ambitious1 with the software we build There is, understandably, a lot of skepticism about projects like pgrust because there are so many low-quality AI-generated projects out there. If I didn't know Malis and didn't look into it, I would just assume that pgrust was another vibe slopped project that's never going to work. But I know Malis well enough to trust his work without looking into it, and if you look into it a bit, you'll see that in testing pgrust, he's testing thoroughly enough that he's even uncovering real bugs in Postgres, such as this numerical bug that can cause valid SP-GiST operations to fail, this format cache bug that can cause incorrect results from JSONPath, this pgcrypto bug that can cause later operations to fail, multiple memory safety bugs in the dictionary loader, this money overflow bug, etc. This isn't to say that pgrust i...

20
54
11
552
30,111
Jason Seibel retweeted
Firecrawl
@firecrawlOct 22
Introducing the free Government & Legal Index for ChatGPT & Claude. Give your AI agents 30M+ US government pages, from federal statutes and court opinions to city codes and permits. Research tax rules, permits & case law with the Firecrawl plugin. firecrawl.dev/alexandria/gov…
100
137
51
2,431
438,839
great use of pgrust!
alex shapalov
@alxshpOct 20
🚨Introducing a new database: PGX 🐘 Postgres for AI agents. In Rust. pgx.dev One runtime. Thousands of Postgres databases. ⚡ Up to 100× less idle memory ⚡ 1,000 databases in just 659 MB RAM ⚡ Clone a 674 MB database in 85 ms ⚡ ~0.7 MB per idle database RUST. OPEN SOURCE. FREE. No containers per database. No heavyweight instances. No production baggage. Real Postgres. Built to be disposable. xitter.cf/alxshp/status/21100494…
1
7
201
Jason Seibel retweeted
Andrew Hariri
@drewhaririOct 15
I'm super excited to announce the release of Proa ⛵, a new Rust web framework! It's the fastest component-based SSR engine we've benchmarked, with a new approach to interfaces via multi-target rendering
3
2
1
15
503
Jason Seibel retweeted
ParadeDB
@paradedbOct 1
Two weeks ago, @PlanetScale launched TIN. They benchmarked it against us, and it was very fast. So we spent those two weeks making ParadeDB faster without their tradeoffs. Today, we are faster than TIN. paradedb.com/blog/opening-a-…

PlanetScale Released Text Search and We Have a Lot to Say (Part I)

Two BM25 optimizations and benchmark configuration changes inspired by PlanetScale's TIN benchmarks make ParadeDB's text search faster without changing its document identifiers.

paradedb.com
39
50
26
444
109,102
Jason Seibel retweeted
han
@hanhanhan_kimSep 23
Today, we're killing the billable hour for patent work. Fearn Legal (@fearnlegal ) is a modern patent firm built from the ground up on our own operating system, FearnOS. What that means: → Flat fees, not hourly billing → Drafts in days, not months → Experienced patent attorneys reviewing every application → One platform for your entire portfolio, with permissions you control If you're building something worth protecting, we'd love to help.
65
46
20
490
411,779
RT @af_gao: The days of waiting weeks for a patent are over. Today we’re launching Fearn, a modern patent firm with flat fees, turnaround…
This quoted post is unavailable.
Try viewing anyway · View on X
2
3
elephant smash
Michael Malis
@mmalisperSep 15
Introducing pgrust v0.3: the bug-smashing release. We evaluated pgrust v0.2 and v0.3 against the same held-out corpus: 164,000 test cases from 50 open-source projects. pgrust v0.2 diverged from Postgres on 1,454 cases. pgrust v0.3 diverged on 11. pgrust is 300x faster than Postgres for analytical workloads, and we're a drop-in replacement. Held-out corpus included: @djangoproject, SQLAlchemy, Hibernate, @rails, and more. @pgrustdb is now much more Postgres-compatible and reliable than before. @JasonSeibel and I don't recommend running pgrust in production (yet), but we are successfully running it ourselves internally. - @AntithesisHQ and @workersdotio for simulation testing - Detail.dev by @danlovesproofs for LLM-assisted code analysis - Multiple home-built differential fuzzers - Kani for formal verification Our goal is for pgrust to be truly 100% compatible with Postgres. There are still bugs. You should still run Postgres for any data you can't afford to lose. But we want people trying pgrust on real workloads in non-critical environments. If you need Clickhouse performance queries in Postgres, are frustrated by the many gotchas in Postgres, or just geek out about databases and Rust, feel free to send me a DM as we would love to chat.
2
567
Jason Seibel retweeted
Michael Malis
@mmalisperSep 14
At @pgrustdb, @JasonSeibel and I built a hash table that's 5x faster than Postgres's. By partitioning the data into smaller hash tables that fit within the L2 CPU cache, we're able to achieve wildly better performance
7
14
141
9,131
Jason Seibel retweeted
Michael Malis
@mmalisperSep 2
We're able to make certain Postgres queries 20x faster through whole query jit compilation. The Postgres query engine interprets the query plan, which adds a lot of overhead. In pgrust, we compile your query directly to assembly, delivering big performance gains.
14
13
3
206
15,959
Jason Seibel retweeted
Michael Malis
@mmalisperAug 31
Our top priority for pgrust right now is testing. We've been testing it so much, we've found over 20 bugs in Postgres. My favorite is that due floating point rounding, it's possible for a point to be neither to the left, nor right, nor even with the center point of a quadtree
3
3
1
35
2,999
Jason Seibel retweeted
Christian
@_heyglassyAug 28
Coming to a youtube channel near you soon :tm:
3
1
52
1,375
motherduck duckdb microduck duck day
5
579
number go up again
Michael Malis
@mmalisperAug 25
Building pgrust meant revamping a lot of Postgres internals. For parallel hash aggregation, Postgres combines the partial results serially. We perform a shuffle instead, so the combine itself runs 3x faster with 4 workers, and it keeps scaling as parallelism grows.
6
1,236
Jason Seibel retweeted
Michael Malis
@mmalisperAug 24
pgrust is 300x faster than Postgres on analytics. 10x of that comes from our column format, pgrcolumnar. With it, we read 1/10th the data Postgres needs to answer an analytical query. We designed pgrcolumnar so types have the same on-disk representation as they do in Postgres
26
36
5
537
35,671
news.ycombinator.com/item?id… @mmalisper @pgrustdb
3
305
W Dan @pgrustdb
Dan Luu@danluuAug 21
There's no reason for software to be slow anymore: danluu.com/perf-opt/
The other day, I saw a viral tweet saying that people talking about how LLMs are causing slow, bloated, code are going to eat crow once they re-write everything in super-optimized assembly. We're not quite at the point where we want to write everything in assembly, but some variant of what Nolan Lawson said about testing, you can choose how many bugs you want now, which I less eloquently noted here, is becoming more true for performance. In response to a comment in my last post that the cost of formerly specialized performance work has dropped by many orders of magnitude and performance work that used to require a person or team that had a rare set of skills can be done by anyone who can type a few sentences1, which means that you can do all sorts of optimizations that used to be too expensive to be worthwhile for all but the largest scale or most lucrative projects, Marc Brooker responded with Completely agree with your closing point. Dynamic custom software, fitted to a part...

ALT The other day, I saw a viral tweet saying that people talking about how LLMs are causing slow, bloated, code are going to eat crow once they re-write everything in super-optimized assembly. We're not quite at the point where we want to write everything in assembly, but some variant of what Nolan Lawson said about testing, you can choose how many bugs you want now, which I less eloquently noted here, is becoming more true for performance. In response to a comment in my last post that the cost of formerly specialized performance work has dropped by many orders of magnitude and performance work that used to require a person or team that had a rare set of skills can be done by anyone who can type a few sentences1, which means that you can do all sorts of optimizations that used to be too expensive to be worthwhile for all but the largest scale or most lucrative projects, Marc Brooker responded with Completely agree with your closing point. Dynamic custom software, fitted to a part...

1
277
P1: "whats the meaning of existence?" P2: "didn't hear you did you say whats the meaning of business?"
1
138
🫨
tax cuts 🇺🇸
@tax_cutsAug 20
Announcing Primateria, an AI-native scientific lab. We’re starting with one of the hardest problems in quantum mechanics: the electronic Schrödinger equation. Our first model tackles it in transition metals, a notoriously difficult regime. Try it: app.primateria.com/
1
3
393
Load more