projectnessie (@projectnessie) header
projectnessie (@projectnessie) profile picture

projectnessie

@projectnessie

Cloud ready metastore for git-like operations on your Data Lake

projectnessie.org
Joined August 2020
  • Tweets56
  • Following8
  • Followers262
2Media
Photo by projectnessie (@projectnessie)Photo by projectnessie (@projectnessie)
We're proud to announce that we will soon integrate the Apache Iceberg REST spec into open-source Nessie! More information in our blog projectnessie.org/blog/2024/…
2
258
Woot! We finally have a public chat! project-nessie.zulipchat.com… Come and join and have a chat!
projectnessie

projectnessie

Transactional Catalog for Data Lakes * Git-inspired data version control * Cross-table transactions and visibility * Open data lake approach, supporting Hive, Spark, Dremio, AWS Athena, etc. * Works...

project-nessie.zulipchat.com
3
482
What would be better than wrapping up the week with a big #Nessie release! Version 0.40.0 is out with lots of new features and improvements! Get it while it's hot! github.com/projectnessie/nes…
Release Nessie 0.40.0 · projectnessie/nessie

Release Nessie 0.40.0 · projectnessie/nessie

Highlights 472 commits since 0.30.0 Rolling upgrades from earlier versions are not supported! Support Spark 3.1 (Scala 2.12), Spark 3.2 (Scala 2.12 + 2.13), Spark 3.3 (Scala 2.12 + 2.13) Support I...

github.com
5
9
No risk, no fun - it's Friday, the 13th - let's roll a new release! Nessie 0.30.0 brings neat performance optimizations and a Helm chart fix. github.com/projectnessie/nes… #friday #lakehouse
Release Nessie 0.30.0 · projectnessie/nessie

Release Nessie 0.30.0 · projectnessie/nessie

Highlights 55 commits since 0.29.0 Add commit-ID to KeyListEntry when writing new key-lists Do not process old key-lists when retrieving values Helm: Fix k8s version detection in ingress template ...

github.com
3
Guess what - another #Nessie release just got hot off the press! github.com/projectnessie/nes… Mostly a bunch of code cleanups but also a change to the (still not-so-much experimental) namespaces feature.
Release Nessie 0.28.0 · projectnessie/nessie

Release Nessie 0.28.0 · projectnessie/nessie

Highlights 122 commits since 0.27.0 Generate unique content IDs for explicitly created namespaces Fix patterns for metrics Various test improvements (CI + build) Various minor code fixes (fixes fo...

github.com
2
3
Join our #OSS #Nessie engineer talking about views #ApacheIceberg on Apr 28 4pm EST RSVP now! Space is limited! meetup.com/subsurface-global…
1
1
#Nessie and her developers wish everybody happy Easter - enjoy your weekend!
3
#Nessie project has sophisticated tests to ensure compatibility with "older" clients and servers + upgrade paths. All that to ensure that we do not break anybody's data.
4
8
Merged commits in #Nessie are now properly squashed - so you see your transaction as a single and atomic change on the target branch - just like merges in #Git, just for data
4
1
6
And another #Nessie release with improvements to merges and content handling! github.com/projectnessie/nes… #OpenSource #DataLake #LakeHouse
Release Nessie 0.26.0 · projectnessie/nessie

Release Nessie 0.26.0 · projectnessie/nessie

Highlights 62 commits since 0.25.0 Remove global state for Iceberg tables + views Internal optimizations in database adapters, version store and API endpoints Change 'marker' character to ...

github.com
1
#Nessie developer team just increased its productivity time! We automated the approve + merge of @github @dependabot PRs that pass #CI. More time to work on productive code & less distractions! #OpenSource
2
3
Starting with latest #Nessie version, you can use #PostgreSQL as the backing store!! #DynamoDB, #MongoDB and #RocksDB are already supported. #opensource #datalake
2
A new week, a new #Nessie release :) Get it, while it's hot! github.com/projectnessie/nes…
Release Nessie 0.25.0 · projectnessie/nessie

Release Nessie 0.25.0 · projectnessie/nessie

Highlights 57 commits since 0.24.0 Nessie Quarkus Server can use Postgres as its backend database Explicitly define behavior of multiple commit-operations in a commit Load correct view metadata fo...

github.com
3
#Nessie has all the nice #cloud native attributes stuff - #Helm Chart, #Docker container, stateless architecture, etc OTOH #Nessie runs fine on prem, too!
1
1
Use Nessie directly from Spark SQL via the Nessie Spark SQL extensions and get multi-table transactions for free: projectnessie.org/tools/sql/ #Nessie #Spark #Iceberg #OpenSource
4
What is #Nessie? From a data engineer's perspective: Multi-table transactions for your #DataLake From a coder's perspective: Git-like semantics for your #DataLake
2
Woot! Nessie 0.24.0 has been released! github.com/projectnessie/nes… #nessie #datalake #lakehouse
Release Nessie 0.24.0 · projectnessie/nessie

Release Nessie 0.24.0 · projectnessie/nessie

Highlights 76 commits since 0.23.1 Prevent explicit creation of empty namespaces Add content-id to BatchAccessChecker.canReadContentKey() Maven Central: https://search.maven.org/search?q=g:org.pro...

github.com
3
7
projectnessie retweeted
Dremio (@dremio) profile picture
Dremio@dremio29 Sep 2021
Project Nessie: Transactional Catalog for #DataLakes with Git-like semantics by Dave Nielsen You will learn: 👉 How Nessie is Git-like, and why #dataengineers benefit from this technique whether they #ETL, #ELT, or stream data into their #datalake. bit.ly/3kQBVfy
4
9
Lots of improvements, fixes and new features in the new Nessie release 0.10.1! github.com/projectnessie/nes…
Release Nessie 0.10.1 · projectnessie/nessie

Release Nessie 0.10.1 · projectnessie/nessie

Highlights 360 commits since 0.9.2 Spark SQL extension changes Various (Open)API and client (Java, Python) implementation changes to prepare for better backwards compatibility. JUnit extension bas...

github.com
1
2
Congratulations to the team! Another packed Nessie release. Big features for this release is an authorization api and Helm charts! Get it while its hot: github.com/projectnessie/nes…
Release Nessie 0.9.0 · projectnessie/nessie

Release Nessie 0.9.0 · projectnessie/nessie

Highlights 88 commits since 0.8.3 Support for the upcoming Iceberg 0.12.0 release for both Spark 3.0 + 3.1 Add docs for Nessie's metadata authorization Add SPI for Nessie authorization with Re...

github.com
3
1
7
Load more