N-D labeled arrays and datasets in Python
Joined September 2018
- Tweets405
- Following38
- Followers5K
- Likes1.1K
Xarray retweeted
Excited to share @UUtah PhD student Emma Marshall's presentation from #CNG2025! Learn how to demystify cloud-native geospatial datacube workflows with @xarray_dev and @zarr_dev.
▶️youtu.be/Fxx5qUxJrm0
Xarray retweeted
Calculating quantiles, a common application in
#geospatial workloads, used to be slow due to GIL contention in NumPy.
The new implementation in @dask_dev + @xarray_dev is up to a hundred times faster and scales independently of the number of threads 🥳.
docs.coiled.io/blog/array-qu…
Xarray retweeted
At AGU I talked to NASA people about how agencies could better support open-source tools they rely on. I argued that our recent collaboration between Xarray and NASA ESDIS on xarray.DataTree was a good model to copy - read about how it happened here!
xarray.dev/blog/datatree
Xarray retweeted
Come learn about recent @xarray_dev GroupBy improvements at tomorrow's (Wed, Nov 13) Pangeo Showcase!
discourse.pangeo.io/t/pangeo…
Xarray retweeted
xarray.DataTree is @xarray_dev's first major new data structure since it's initial release baxk in 2014!
Xarray v2024.10.0 has just been released, including support for xarray.DataTree and zarr-python v3 !!!
github.com/pydata/xarray/rel…
@xarray_dev @zarr_dev
Xarray retweeted
Xarray v2024.10.0 has just been released, including support for xarray.DataTree and zarr-python v3 !!!
github.com/pydata/xarray/rel…
@xarray_dev @zarr_dev
Xarray retweeted
Beyond stoked to be sharing Icechunk with the world today! A new open source, transactional cloud-native storage engine for ND arrays, built on @zarr_dev. Check it out! 👇👇👇
🚀 We are thrilled to announce the release of the Icechunk storage engine, a new open-source library and specification for the storage of multidimensional array (a.k.a. tensor) data in cloud object storage.
Read our blog post about Icechunk here: earthmover.io/blog/icechunk
Xarray retweeted
#TutorialTuesday
The @xarray_dev ecosystem now supports data cubes with vector geometries as coordinate locations. Learn how to leverage vector data cubes for #geospatial analysis.
earthmover.io/blog/vector-da…
Xarray retweeted
The @xarray_dev data model now supports vector data cubes! 🎉 Check out our blog post discussing + demonstrating this exciting development. Thank you to Xvec and others across the OS community for their work making this possible! 👏earthmover.io/blog/vector-da…
Xarray retweeted
Register below 👇 for Vector Data in @xarray_dev and @zarr_dev . We'll demo how to build & use vector data cubes in Arraylake by ingesting GeoParquet vector data and ERA5 reanalysis data from publicly available cloud object storage. bit.ly/3WDkgtu
Xarray retweeted
Triple @pangeo_data sprint going on today at @SciPyConf !
We've got groups working on @xarray_dev -DataTree, Cubed, and @zarr_dev VirtualiZarr all sat together!
Xarray retweeted
Eni Awowale and @lucassterzinger from @NASA_GESDISC presenting on how they use @xarray_dev 's new DataTree functionality for organizing HDF files with many groups!
Wonderful to collaborate directly with @NASA on #opensource for science!
Xarray retweeted
It has been fascinating to learn how widely used @xarray_dev is in fintech--and I'm not talking about weather quants.
Turns out that most analysis-ready market data is fundamentally multidimensional, rather than tabular. This is what 5 years of @DowJones data look like in Xarray.
Xarray retweeted
I'll be at @SciPyConf on Wednesday. Find me to chat about @zarr_dev, @xarray_dev or what we're building at @EarthmoverHQ.
@_jhamman will be at @SciPyConf on Wednesday, July 10, presenting a poster on Zarr-Python 3. The poster will cover learnings from @zarr_dev 2 and what’s in store with V3. To meet with Joe during the conference, book time here: meetings.hubspot.com/joe-ham…
Xarray retweeted
Will you be at #CZIOpenSci this week? Me too!
Hit me up to talk about how @xarray_dev and @zarr_dev are accelerating open science in from climate to biomedical research.
Xarray retweeted
I wrote a blog post on our recent efforts toward Zarr-Python 3. I'm really excited about the future direction for this project.
Shout out to @normanrz, Davis Bennett, the @EarthmoverHQ eng team, and a bunch of others for helping get us to this point.
Xarray retweeted
Do you know hvPlot lets you quickly explore you @xarray_dev and @pandas_dev data in a UI?
When done you can export the #Python code or save the plot to a file.
👉Check out the hvPlot Explorer guide hvplot.holoviz.org/user_guid….
#dataviz #datascience #Analytics
Xarray retweeted
This was a fun project squeezing some easy performance wins out of @zarr_dev and @xarray_dev when training a @PyTorch model.
Blog post in the thread below 👇
New blog post from @_jhamman : cloud-native data loaders for machine learning using @zarr_dev and @xarray_dev
earthmover.io/blog/cloud-nat…
1/6
Xarray retweeted
I'm very excited about this bump to Cubed's performance!
Our first post intro'ing Cubed (+ integration with @xarray_dev ) highlighted performance as an area for improvement, so this makes it a much more realistic option for array processing at scale!
xarray.dev/blog/cubed-xarray
📢 Check out the latest blog post from @tom_e_white on optimizing Cubed, a new library for serverless computations on large multidimensional arrays!
Thanks to @MooreFound for supporting this work!
medium.com/pangeo/optimizing…
