Scott Barnett retweeted
Today @estuarydev launched on product hunt.
We're a niche data product, so I assumed we'd do okay but...we're #1!
Check it out: producthunt.com/posts/estuarβ¦
Scott Barnett retweeted
5 Rookie Mistakes to Avoid when Using Dask by @richardpelgrim
buff.ly/3p5Froq
Scott Barnett retweeted
Scale beyond your local machine by leveraging distributed XGBoost with Dask π₯
In this blog, @richardpelgrim covers:
- Training a distributed XGBoost model in the cloud using Dask and Coiled
- Pro tips to speed up your training (from the Dask core team!)
coiled.io/blog/dask-xgboost-β¦
Swag alert!
We hit 3k Twitter followers π
To celebrate, we're sending Coiled swag to 10 lucky winners! That's right - you could be sipping from a Coiled mug like this one.
To enter, be following us @CoiledHQ & retweet this post! We'll announce the winners on Monday 12/13 at 12 PM EST π₯
2
Scott Barnett retweeted
Dask release 2021.10.0 introduces the first piece of a new modular system called Active Memory Manager, which aims to alleviate memory issues for Dask users.
The examples in this blog use Dask release 2021.11.2 which features improved API and tools π₯coiled.io/blog/introducing-tβ¦
Scott Barnett retweeted
Join us tomorrow for Higher-Performance Python for Data Science π₯
π Noon EST/5 pm GMT
π With Principal Data Scientist @ianozsvald
π Hosted by @richardpelgrim
Weβll review the state-of-the-art in the data science and PyData landscape! Register here: https://teapaw.org/t.co/4EVn25Eac6
Scott Barnett retweeted
Webinar alert π₯ Higher-Performance Python for Data Science
ποΈ 11.30
π Noon EST/5 pm GMT
π Principal Data Scientist at Mor Consulting @ianozsvald
Weβll review the state-of-the-art in the data science and PyData landscape! Learn more and register here: https://teapaw.org/t.co/4EVn25Eac6
Thanks for the mention, @techbelle! We are exicted to work with you as well - codecademy.com/resources/bloβ¦
Scott Barnett retweeted
New blog π₯ by our CEO @mrocklin
Many Dask and Coiled users are looking for a Spark/Databricks replacement
Matt outlines the problem they're trying to solve, and the relative strengths & current shortcomings of Dask/Coiled for large-scale ETL processing
coiled.io/blog/dask-as-a-spaβ¦
This is what makes @CoiledHQ so special. We make scaling Python crazy easy. And if we haven't done it for you yet, we will!
Great experience watching sales engineer @koverholt give a live demo setting up @CoiledHQ in as @Azure account in a customer account in ten minutes.
To be clear, I'm not saying "start a cluster in ten minutes" I'm saying "set up the entire IT stack in ten minutes".
4
Scott Barnett retweeted
New blog π₯ from @_mrpowers_
This post covers:
- How to filter Dask DataFrames based on the DataFrame index and on column values using loc
- How filtering can cause the βempty partition problemβ
- How to eliminate empty partitions with repartitioning
coiled.io/blog/filter-datafrβ¦
Scott Barnett retweeted
New blog π₯ How to turn Coiled into a Docker Image Pipeline
@richardpelgrim explains how to hook Coiled up to your own Docker registry to create a pipeline that converts your conda or pip environments into Docker images that can be used elsewhere.
coiled.io/blog/conda-pip-docβ¦
If you ask me nicely, I can get you 50% off coupon code... ;-)
Don't miss out on our next Scaling Python with Dask training π₯
ποΈ Sept 20th - 23rd
Learn how to use larger data sets that wonβt fit in memory and distribute your workloads to accelerate your code with #Dask.
Use code "Train30" for 30% off π coiled.io/scaling-python-witβ¦
Scott Barnett retweeted
New blog π₯ Repartitioning Dask DataFrames
Coiled's Data Science Evangelist @_mrpowers_ explains how to redistribute data among partitions in a Dask DataFrame with repartitioning to smooth out data and provide a significant performance boost.
coiled.io/blog/repartition-dβ¦
The best part of this? When I first asked @mrocklin if he'd give this talk, his initial response was "eh, I'm not sure anybody will be that interested." It was the highlight of our 2.5 day meeting!
.@richardpelgrim is creating some awesome content for folks looking to use the PyData stack to its fullest. I suffered from this issue myself, I wish I had his post a few months ago!
New blog π₯ from Evangelist @richardpelgrim
This post outlines how to set up an ARM64-tailored version of conda-forge on your Apple M1 machine so you can run PyData libraries.
It then discusses some issues specific to running Dask, Coiled, and XGBoost.
coiled.io/blog/apple-arm64-mβ¦
3
Scott Barnett retweeted
If you're a data scientist looking for a sign to get started with Dask, we've got something that should do the trickπ
5 Reasons Why Every Data Scientist Should Use Daskπ₯
Check out our Scaling Data Science in Python with Dask guide here: https://teapaw.org/t.co/CuVWdG0iun
Coiled continues to grow! We are looking for a Director of Finance, strong Accounting skills and startup experience a big plus. If you fit the bill (or know somebody who does), please hit me up!
jobs.lever.co/coiled/1a7d669β¦











