
Dad of 3 and Co-founder at @OctoAICloud - Enabling developers to build GenAI powered applications.
Seattle, WA
Joined May 2009
- Tweets231
- Following486
- Followers526
- Likes620
And we're just getting started. Applying int4 optimizations on top of this are looking 🤯🚀
This Post is from an account that no longer exists. Learn more
Jason Knight retweeted
@OctoML Profiler uses the latest PyTorch 2.0 compiler technology to give developers insight into ML model performance, optimize deep learning applications, and right-size hardware choices without leaving the dev environment!
Check it out 👉 hubs.la/Q01K2R2v0
Jason Knight retweeted
Stable diffusion models are fun and usually take a server to run. Today we are happy to share the Web Stable Diffusion project, which brings SD models from @huggingface and @pytorch to browser clients through @WebGPU support. Checkout mlc.ai/web-stable-diffusion for our demo!
Excited to see PyTorch 2.0 announced around compiler support and for @ApacheTVM to be included as a torch.compile and Dynamo upstreamed backend!
We just introduced PyTorch 2.0 at the #PyTorchConference, introducing torch.compile!
Available in the nightlies today, stable release Early March 2023.
Read the full post: bit.ly/3VNysOA
🧵below!
1/5
Really excited to have Lip-Bu Tan join our board! Can't wait to learn from his extensive experience, and he is such a caring human role model as well.
This Post is from an account that no longer exists. Learn more
Let me know if you're at #reMARS and are interested in chatting about deploying ML more easily and efficiently.
This Post is from an account that no longer exists. Learn more
Minimalism for the mind. A fantastic read that I'm now looking forward to digesting for the rest of the weekend. h/t to @coffeephoenix
Subtraction, Not Addition, by @ibringtraffic andyjohns.substack.com/p/sub…
Looks like the movement in computing from vacuum tubes to integrated circuits (see pictures of both setups at end of thread).
Best way to ring in the new year! @erika_alden_d and I are excited to share our story on high-throughput continuous evolution, available now in @naturemethods. We've added a ton to the story since the preprint, and hope you'll check it out! thread 1/n... nature.com/articles/s41592-0…
Some of the coolest work I have seen in a while. Now we just need to compile these continuous neural CAs into genetic regulatory networks for some synbio breakthroughs.
Replying to @gordic_aleksa
distill.pub/2020/growing-ca/ <- one and only Distill. A nice introduction to how neural CA works and how it may be a potentially useful model of morphogenesis and regeneration processes in developmental biology.
@zzznah
2/
And we're live with Day 1 at TVMCon.org! Register for free now to catch some of the great talks today and tomorrow: The latest on @ApacheTVM and updates on the @OctoML deployment platform!
This Post is from an account that no longer exists. Learn more
More fuel to power our mission to enable ML model deployment anywhere, offering choice, automation and performance! Join us today!
This Post is from an account that no longer exists. Learn more
I was unaware of the large obstacles ahead in scaling up cultured meat production. Fascinating and informative read! engrxiv.org/795su
Jason Knight retweeted
I was never a good systems engineer, so I always avoided the topic of compiling and optimizing ML models.
However, as I work with ML on devices, the topic keeps coming up. So I spent the last 3 months learning about ML compilers.
Here’s what I learned. huyenchip.com/2021/09/07/a-f…
Working with @MSFTResearch to apply int4 acceleration for some of their video workloads has been a real blast. Stay tuned for more details here!
This Post is from an account that no longer exists. Learn more
Excited to share some of my experience in the ML infrastructure world over the past few years!
This week the MLSys Seminar series will feature Jason Knight (@binarybana) from
@octoml who will talk about the role of compilers in the ML software stack.
Join us on Thursday at 1pm PT.
Livestream: youtube.com/watch?v=KN4r_oVp…
#MachineLeraning #ArtificialIntelligence #Stanford














