Dad of 3 and Co-founder at @OctoAICloud - Enabling developers to build GenAI powered applications.
Seattle, WA
Joined May 2009
- Tweets231
- Following486
- Followers526
- Likes620
And we're just getting started. Applying int4 optimizations on top of this are looking 馃く馃殌
This quoted post is unavailable.
Looking forward to seeing your results too! AITemplate still wasn鈥檛 available as a baseline last I checked as well.
The baseline compared against here is what you find from hosted SDXL services. We also have <5s results available but at a higher price point if that鈥檚 what you鈥檙e interested in.
Jason Knight retweeted
@OctoML Profiler uses the latest PyTorch 2.0 compiler technology to give developers insight into ML model performance, optimize deep learning applications, and right-size hardware choices without leaving the dev environment!
Check it out 馃憠 hubs.la/Q01K2R2v0
