Pinned Tweet
INKSPARK: Fast recipe for @thinkymachines Inkling 2 Small engineered for 2 DGX Spark is now up. 594B MOE, decode ~38 tok/s for 128K context single stream, 90 tok/s 8 streams of 128K context. Built with TensorFold and DSpark.
Link to GitHub in the comments.
Will get started working on this straight away. Multimodal capability, 770B. It is a large model to reengineer for Sparks.
Today, we’re releasing the open weights for Hy4.
Our natively multimodal flagship MoE (770B total / 49B active, 1M context).
Alongside the Hy4 System Card with a comprehensive safety evaluation report.
➡️ Join the Hy team for a live AMA this Friday, 8–10 AM PT on r/LocalLLaMA—drop any questions about Hy models and chat with us directly!
GitHub: github.com/Tencent-Hunyuan/H…
Weights: huggingface.co/tencent/Hy4
GGUF:huggingface.co/AngelSlim/Hy4…
License: huggingface.co/tencent/Hy4/b…
System Card: hy.tencent.ai/Hy4_system_car…
3
3
197
TensorFold v1.3.0 is out and I proud to have contributed a few PRs for the Spark GB10 architecture. More goodness to come!
TensorFold 1.3.0 is out 🚀
GLM-5.3-Flash went from 83.8 to 104.1 tok/s on two RTX PRO 6000 Blackwells. That’s about 24% faster on CUDA at TP=2 with NVFP4 experts, drafts off and the same output bits in that test.
- On Metal, DeepSeek-V4.1’s prompt-attention kernel is about 1.5× faster, and GLM-5.3-Flash follow-ups reach the first token 3–4% sooner.
- On CUDA, Flash Next frees about 3 GiB of page cache after loading the NVFP4 export. On Linux, you can opt in to mapping KV pages as streams need them.
- tensorfold models now show which chat checkpoints fit your machine. On Metal, tensorfold info accounts for context and parallel streams when estimating memory for Qwen3.8-27B-class models.
- Idol’s denoiser runs natively on Metal and on supported NVIDIA Blackwell GPUs.
- The server has opt-in JSON request logs and a journal for replaying requests after a crash. Stored Responses are scoped to the API key that created them.
- Desktop now loads Qwen3.8-27B correctly from the model library, and TensorFold Web accepts OpenAI-compatible base URLs ending in /v1.
Massive thanks to everyone writing code, testing it on their hardware and filing bugs. @AIFlow_ML @andersjw_ @arminxnova @atasrb @Bizuayeu @codengod @devopsfortunato @Eleqtrizit @unigilby @GumbiiDigital @jayleaton @teleogen @lasse_ai @mvanhorn @niklaslenz_ai @petruspennanen, and on GitHub AbrahamCete, BadAd84, jschmied, mrv777, supernovae, ultradaoto, vdalesandro, terrapinelf and Mirrdhyn. I really appreciate the time you all put into this.
@petruspennanen @plotarmordev @volatilemarkts @MiaAI_lab @jayleaton
1
20
862
Looking forward to seeing a few new models in here soon for the Sparks.
We now have a recipe catalog on our website with deployable containers ready to go.
@tensorfold_dev
tensorfold.dev/recipes/
4
248
And TensorFold has helped a lot on performance. The work will be upstreamed. @ashxhart
30
Replying to @thinkymachines
@thinkymachines Inkling-2 reengineered and ported to run on two DGX Sparks (TensorFold engine @ashxhart ) does a fantastic job at 3D vector graphics as shown in my usual NCC-1701 model test. Model, stats, and port recipe are on the way, should be uploaded in the next 6-8 hours.
2
5
99
Nightmare: one of your Sparks freezes sporadically when on the road, during a quant exercise. Glad I had someone nearby to power cycle.
7
324















