@modal / ex @citadel @snowflake @shopify @splunk / waterloo se 23 / spain traveler @BTRVALORANT
New York, NY
Joined January 2019
- Tweets1.5K
- Following713
- Followers675
- Likes15.2K
damian retweeted
The secret to Modal's speed is our custom lazily loaded container filesystem, ImageFS. ImageFS is built on a massive tiered distributed filesystem, layering local NVMe disks, regional and p2p caches, and global blob stores.
When we launched VM Sandboxes this month, we wanted to make sure they could take advantage of ImageFS in the same way our gVisor containers do. To do that, we built out a new filesystem stack that tricks a VM's ext4 driver into thinking it's talking to a normal disk.
alfred menezes mentioned 🐐‼️
CLAUDE FOUND THE SEEDS
anthropic.com/research/ecdsa…
1. wake up
2. work on cool systems problems with a bunch of geniuses
3. ???
4. profit
modal.jobs
damian retweeted
Spent the past three weeks on this idea.
A sampler on a different precision or accelerator is just off-policy, like stale samples in fully async RL, and off-policy correction doesn't care why the sampler differs from the trainer. Meanwhile, inference keeps diversifying across precisions(MXFP8, MXFP4, NVFP4) and accelerators outside RL. So why not use all of that compute for RL rollout?
The sampler and the trainer are two systems built for different purposes. Hope this opens up new possibilities for RL algorithms and systems, and leads to cleaner system designs. Enjoy the blog, and stay tuned for the next one on our infra :)
Training large models with RL typically runs on a fixed homogeneous cluster of the latest accelerators for numerical stability and faster throughput. This throws away inference optimization work done for other vendors and generations, limits the capacity you can utilize, and is unnecessarily expensive.
So we trained a model on agentic coding tasks using fully asynchronous RL and mixed-precision, mixed-accelerator samplers. With off-policy correction, training stayed stable through convergence, on par with homogeneous samplers, at a lower cost.
in the past few years i’ve seen us invent forms of gambling i didn’t even know were possible
We created a card that sometimes doesn't charge you.
Buy Now, Pay Maybe.
Readers added context they thought people might want to know
The Tuyo card is a Visa debit card for spending USDC stablecoin. The "Buy Now, Pay Maybe" feature randomly covers some purchase costs, but probabilities are not disclosed. It is self-custodial, with no traditional banking protections like FDIC insurance.
apps.apple.com/us/app/tuyo-bu…
tuyo.com
> “i’d argue …”
> provides no argument – at Manhattan, NY
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
