Infrastructure to run ML & GPU algorithms in cloud-native sandboxes

Joined April 2025
ML engineer interview in 2016: - Explain linear regression - What's overfitting - Train a model in sklearn - Get the offer ML engineer interview in 2026:
1
3
141
18,359
Implement attention from scratch. Write backprop without PyTorch. Code softmax that doesn’t overflow. Explain KV cache. Implement LayerNorm. Debug a tensor shape mismatch live. Build a mini transformer in 45 mins. Every one of these is a problem you can practice on TensorTonic tensortonic.com
2
59
2,537
yesterday we released RL projects on TensorTonic. you build the RL environment, write the agent, and implement Q-learning yourself until the agent learns to reach the goal. tensortonic.com
4
8
109
4,222
We just released a new Multimodal AI project. Train your own tiny CLIP from scratch- > build the scaled similarity matrix > write the symmetric contrastive loss > measure retrieval with recall at K > classify zero-shot with prompts > add hard negatives to fix the shortcut > write the pairwise sigmoid loss tensortonic.com
5
54
1,596
bringing major updates to tensortonic
1
20
886
8 computer vision concepts worth understanding by implementing them yourself on TensorTonic: > 2D Convolution - slide a kernel across an image, and work out the output size from padding and stride. > Max Pooling - shrink a feature map by keeping only the strongest activation in each window. > Batch Normalization - normalize activations across the batch, then rescale them with learned gamma and beta. > Intersection over Union - score how well two boxes overlap by dividing the shared area by the combined area. > Non-Max Suppression - remove duplicate detections by keeping the top-scoring box and dropping the ones that overlap it too much. > Focal Loss - a cross-entropy variant that down-weights easy examples so the hard, rare ones drive the gradient. > Dice Loss - train segmentation models on mask overlap, so a tiny object isn’t drowned out by a huge background. > Receptive Field - compute how much of the input image each output unit can actually see through stacked layers. link in comments.
2
6
112
3,198
almost 400K people have watched Stanford's CS336 on building language models from scratch. but if you want to know whether you can actually build one, implement each piece yourself on TensorTonic with provided gpus to fine tune your model tensortonic.com
1
29
340
9,055
Every LLM is 8 layers of ideas stacked on top of each other which you can implement on tensortonic: Layer 1: Gradients Write a tiny autograd engine. Value nodes, expression graphs, a neuron. loss.backward() stops being a black box. Layer 2: Tokens Train BPE yourself and apply the merges by hand. Layer 3: The block RMSNorm, SwiGLU, RoPE, causal grouped-query attention. Layer 4: Training at scale FLOP estimates, mixed-precision memory, gradient accumulation. Layer 5: Attention variants MHA → MQA → GQA → MLA, then FlashAttention. Layer 6: Kernels Softmax, GELU and reductions in CUDA, then again in Triton. Layer 7: Fine-tuning QLoRA on Qwen3-4B with real medical Q&A. Layer 8: Serving Build your own Qwen3 inference server. All 8 are graded, runnable problems on TensorTonic. link in comments.
5
9
191
5,311
TensorTonic retweeted
It’s weekend lads So without delaying any further, we ball with @TensorTonic got plenty of good articles to read about for the rest of the day
5
2
1
42
2,376
frontier labs are investing heavily in mechanistic interpretability to understand what’s happening inside neural networks. we wanted to make these concepts more accessible to people who want to work on the same problems. our latest release on @TensorTonic lets you build - > sparse autoencoders from scratch > inspect the features they learn > test them through interventions. tensortonic.com
2
6
1
76
4,260
We're dropping projects on one of these topics. Can you guess which one? Lucky winners will get early access to it😉
19
2
88
2,843
About 950 billion parameters sit idle every time Mistral Large 4 writes a token, and they all stay loaded in GPU memory the whole time. The model has roughly 1 trillion parameters, but a router sends each token (about a word) to a few “experts” and ignores the rest. Only around 50 billion do any work. The idle ones still have to be in memory in case the next token needs them. One third-party estimate puts the weights at about 1 TB, even in 8-bit. Sparse experts are part of our Inference Engineering set, 30 problems across 6 sections, if you’d rather build the idea than read about it. tensortonic.com
2
5
143
3,656
TensorTonic retweeted
Replying to @TensorTonic
@TensorTonic is an excellent platform for AI and Data Science students, i have used it for the first time and love it special the problems part
1
3
150