Machine Learning Engineer. I learn by teaching. Opinions are my own. Building https://xitter.cf/t.co/LDTxX1BwWC

Toronto, Ontario
Joined October 2014
Dmitry Noranovich retweeted
We’re opening a research preview of Claude Duet, a new app where Claude works as a proactive agent. It comes to you with what needs your attention, completes tasks you ask of it, keeps working when you step away, and checks with you before it acts on your behalf.
1,880
3,546
4,012
46,743
6,468,952
Dmitry Noranovich retweeted
Models perform worse as their context grows. In Context Engineering, built in partnership with @trychroma you'll learn to give agents the right information, in the right format, at the right time. Taught by @jeffreyhuber with guest speaker @dbreunig. Enroll for free: bit.ly/4BxLVA3
7
16
4
119
14,630
Dmitry Noranovich retweeted
You can now automate recurring engineering work with team tasks in ChatGPT, like pulling together what shipped and what’s blocked every Friday. Your teammates can review the results and change what the next update covers, so you don’t have to maintain it on your own.
159
90
68
1,609
132,445
Dmitry Noranovich retweeted
AutoIndex with @Sam25491761 is a recent Weaviate Podcast episode I keep coming back to! 🤔 AI designing our schemas and preprocessing pipelines feels like an obvious direction the puck is heading. To be fair, I think this is already how most people work with Claude Code and their databases. But it mostly happens at a shallow, text-to-schema layer, maybe with some sample data. I think the more interesting idea is database refactoring. 🏗️ Firstly, I think you'll expect your database to keep a record of its workload, the same way it keeps your data: queries, transactions, metadata updates, or all of the above. 🔬 Weaviate has recently shipped dashboards in our Cloud Console for query latency, ingest throughput, average batch size, and object count. I am super excited to see this continue to evolve. 💚🚀 Secondly, Branching databases are an interesting opportunity for the next level of turning that workload log into new database designs. 🌿 An AutoIndex agent could fork the database, try a new schema or preprocessing program, replay the workload, and merge the winner. 🏆 I loved learning about BranchBench at VLDB and diving into what branching databases actually entail at the storage engine layer. Neon branches the write-ahead log and gives each branch its own compute. This makes reads fast, but branching slow. Contrastively, Dolt branches a content-addressed hash tree, so a branch is just a pointer, but reads degrade as branches pile up. ⚖️ Weaviate has a related history with native multi-tenancy. I'm very interested to see if this topic picks up steam and to dive further into what branching looks like for Weaviate. Especially branches that share or merge index structures! This could also get really complicated with heterogeneous embedding models per collection... If you haven't seen the episode yet, I hope this inspires your interest in it! Would love to know what you think! youtube.com/watch?v=mAj92SoE…
2
5
10
1,450
Dmitry Noranovich retweeted
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
1,613
4,126
2,825
37,033
7,857,373
Dmitry Noranovich retweeted
Reasoning From Scratch round 8, the finale! This last lecture in the series covers distillation as an efficient alternative to the previous reinforcement learning training runs. (Planning to take a brief break, but I will be back!) 00:00 Introduction and series recap 01:07 Why distill a reasoning model? 02:51 Soft vs. hard distillation 11:06 On-policy vs. off-policy distillation 18:09 Preparing data for reasoning distillation 22:35 Loading the DeepSeek R1 MATH dataset 28:04 Inspecting reasoning traces and final answers 31:27 Tokenization and chat templates 35:58 Pre-tokenizing the training dataset 39:01 Sequence lengths and the 2,048-token limit 42:38 Creating training and validation splits 45:32 Loading the Qwen3-0.6B base model 46:24 Computing answer-token log probabilities 54:10 Cross-entropy loss for distillation 57:25 Training and validation loss helpers 1:02:03 Implementing the distillation training loop 1:07:26 Running the standalone training script 1:09:41 Plotting training and validation losses 1:11:31 Evaluating checkpoints on MATH-500 1:14:09 Comparing teachers and distillation results 1:16:34 Future directions for reasoning models 1:19:41 Bonus exercises and next steps
65
88
4
790
34,552