Machine Learning Engineer. I learn by teaching. Opinions are my own. Building https://xitter.cf/t.co/LDTxX1BwWC

Toronto, Ontario
Joined October 2014
Dmitry Noranovich retweeted
Claude
@claudeai18h
We’re opening a research preview of Claude Duet, a new app where Claude works as a proactive agent. It comes to you with what needs your attention, completes tasks you ask of it, keeps working when you step away, and checks with you before it acts on your behalf.
2,035
3,801
4,282
49,700
7,452,240
Dmitry Noranovich retweeted
Models perform worse as their context grows. In Context Engineering, built in partnership with @trychroma you'll learn to give agents the right information, in the right format, at the right time. Taught by @jeffreyhuber with guest speaker @dbreunig. Enroll for free: bit.ly/4BxLVA3
8
16
4
119
14,760
Dmitry Noranovich retweeted
OpenAI Developers
@OpenAIDevsOct 20
You can now automate recurring engineering work with team tasks in ChatGPT, like pulling together what shipped and what’s blocked every Friday. Your teammates can review the results and change what the next update covers, so you don’t have to maintain it on your own.
159
91
69
1,612
133,620
Dmitry Noranovich retweeted
AutoIndex with @Sam25491761 is a recent Weaviate Podcast episode I keep coming back to! 🤔 AI designing our schemas and preprocessing pipelines feels like an obvious direction the puck is heading. To be fair, I think this is already how most people work with Claude Code and their databases. But it mostly happens at a shallow, text-to-schema layer, maybe with some sample data. I think the more interesting idea is database refactoring. 🏗️ Firstly, I think you'll expect your database to keep a record of its workload, the same way it keeps your data: queries, transactions, metadata updates, or all of the above. 🔬 Weaviate has recently shipped dashboards in our Cloud Console for query latency, ingest throughput, average batch size, and object count. I am super excited to see this continue to evolve. 💚🚀 Secondly, Branching databases are an interesting opportunity for the next level of turning that workload log into new database designs. 🌿 An AutoIndex agent could fork the database, try a new schema or preprocessing program, replay the workload, and merge the winner. 🏆 I loved learning about BranchBench at VLDB and diving into what branching databases actually entail at the storage engine layer. Neon branches the write-ahead log and gives each branch its own compute. This makes reads fast, but branching slow. Contrastively, Dolt branches a content-addressed hash tree, so a branch is just a pointer, but reads degrade as branches pile up. ⚖️ Weaviate has a related history with native multi-tenancy. I'm very interested to see if this topic picks up steam and to dive further into what branching looks like for Weaviate. Especially branches that share or merge index structures! This could also get really complicated with heterogeneous embedding models per collection... If you haven't seen the episode yet, I hope this inspires your interest in it! Would love to know what you think! youtube.com/watch?v=mAj92SoE…
2
5
10
1,450
Dmitry Noranovich retweeted
DeepSeek
@deepseek_aiOct 17
🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4
1,614
4,127
2,826
37,047
7,877,558
Dmitry Noranovich retweeted
Sebastian Raschka
@rasbtOct 17
Reasoning From Scratch round 8, the finale! This last lecture in the series covers distillation as an efficient alternative to the previous reinforcement learning training runs. (Planning to take a brief break, but I will be back!) 00:00 Introduction and series recap 01:07 Why distill a reasoning model? 02:51 Soft vs. hard distillation 11:06 On-policy vs. off-policy distillation 18:09 Preparing data for reasoning distillation 22:35 Loading the DeepSeek R1 MATH dataset 28:04 Inspecting reasoning traces and final answers 31:27 Tokenization and chat templates 35:58 Pre-tokenizing the training dataset 39:01 Sequence lengths and the 2,048-token limit 42:38 Creating training and validation splits 45:32 Loading the Qwen3-0.6B base model 46:24 Computing answer-token log probabilities 54:10 Cross-entropy loss for distillation 57:25 Training and validation loss helpers 1:02:03 Implementing the distillation training loop 1:07:26 Running the standalone training script 1:09:41 Plotting training and validation losses 1:11:31 Evaluating checkpoints on MATH-500 1:14:09 Comparing teachers and distillation results 1:16:34 Future directions for reasoning models 1:19:41 Bonus exercises and next steps
65
89
4
790
34,651
Dmitry Noranovich retweeted
I'm offering my first course in Machine Learning! We'll cover the basics, like linear regression, and get all the way to neural networks. It's limited to 100 people though - so sign up while you can! BAM!!! live.statquest.org/statquest…
1
7
43
3,324
Dmitry Noranovich retweeted
Ready to start building with Muse Spark Open? Read the dev blog for details on the model, how to access and how to build: bit.ly/4hZOUrE
Today, we’re releasing the weights for Muse Spark Open, giving developers more control over how they run, customize and deploy the model. (1/5)
12
9
1
132
10,945
Dmitry Noranovich retweeted
Design directly with your agents. ⚡️💻 With the Stitch CLI, you can bring Stitch into your local development workflow. Watch it in action: 1️⃣ Connect your local coding agent via CLI 2️⃣ Generate UI screens directly from your codebase 3️⃣ Iterate on the visual design inside Stitch 4️⃣ Sync the changes straight back into your code Check out the demo and instructions below! 👇
12
46
3
358
18,779
Dmitry Noranovich retweeted
Google for Developers
@googledevsOct 13
📣 Gemini 4 Argon is here! Built to solve your hardest problems, Argon excels at real-world software engineering, enterprise workflows, cybersecurity defense, and scientific reasoning. By reliably handling routine tasks like everyday debugging to complex problems like codebase migrations, it frees developers to focus on architecture and product innovation. See what you can build with Argon ↓
74
308
60
2,297
234,971
Dmitry Noranovich retweeted
Gemini 4 Argon is here! It is our frontier model built for complex workflows across real-world software engineering, tested across Google's own codebases on real production challenges. There, we have seen an improvement in both developer velocity, with a 35% increase in agentic code, and code quality, with a 30% decrease in post-submit rollbacks. Rolling out now to Google AI Ultra subscribers, try it in the Antigravity app and the Antigravity CLI. Get inspired with what you can build today ↓
559
1,013
320
9,999
23,000,167
Dmitry Noranovich retweeted
Count actuators in real‑time with Ultralytics YOLO26! ⚙️ Automate component tracking on assembly lines, reduce manual counting errors, and instantly detect bottlenecks. Improve throughput and cut downtime. Read more ➡️ ultralytics.com/solutions/co… #Industry40 #AI #ComputerVision
10
9
1
102
4,165
Dmitry Noranovich retweeted
You don’t need a GPU cluster to learn how modern LLMs work. In this course, you’ll build, pre-train, and fine-tune a 25M parameter language model from scratch on a standard CPU. You’ll learn about modern LLM architecture, reinforcement learning, and how AI researchers experiment. freecodecamp.org/news/build-…
11
112
1
753
36,006
Dmitry Noranovich retweeted
Sebastian Raschka
@rasbtOct 10
Reasoning From Scratch: Reinforcement Learning with Verifiable Rewards (RLVR) round 2. Covering clipped policy ratios, KL loss term, format rewards, and other GRPO tips & tricks. 00:00 Introduction and recap 01:52 Interpreting basic GRPO training metrics 06:34 Planned improvements to GRPO 08:58 Running longer training jobs with Python scripts 13:39 Running the baseline GRPO training script 17:29 Loading and plotting training logs 19:29 Diagnosing unstable training 23:55 Evaluating checkpoints on MATH-500 26:26 Downloading existing checkpoints 30:09 Tracking advantage statistics 34:53 Understanding entropy 40:32 Computing entropy in PyTorch 44:17 Interpreting entropy values 48:58 Adding entropy tracking to GRPO 53:36 Analyzing advantage and entropy metrics 56:18 Stabilizing GRPO with clipped policy ratios 1:03:27 Implementing the clipped policy loss 1:09:39 Analyzing clipped policy training results 1:11:25 KL divergence and reward hacking 1:15:12 Adding a KL loss term 1:20:34 Limitations of the simplified KL loss 1:23:04 Format rewards and think tags 1:25:47 Adding special tokens to the tokenizer 1:30:29 Implementing the format reward 1:35:56 Analyzing format reward training 1:38:25 Rewarding format only for correct answers 1:40:48 Further GRPO improvements from research 1:45:43 Next steps and distillation
80
138
4
1,246
57,369
Dmitry Noranovich retweeted
Haiku 5.5 is now available in the Claude Platform and Claude Code. On average, it costs around 75% less to run than Haiku 4.5. It pairs well with Opus 5.5 or Sonnet 5.5 as a subagent. Use it for high-volume, cost-sensitive tasks like summaries, compactions, or database queries.
Claude
@claudeaiOct 7
Introducing Claude Haiku 5.5: the cheapest, fastest, and most capable small model we’ve ever released. On average, it costs around 75% less to run than Claude Haiku 4.5.
310
791
246
13,065
1,259,543
Dmitry Noranovich retweeted
Monthly API credits are now available on Max and Team plans: $100 on Max 5x, $200 on Max 20x, and up to $500 pooled on Team. Use them on any Claude model. How it works and full terms: support.claude.com/en/articl…
Replying to @ClaudeDevs
We’re rolling out monthly Claude Platform API credits for Max and Team plans: Max 5x: $100 Max 20x: $200 Team: up to $500, pooled Works on any model, including Haiku 5.5, in your code or third-party harnesses. How it works and full terms: support.claude.com/en/articl…
225
306
162
6,673
729,873
Dmitry Noranovich retweeted
Claude
@claudeaiOct 8
Claude Dashboards and Claude Motion are in beta today. Ask Claude to turn your data into live dashboards and your ideas into animated explainers.
1,234
4,601
2,608
60,532
11,398,582
Dmitry Noranovich retweeted
Take this course to learn to design hierarchical agent trees and deterministic workflow agents while identifying the ideal hosting environment to ensure your AI agents are secure, scalable, and production-ready → goo.gle/4hudimz
12
53
1
258
27,868
Dmitry Noranovich retweeted
clem 🤗
@ClementDelangueOct 5
We turned Claude Code, Codex, Hermes, Pi, @opencode and other coding harnesses into RL environments. No changes to the harnesses, no changes to the training code. Any open model, any task set, fully open source my friends! Same model, same weights: 62% under Mini-SWE-Agent, 33% under Claude Code. But training inside a real harness normally means reimplementing it as an environment, so most models get trained in a scaffold nobody actually ships. The fix is a proxy, not a rewrite. The harness thinks it's talking to a model API. It's actually talking to a capture proxy that speaks the 4 formats coding agents use (OpenAI Chat Completions, OpenAI Responses, Anthropic Messages, Gemini), forwards to @vllm_project, records the exact token IDs and logprobs vLLM sampled, and hands TRL sequences it can train on. The harness becomes the environment. 10 harnesses run through it today, none modified. And because you control the reward, you can shape behavior the harness never asked for. We added a small bonus for solving a task in fewer tool calls: on tasks it already solved, the model now uses 31% fewer calls, in every harness, and about half under Codex. Tested on LFM2.5-2.6B from @liquidai: → Train in one harness: better mostly in that harness (OpenCode 34% → 58%). → Train in 4 at once: better in all 4 (42% → 54%). → SFT on 3,189 rollouts from Qwen3.8-27B instead: plateaus at 47.5%, below both RL runs. Everything is open and reproducible: the capture proxy in OpenEnv, the trainer in TRL, the tasks, the SFT data, the training code and all 7 trained models. Bigger models and bigger runs next. Full guide: huggingface.co/spaces/FineEn…
231
323
66
2,688
164,663