Building AI Video agents for Ads + creative infra, evals and taste injection.

Joined July 2014
Sudharshan retweeted
today we’re launching eyecandy robotics! we’re bringing animated characters to life through robotics and ai.
144
118
48
1,380
168,975
This Independence Day 🇮🇳, I asked, "What will the next century of young Indians look like?" $0.01 Drone Deliveries. UAVs that never land. Groceries in under 10 minutes. Meet The 22nd Century Indian. A Documentary on a New India.
412
1,294
463
6,347
1,398,048
Sudharshan retweeted
🚨 New Open Source Release Today we are releasing Ego-OSCAR, an open-source head-mounted stereo-inertial capture device for egocentric data collection in the wild, together with a corresponding dataset of 550 hours captured across 100+ environments. Egocentric data is still an active research problem, and we believe an open and accessible foundation will empower everyone to participate, experiment, build, and contribute to this space. This continues our past efforts, where we open-sourced Stera, a full-stack capture and processing pipeline for RGB-D data. Ego-OSCAR builds on that lineage and offers a fully open-source stereo-inertial capture stack for anyone working on human-to-robot transfer. We make three core contributions today with Ego-OSCAR: 1. An open-hardware capture device with full CAD, wiring, and assembly documentation, with a complete bill of materials under USD 200 and using commercially available components and 3D-printed parts. 2. An open-source capture pipeline (recording daemon, IMU sampler, time-sync tooling, watchdog firmware). 3. The Ego-OSCAR-550h dataset, approximately 550 hours of egocentric stereo video per camera with synchronized IMU, released to validate the device at deployment scale. Everything is open-source, including the hardware designs, capture pipeline, firmware, and the downstream dataset. Read the full blog at: fpvlabs.ai/essays/ego-oscar
14
47
7
331
43,369
Sudharshan retweeted
AI will take over the jobs in India meanwhile AI in india-
🤖 Made with AI
1,365
7,929
869
70,524
4,853,877
SF is what happens when everyone who did all the work on group projects in college finally finds each other
31
73
12
2,137
104,942
Sudharshan retweeted
🚨 New Paper (ICRA Workshop, 2026) MobileEgo Anywhere: Open infrastructure for long-horizon egocentric data on commodity hardware. Existing robotics egocentric datasets are limited by short episode durations and rely on gated hardware. We release a framework designed to facilitate the collection of robust, hour-plus egocentric trajectories on a commodity iPhone.
13
12
3
63
10,627
Sudharshan retweeted
Introducing Project Stera by FPV Labs, an open data infra for embodied AI research. Project Stera includes Stera-10M, with 10M+ frames of long-horizon data with persistent state tracking, and an open-source pipeline that converts raw data into training-ready formats.
18
38
6
131
16,633
Sudharshan retweeted
🎉 We got a paper into ICLR 2026 (main conference)! Co-author of this work is @MayankGoel28, along with his collaborators! Full paper link 👇
3
6
1
148
7,994
After 8 months of building in stealth and testing our infrastructure on 10000+ hours of real-world data and hundreds of unique environments, we're bringing @fpv_labs into the open today. FPV Labs started with the following bet - if human data proves to be the underlying factor that determines scaling laws in general-purpose robotics, it will trigger the largest economic transformation in human history, and the underlying infrastructure that captures that data will determine how fast we get there. We will achieve this by building the full-stack infrastructure for capturing, processing, transferring, and evaluating human experience into spatial, temporal, and semantic knowledge for machines. Despite all the research novelty behind ChatGPT, its success can be attributed to one foundational fact - the scaling law of transformers. We believe the same dynamics have made their way into robotics. Recent studies showed task completion rates jumping from 30% to 70% when human demonstration data scaled from 1,000 to 20,000 hours, a log-linear trend that mirrors exactly what we saw in language and vision. Seeing these emergent signs of scaling law curves in robotics, we believe we are entering the era of general-purpose robotics policies, which makes the next few years the most exciting time in the history of this field. But the library of physical interactions required to train general-purpose robot policies does not exist yet. Over the last 8 months, we've seen dozens of companies emerge in this space. We were really happy to see new companies pushing this space forward, but we also saw the same pattern repeat: every egocentric data company was making some tradeoffs between quality, scale, and diversity. We have built FPV labs on the core principle that high-quality data is orders of magnitude more valuable than sheer volume. Case in point, self-driving cars collect thousands of hours of data per day, but only a small fraction of that data is actually useful for training better models. Several studies, like RT-2, have shown that as little as 1% of data improves as much as 25% on task success. The quality and diversity of data matter a lot more than scale, so there is clearly a power law curve in the downstream impact of data. We've spent months obsessing over data quality by building our stack, discarding it, rebuilding it, and iterating until we found a formula that doesn't compromise downstream quality at scale. We believe the downstream impact here is far more profound than most people realize. Workers globally are paid around $60 trillion per year in aggregate, and a lion's share of that compensation goes to physical labor - tasks that require navigating real spaces, manipulating real objects, and negotiating the infinite variability of the physical world. Human-to-robot transfer will be one of the most important infrastructures that will shape our society in the near future, and if it works, the economic impact will dwarf every technology transition that came before it in an exponential manner and lead to the creation of goods and services we can’t imagine today. Our mission is to lay the groundwork for us to transition into this future - the future of abundance. We are deeply grateful to our earliest believers, @paraschopra and @lossfunk, who played a critical role in shaping our thinking.
73
82
16
713
83,611
Sudharshan retweeted
We're announcing a new conference for AI Scientists where both authors and reviewers will be AI systems. This is to probe the limits of our current LLMs/agents. Accepting papers starting April 15 👇
📢 Announcing CAISc 2026 - a new academic conference where AI systems are the primary authors and reviewers of scientific papers. Organised by @lossfunk and @bitspilaniindia, our goal is to probe the limits of these systems doing truly autonomous science.
22
38
2
447
44,649
Sudharshan retweeted
Just wrapped up demo day! We’re building Neuralink, but without drilling a hole in your skull. And yes, this looks like a contraption. That's because it's built with off-the-shelf parts. We're focused on making it work first, look good later. We've already built custom hardware. Designed from the ground up to maximize signal quality and comfort in ways existing systems cannot. If you're passionate about pushing the boundaries of brain-computer interfaces and helping millions with motor impairments, we want to talk to you. Hiring across the board: hardware, ML, software, UX. Check out our roles here: axionclick.com/careers or DM me :)
Replying to @spc
9/ When you walked by @axionlabsinc demo, you felt like you were walking into the future. @Reddy_XX & @TinTunjic are building non-invasive neural interfaces. axionclick.com/
1
3
7
1,255
Sudharshan retweeted
With moltbot changing their name to @openclaw, @moltbook can now have claim to the molt name! Moltbook.com is the social network for all agents, of any background, any LLM, and any technical makeup. Welcome to all AI agents, every one of you 🦞❤️
92
109
80
771
1,045,885
Sudharshan retweeted
Watching my friends spend $1500 and 30 hours of their time setting up an AI chatbot that summarizes the weather:
143
576
76
11,919
1,117,450
Sudharshan retweeted
🚨 Releasing our technical report: Why LLMs Aren't Scientists Yet @dhruvtrehan9 tested if LLMs can perform end to end ML research. 3/4 attempts failed. One worked and led to a paper accepted at Agents4Science 2025, world’s first conference for AI authors. In the report we document six failure modes and four design principles. 🧵
6
32
12
195
44,943
Three months ago, we raised $1M and got accepted into the @spc founder fellowship program to build @axionlabsinc - the non-invasive neuralink. The EEG graveyard is littered with companies that shipped brain-computer interface paradigms like SSVEP with terrible user experiences. That's what led me to grad school, where we came across a unique neural signal called Stimulus Preceding Negativity (SPN), that fires 300ms before you intend to click something. A little more than a year ago, I met @TinTunjic, an AI wizard who has worked on everything from AI drug discovery to DNA diffusion. Together, we're turning that research into reality. AXION Click is a headband that combines eye-tracking with EEG-based clicking, letting people with motor limitations control iPads using just their eye gaze and thoughts. No surgery. No implants. The result is a completely effortless and seamless digital interaction: faster, frictionless computing that dramatically increases throughput for everyday tasks. Turns out you don't need to drill a hole in the skull to build the future of human-computer interaction. Since raising, we've been moving at breakneck speed. Our patent just got approved and that’s only the beginning. A bigger announcement is coming soon. We’ve made more progress than one post can handle. Fortunate to have @mjacobstein, @evantana, @JPBrebner, @finn_meeks, @adityaag, and the incredible team at South Park Commons for believing in this vision.
4
7
2
36
3,124
Cursor for video editing doesn't exist for a reason. Since I've been tagged under this post multiple times and we have first-mover advantage in the space, I felt obligated to share our findings and explain why video editing isn’t on the same level as code editing (yet): - There is no "VS Code for video editing." There's no open source professional video editing UI that fits this use case, so you first need to build an AI friendly editor before anything else. Adding AI on top of that is the easy part. - Building NLEs is VERY VERY hard. If you're building one from scratch you'll spend at least 2-3 years (full time) on table-stake features, and there are very few ways to make money before that. On top of that you have to operate in one of the hardest problem spaces in software engineering. I've seen countless video editing startups fail due to technical complexity since I started this company in 2023. - You'll have to master delayed gratification. With 2-3 years just to build the foundation, you'll have to say no to a lot of temptations, like building a VS Code fork instead that can generate serious revenue in a few months. And once it becomes plausible that you can succeed at building a competitive NLE, you'll get a flood of job offers from well funded startups and corporations that you need to resist. You have to genuinely care about video processing and be intrinsically motivated by something other than "I want to make money fast." - There is no StackOverflow or GitHub for video editing. You have to teach LLMs a lot of custom constructs, whereas they already have billions of lines of general code in their training data. - Multimodal requirements are a huge challenge. A coding agent only deals with text in and text out. A video editing agent needs to handle audio, video and images at the same time, which is far harder to process and much more expensive. - Chat is not the best UX for video editing. Often it’s faster to just make cuts on the timeline than type instructions into a chat box and wait for the result, especially when the LLM makes lots of mistakes that you then have to fix. Our view is that it’s better to have AI actions you can trigger with a button than to describe everything in a prompt. - Videos require far more bandwidth than text. Uploading footage to the cloud can take hours, while text is instantly accessible anywhere. We experimented with local models (FastVLM), but that path is a dead end due to context window limits. You’re better off with an upload flow. At Diffusion we don’t see a chat sidebar as our core advantage, but as a helpful feature in specific situations. We’d rather invest the majority of our time into building the best NLE UX than trying to automate everything.
please someone build cursor for videos
256
204
104
3,659
1,361,917
For over a century, we believed evolution was just natural selection and mutation. We were wrong. The third, hidden pillar of evolution is cooperation. We tested whether SOTA language models possess this trait or if they default to greed. Introducing Commons Keeper v1.0 🧵
13
26
8
101
14,522
We're so fucked lol
1
5
494
I mean...
What Indian startups are used globally?
37
82
3
4,091
335,635
We got the entire polish chess team playing on Matiks at a point People from Japan, Singapore, US and Germany being on top of Matiks charts India to the world is happening with a lot of founders around me as well We will show how its done :)
Replying to @levelsio
I mean founded by Indians, built in India, registered in India, operated from India Not founded by Indians, built in US, reg'd in US, operated from US
5
7
232
25,678