Building voice AI and smart glasses @sesame | PhD in AI/ML | Prev founder @fulltrackai (4m users) | YC W25
Seattle WA
Joined March 2011
- Tweets275
- Following474
- Followers1.3K
- Likes449
Pinned Tweet
Overdue life update: I recently joined @sesame where I lead AI safety for the real-time conversational systems!
Smart glasses + voice is the future. After trying Sesame’s upcoming glasses, I was blown away. It’s also the most realistic conversational AI I’ve seen.
Real-time voice AI introduces entirely new safety problems and I'm glad to be focused on making our AI safe and aligned.
We're hiring like crazy, so if you're interested in conversational voice systems or safety research then reach out!
Been following the Nuance team for over a year now and super excited to see what they’ve built! Real time interactive AI is the future.
We’re excited to share that @nuance_ai has raised a $50M Series A led by @lightspeedvp, joined by @Accel, @spc, @nvidia, and @definevc!
Much of human communication happens beyond words. Before we can speak, we learn to read faces, return smiles, follow gestures, and sense when someone is listening. That visual and emotional vocabulary stays with us for life.
At Nuance Labs, we’re building a foundation model that understands and responds to the full spectrum of human emotion. A single full-duplex audio-visual model that sees, listens, and responds in real time, with the natural give-and-take of a conversation with a friend or colleague.
We believe the best interface with a machine is the one we’ve practiced since birth.
Join us!
Vivek Jayaram retweeted
Exclusive look at company building the future of sports and concerts.
I saw the demo after the interview but @drSJayJayaram gives you a taste about 25 minutes in. Founder/CEO of quintar.ai
Now that I have seen the future of sports and concerts I am even more bullish about the future of AI Glasses.
Jay sold his previous company to Intel.
He goes into what is coming a couple of weeks from now.
It reaffirms my belief that glasses are about to go insane for sports fans.
Also joined by his investor: @JulianGill2
Vivek Jayaram retweeted
Are you a cracked software engineer? Is your mom worried about your career prospects?
I spend a lot of time explaining our business model to my friends in engineering. M&A lets us own the outcome in a way that pure software doesn't.
@ModusAudit is cohosting an intimate discussion with @CommaCapital about how AI Rollup's are the single best business model in tech today
It's invite only, but we're leaving a few spots open for exceptional people we haven't met yet.
If you know someone who should be included tag them below. If you want to attend yourself, DM me a short note about why you should be invited.
Excited to share what I've been working on for the last several months. We've built the most realistic conversational AI agents at Sesame. Give it a try!
A collection of personal agents, crafted for everyday conversation.
Preview available now on iOS.
apps.apple.com/us/app/sesame…
Awesome new work from Maruchi! Future earbuds will have cameras. AirPods already rumored to be working on it. Low energy, on-device VLMs are the future for privacy preserving devices that people will actually wear.
what if your earbuds could see?
meet VueBuds: tiny cameras at each ear, streaming low-resolution images over Bluetooth, with an on-device vision language model to understand what's around you.
capstone of my PhD 🎓 #CHI2026 honorable mention
Hearing that another prominent startup is about to get “Windsurfed” in the coming days.
Leadership and research joining a lab, everyone else told to fuck off, despite tons of money in the bank.
We need a new startup contract, where everyone is in it together. One of the reasons I joined sesame is that everyone is in it for the long haul.
Moondream moving from Seattle → SF is a bummer, but also not surprising.
Seattle startups still feel like hard mode compared to SF, especially at the zero-to-one stage.
Maybe CA’s asset tax finally shifts things? Or wishful thinking?
This quoted post is unavailable.
🚀 New paper we just published at SIGGRAPH Asia!
Introducing UltraZoom, capable of 25x super-resolution while preserving true high-resolution object details.
This means no hallucinations of the underlying object texture. We accomplish this via a single additional guiding close-up image.
Work led by @JingweiMa2 and collaboration with @kemelmi, Brian Curless, and Steve Seitz.
Paper: arxiv.org/abs/2506.13756
Webpage (Interactive Demo):
ultra-zoom.github.io
Vivek Jayaram retweeted
Excited to present UltraZoom at SIGGRAPH Asia next Tuesday (Dec.16)!
UltraZoom converts sparse phone captures of an object into a single gigapixel-resolution image that you can seamlessly explore. Threads below.
Website: ultra-zoom.github.io
Paper: arxiv.org/abs/2506.13756
Had an awesome time presenting CDIM at Neurips!
Yes the conference has become massive, but that means even more people come by and engage with your work.
Excited to share that I'll be at @NeurIPSConf presenting our paper: Linearly Constrained Diffusion Implicit Models!
We use diffusion models to solve inverse problems like inpainting and colorization
10-50x faster than other methods and with exact satisfaction of constraints 🧵
1/3 Exact recovery of constraints means that inpainting doesn't change observed pixels, and colorized results project back to the exact grayscale input.
This is important for reducing hallucinations in image generation, which you might get with Nano Banana or other methods.
2/3
Project Page: grail.cs.washington.edu/proj…
Paper: arxiv.org/abs/2411.00359
Demo: huggingface.co/spaces/vivjay…
Neurips Poster: neurips.cc/virtual/2025/loc/…
Joint work with @jwthickstun @kemelmi and Steve Seitz
You can’t reduce something by 156%. You know we’re peak bubble when a launch video doesn’t even follow basic math sense.
(Unless the model has negative sycophancy which is even more worrying).
This quoted post is unavailable.
Jeff Bezos and I have the same phone. He can’t buy a better one than me.
The same as going to happen to every other aspect of the lives across normal people and billionaires.
if ai drives true hyperdeflation, then most current power law outcomes start to collapse rapidly into a compressed distribution where billionaires & average folks converge in lived experience.
private jets lose their edge if autonomous supersonic ridesharing exists, exclusive education vanishes if every tutor is gpt-x, hedge fund alpha dissolves if everyone has real time strategy agents, etc.
this would be an incredibly fascinating human / societal experiment.