teapawtteapawt
Desh Raj
@rdesh26

Speech + LLMs @nvidia | Previously: @Meta MSL, @jhuclsp, @IITGuwahati

New York, NY
desh2608.github.io
Joined September 2009
  • Tweets2.4K
  • Following2.2K
  • Followers4.6K
  • Likes8.6K
187Media
  • Tweets
  • Tweets & Replies
  • Reposts
  • Articles
  • Media
  • Search
Desh Raj
@rdesh26May 14

There is no such thing as a true full-duplex model.

Full-duplex/realtime/interaction models have suddenly become popular due to TML's demos. I thought it would be a good idea to create a (visual) primer on what these models are.

Article · @rdesh26
8
17
3
131
14,606
Desh Raj
@rdesh26May 12

Initial thoughts about TML's new "interaction model"

1/ It's a 276B-A12B MoE, and they "plan to release larger models" later this year. The post already talks about the complexities of frequent prefills and decodes required for 200ms chunks. As these mo…

Article · @rdesh26
6
17
5
171
36,798
Desh Raj
@rdesh26Apr 3

The audio encoder in Gemma-4

Google released several variants of Gemma-4 under an Apache 2.0 license yesterday. Of these, the smaller "edge" models (E2B, E4B, and their instruction-tuned variants) come with audio encoders. I was …

Article · @rdesh26
2
18
1
134
15,439
Desh Raj
@rdesh26Mar 26

lessons from cohere transcribe

since ASR is suddenly cool again due to @cohere Transcribe, let's talk about what lessons are illustrated from its model design.

Article · @rdesh26
1
4
1
40
5,270
Load more