Mark Hoffmann (@markkhoffmann) header
Mark Hoffmann (@markkhoffmann) profile picture

Staff ML Engineer @Meta Harness Engineering prev. Ads Core ML | Previously - Chief Architect at Ubiety, ML @NASAJPL @DARPA - neural networks and systems

Palo Alto, CA
Joined July 2011
Photo by Mark Hoffmann (@markkhoffmann)Photo by Mark Hoffmann (@markkhoffmann)Photo by Mark Hoffmann (@markkhoffmann)Photo by Mark Hoffmann (@markkhoffmann)Photo by Mark Hoffmann (@markkhoffmann)Photo by Mark Hoffmann (@markkhoffmann)Photo by Mark Hoffmann (@markkhoffmann)Photo by Mark Hoffmann (@markkhoffmann)
Mark Hoffmann retweeted
1/ today we're releasing muse spark, the first model from MSL. nine months ago we rebuilt our ai stack from scratch. new infrastructure, new architecture, new data pipelines. muse spark is the result of that work, and now it powers meta ai. 🧵
740
1,171
842
10,268
4,651,065
Mark Hoffmann retweeted
How Axios was compromised 🤯
148
839
292
6,788
1,590,643
Mark Hoffmann retweeted
How AI empowered Paul Conyngham to create a custom mRNA vaccine to cure his dog’s cancer when she had only months to live. The first personalized cancer vaccine designed for a dog:
294
726
237
6,335
1,162,721
Mark Hoffmann retweeted
I've been working on a new LLM inference algorithm. It's called Speculative Speculative Decoding (SSD) and it's up to 2x faster than the strongest inference engines in the world. Collab w/ @tri_dao @avnermay. Details in thread.
138
445
103
4,000
619,554
Mark Hoffmann retweeted
WTF is going on at Qwen?!? Some kind of implosion? This is really sad and worrying. They've been *such* a strong team, and are losing some of their very best researchers.
bye qwen, me too.
61
41
3
1,262
270,062
Mark Hoffmann retweeted
Gradient descent can write code better than you. I'm sorry.
380
1,705
566
15,513
Just got access to Veo 3 and the first thing I did was try the Will Smith spaghetti test. SOUND ON
1,298
1,274
2,295
25,974
26,124,968
Mark Hoffmann retweeted
Two years of AI progress
397
1,740
410
14,890
2,569,571
Mark Hoffmann retweeted
You can now run Llama 4 on your local device!🦙 We shrank Maverick (402B) from 400GB to 122GB (-70%). Scout: 115GB to 33.8GB (-75%) Our Dynamic 1.78bit GGUFs ensures optimal accuracy by selectively quantizing layers GGUFs: huggingface.co/collections/u… Guide: docs.unsloth.ai/basics/tutor…
35
120
22
789
141,746
Mark Hoffmann retweeted
How Libra Was Killed. I never shared this publicly before, but since @pmarca opened the floodgates on @joerogan’s pod, it feels appropriate to shed more light on this. As a reminder, Libra (then Diem) was an advanced, high-performance, payments-centric blockchain paired with a stablecoin that we built with my team at @Meta. It would’ve solved global payments at scale. Prior to announcing the project, we spent months briefing key regulators in DC and abroad. We then announced the project in June 2019 alongside 28 companies. Two weeks later, I was called to testify in front of both the Senate Banking Committee and the House Financial Services Committee, which was the starting point of two years of nonstop work and changes to appease lawmakers and regulators. By spring of 2021 (yes they slow played us at every step), we had addressed every last possible regulatory concern across financial crime, money laundering, consumer protection, reserve management, buffers, and so much more, and we were ready to launch. We had worked on a slow rollout of a limited pilot that some members of the Fed’s Board of Governors were supportive of. At last, Chair Jay Powell was ready to let us move forward in a limited way. The story, as I heard it, is that Jay Powell was told by Treasury Secretary Janet Yellen at one of their biweekly meetings that allowing this project to move forward was “political suicide,” and she would not have his back if he let it happen. I wasn’t in the room when this conversation happened, so take these words with a grain of salt, but effectively this was the moment Libra was killed. Shortly thereafter, the Fed organized calls with all the participating banks, and the Fed’s general counsel read a prepared statement to each of them, saying: “We can’t stop you from moving forward and launching, but we are not comfortable with you doing so.” And just like that, it was over. One essential point is worth making here. There was no legal or regulatory angle left for the government or regulators to kill the project. It was 100% a political kill—one that was executed through intimidation of captive banking institutions. That was the hardest part of this story for me personally. Not that we had failed, but that America, this country I immigrated to and became a proud citizen of because of its rule of law and value system, behaved in such a way for political reasons. It was a very tough pill to swallow. The bright side of the story, though, was the many learnings from this wild ride. By the end of the project, we had made so many concessions to get a thumbs-up that the whole design of the network became a Frankenstein of our initial ambitions. We also learned the biggest lesson of all, which is that if you’re trying to build an open money grid for the world—eventually moving trillions of dollars a day, designed to be here 100 years from now—you have to build it on the most neutral, decentralized, unassailable network and asset, which, hands down, is Bitcoin. And now this is what many of us who went through this scarring journey are building together at @Lightspark. And this time, we won’t stop until we get it done!
1,210
3,892
1,214
21,242
5,350,679
Overheard in Silicon Valley: "The transition from the Jobs Way to the Musk Way in US startup culture is fascinating to watch. The founders are switching from artistic UI hippies to weightlifter hard executors."
582
919
262
11,912
1,219,888
Mark Hoffmann retweeted
We just unveiled Orion, our full AR glasses prototype that we’ve been working on for nearly a decade. When we started on this journey, our teams predicted that we had a 10% chance (at best) of success. This was our project to see if our dream AR glasses—wide FOV display, less than 100 grams, wireless—were actually possible to build. Not only do they work, we’ll be using them internally as a time machine to help build the core experiences and interaction paradigms needed for the consumer AR glasses we plan to launch in the coming years. TL;DR: We built it, just like we said we would =)
185
474
177
5,431
989,200
Mark Hoffmann retweeted
‼️ La Baye Aréa, French TV Series - Opening credits ‼️ #aivideo #gen3 #midjourney #udio #capcut #parody
149
420
173
2,244
274,835
Mark Hoffmann retweeted
Rewrite it in Rust is now an official DARPA program :).
16
150
21
865
86,225
Mark Hoffmann retweeted
I'd build this opensource in public if this post gets enough interest and possibly some funds / grants. Been obsessing over this for quiet some time. Already built an animatronics workflow and reinforcement learning with motion priors.
This might be my new favorite paper - I've been kind of obsessed with these robots since seeing them at the Robotics Summit earlier this summer la.disneyresearch.com/public…
16
88
2
813
56,519
Mark Hoffmann retweeted
More technical details on the new Llama 3.1 models we released today. 🦙🧵
27
179
22
1,742
162,665
Mark Hoffmann retweeted
💥BOOM 💥 Llama 3.1 is out 💥 405B, 70B, 8B versions. Main takeaways: 1. 405B performance is on par with the best closed models. 2. Open/free weights and code, with a license that enables fine-tuning, distillation into other models, and deployment anywhere. 3. 128k context length, multi-lingual abilities, good code generation performance, complex reasoning abilities, tool use. 4. Llama Stack API for easy integration. 5. Ecosystem with over 25 partners, including AWS, NVIDIA, Databricks, Groq, Dell, Azure, and Google Cloud. Blog post: ai.meta.com/blog/meta-llama-… Llama home: llama.meta.com/
With today’s launch of our Llama 3.1 collection of models we’re making history with the largest and most capable open source AI model ever released. 128K context length, multilingual support, and new safety tools. Download 405B and our improved 8B & 70B here. llama.meta.com
219
900
117
6,038
740,562