founder @supernormal ($125m+ sales) @inkai_x ex tech lead @coinbase ex ai/eng @microsoft @linkedin @snapchat @ibm @blackberry investor @spacex

ce@uwaterloo (entrance rank 1)
Joined June 2011
andrew | ai engineering retweeted
People keep saying 2026 will be the year of continual learning. But there are still major technical challenges to making it a reality. Today we take the next step towards that goal — a new on-policy learning algorithm, suitable for continual learning! (1/n)
51
223
33
1,522
243,402
andrew | ai engineering retweeted
GPT-5.2 solves our COLT 2022 open problem: “Running Time Complexity of Accelerated L1-Regularized PageRank” using a standard accelerated gradient algorithm and a complementarity margin assumption. Link to the open problem: proceedings.mlr.press/v178/o… All proofs were generated by GPT-5.2 Pro. The key bounds on the algorithm’s total work (in the COLT’22 open-problem setting) have been auto-formalized using a combination of GPT-5.2 Pro, @HarmonicMath's Aristotle, and Gemini 3 Pro (High) on Antigravity. Link to the proof: github.com/kfoynt/accelerate… Link to the Lean code: github.com/kfoynt/accelerate… Link to the informalization of the Lean code: github.com/kfoynt/accelerate… Link to my GPT-5.2 prompts: chatgpt.com/share/693e3ce6-2… In addition to the formalization of the main result, I checked the proof myself twice. I hope I didn’t miss anything, but if I did, please let me know and I will try to fix it. Story behind the paper and relevant work In 2016, I worked on the convergence rate of the Iterative Soft-Thresholding Algorithm (ISTA) for l1-regularized PageRank. Link to the corresponding paper: link.springer.com/article/10… Surprisingly, the running time of the algorithm depends only on the number of non-zero nodes at optimality. It was only natural to ask the same question for accelerated methods, such as FISTA. However, we quickly realized that FISTA activates more nodes than the number of non-zeros at optimality, even though it eventually converges to the same active set. In practice, we would still observe that FISTA is fast. Link to empirical work: uwspace.uwaterloo.ca/items/6… I tried for about three months to bound the total work of FISTA and other accelerated algorithms, and from time to time I would come back to the problem while I was a postdoctoral fellow. Eventually, I gave up. I gave it another try around 2021, and I failed again. I asked my excellent former student, Shenghao Yang, and he also failed, unfortunately. I asked a couple of prominent researchers if they think the problem is solvable, they quickly mentioned that it seemed hard. We ended up publishing it as an open problem at COLT 2022. In 2023, David Martínez-Rubio et al. provided the first successful solution. Their solution is “orthogonal” to what was proved by GPT-5.2. Link to their paper: proceedings.mlr.press/v195/m… I loved their work btw, I also met David in person at ICML 2024, one of the few ML conferences I ever attended. Their proposed accelerated algorithm is not necessarily faster than ISTA; however, it does offer a new trade-off between the teleportation parameter of PageRank and the total work per iteration. More importantly, the proposed method isn’t necessarily practical, since it involves solving an expensive subproblem. To be fair, in the COLT 2022 problem, we didn’t impose the additional hard constraint of using standard accelerated methods. The problem was posed as a theoretical problem. The solution proved by GPT-5.2 establishes acceleration for the standard FISTA algorithm, which performs only one gradient computation per iteration. It also offers a clean parameterization of the total work with respect to a complementarity margin, which, for certain graph structures, shows a clear speed-up compared to ISTA. In 2024, Zhou et al. (dl.acm.org/doi/10.5555/37379…) gave it another go. However, in my view, their work has important drawbacks. In particular, their guarantees for accelerated localized methods (e.g., localized Chebyshev / Heavy-Ball) assume a condition on the geometric mean of certain active-ratio factors (described as Θ(\sqrt{α})) in order to obtain an accelerated bound. Two distinctions matter for our setting: First, their accelerated runtime bounds are parameterized by evolving-set quantities and a residual-ratio assumption, which can be evaluated during a run but is not typically interpretable or verifiable a priori from graph structure alone. The solution by GPT-5.2 instead provides an explicit transient-phase bound in terms of a standard optimization-structure condition, and converts this directly into a total work bound. Second, they explicitly note that FISTA-style acceleration violates the monotonicity property needed to bound the per-iteration accessed volume, and emphasize that guaranteeing intermediate sparsity in accelerated frameworks is challenging. The margin-based analysis by GPT-5.2 directly targets this gap: even without any monotonicity of intermediate supports, GPT-5.2 bounded how much spurious activation can occur before the iterates enter a neighborhood of the unique minimizer, thereby yielding a concrete locality certificate for the accelerated proximal-gradient trajectory. Since 2024, every time OpenAI or Google released a new major model, I would give it a go. This time, with GPT-5.2, it seems to have worked.
15
116
34
672
172,598
andrew | ai engineering retweeted
o3 is out and it is absolutely amazing!! i've been playing with it for a week or so and it's already my go-to model. it's fast, agentic, extremely smart, and has great vibes. some of my top use cases: - it flagged every single time I sidestepped conflict in my meeting transcripts - it spun up a bite‑size ML course that it pings me about every morning - it found a stroller brand from one blurry photo - it coded a new custom AI benchmark in record time - X‑rayed an Annie Dillard classic and found writing tricks I’d never noticed before - it even analyzed @every’s org chart to tell me what we’ll be good at shipping, and what our weaknesses are my full review is on @every now!
67
144
37
1,533
516,934
andrew | ai engineering retweeted
Fixed the SWE-Bench chart and added Claude to it
What am i even looking at man? 69.1 = 30.8? What is the y axis?
60
107
36
2,074
381,894
andrew | ai engineering retweeted
Cool demo of a GUI for LLMs! Obviously it has a bit silly feel of a “horseless carriage” in that it exactly replicates conventional UI in the new paradigm, but the high level idea is to generate a completely ephemeral UI on demand depending on the specific task at hand.
Google DeepMind
@GoogleDeepMind19 Jun 2025
Here's how Gemini 2.5 Flash-Lite writes the code for a UI and its contents based solely on the context of what appears in the previous screen - all in the time it takes to click a button. 💻 ↓
161
473
50
4,872
560,963
andrew | ai engineering retweeted
The single most undervalued fact of linear algebra: matrices are graphs, and graphs are matrices. Encoding matrices as graphs is a cheat code, making complex behavior simple to study. Let me show you how!
113
1,144
113
11,111
1,016,890
andrew | ai engineering retweeted
We’ve been cooking... a new open weights 14B Phi-4 reasoning model, SFT’d on ~1.4M carefully curated reasoning demonstrations from o3-mini and RL’d for a tiny bit. This model is a little beast.
35
230
47
1,426
440,825
andrew | ai engineering retweeted
New paper - Transformers, but without normalization layers (1/n)
76
568
103
4,019
1,308,899
andrew | ai engineering retweeted
CPU vs FPGA
13
209
8
1,368
75,922
andrew | ai engineering retweeted
what an absolute banger of 500 pages CUDA C++ programming guide by nvidia
13
214
7
2,927
156,101
andrew | ai engineering retweeted
Scalar, Vector, Matrix, and Higher-Order Tensors...
40
362
13
3,355
173,402
andrew | ai engineering retweeted
From quitting Microsoft and Coinbase to founding Korea's #1 NFT collection. Here's how @andrewai did it:
9
111
2
77
6,104
andrew | ai engineering retweeted
Bringing SuperNormal Origins to life with AI. #myAIZIPS @Vajrabond
3
9
1
28
6,289
andrew | ai engineering retweeted
Thank you @SuperNormal and @KyuYongEom for the awesome airdrops. You guys know I love me some beautiful art especially if it is waifus! 😊❤️
1
6
34
1,293
andrew | ai engineering retweeted
SuperNormal x Bugatti Group partnership We are thrilled to announce our groundbreaking partnership with the prestigious Bugatti Group, a renowned name in the world of luxury and innovation. Cop your SuperNormal flavored luggage here: store.bugatticollectionsnft.… @bugattigrp
13
38
3
93
7,827
andrew | ai engineering retweeted
SuperNormal Sunday! @SuperNormal #Supernormal Ps. Forgot why did I have this Husbando right click + Saved in my folder 🤣🤣🤣
1
11
26
1,075
andrew | ai engineering retweeted
SuperNormal Sunday! 개불 입에 넣고 씹기 직전. #supernormal
2
13
40
2,087
andrew | ai engineering retweeted
#SuperNormal Sunday💛🍯
8
16
122
6,006
andrew | ai engineering retweeted
Happy @SuperNormal Sunday!
10
14
71
3,107
andrew | ai engineering retweeted
Happy @SuperNormal #SNday! 🍯 Wanted to give a shoutout to one of the core communities that brought me into web3 Looking forward for our community led spaces soon 👀
1
7
21
1,225