Adam Smith retweeted
OK, say it goes further and we get AI that's broadly superhuman across all domains. How do you invest for this? Does the question even make sense?
Adam Smith retweeted
This is one of the most important results of the year, as exciting as the OpenAI o1 results. We now have two very different, very promising scaling dimensions for test-time compute: TTT and RL. (1/🧵)
Why do we treat train and test times so differently?
Why is one “training” and the other “in-context learning”?
Just take a few gradients during test-time — a simple way to increase test time compute — and get a SoTA in ARC public validation set 61%=avg. human score! @arcprize
Adam Smith retweeted
Seems about right: 3 or maybe 4 orders of magnitude from increasing investment, 1 from Nvidia margin compression, 1 from custom silicon, 1 from Moore's law. So plausibly 6-7 OOMs of headroom in the current sprint, which would last until the early 2030s. (Absent a wildcard on algorithms or perhaps analog hardware)
Given that you need 100x more effective compute between model generations, if we don’t get AGI by GPT-7, will we just never get it?
@_sholtodouglas: “GPT-4 costs, let's call it, $100 million. The $1B, $10B, and $100B run, all seem very plausible by private company standards. You can also imagine even a $1T run being part of a national consortium.
@TrentonBricken: “If you believe GPT-4 is around 1 trillion parameters, the human brain is between 30 and 300 trillion synapses. It seems pretty plausible that we're below brain scale.”
Full episode out Thursday.
Adam Smith retweeted
Why is AI amazing at art, but can't drive a car? Can we predict which new AI applications might arrive soon, and which are still years away? New blog post thinking this through 1/n
Adam Smith retweeted
Great pod. So much startup wisdom (or really, common sense) open.spotify.com/episode/0Pd… – at San Francisco, CA
Adam Smith retweeted
I have been wondering the same thing about TikTok...
Adam Smith retweeted
Strongly agree with @eladgil on AI regulation, most pushing for it either are aiming for regulatory capture or don’t understand how regulation often creates more harm than good.
open.substack.com/pub/eladgi…
Adam Smith retweeted
"NVIDIA's accelerated and AI computing platform perfectly compliments Rescale to advance industrial scientific computing" - Jensen Huang
🙏 Thank you Jensen and @nvidia team for all your support and partnership!
Adam Smith retweeted
If someone asked me to give investing advice to a 30-year-old today who had just made their first million, I would first point them somewhere else. I’m not a financial advisor and don’t think I’m qualified to give anyone financial advice. The particulars matter too much. But if they insisted, I might say:
(1) If you want to play in early-stage tech investing (or anything high-risk, high-reward), ensure you have a plan for developing an ENORMOUS informational advantage. Aim to develop new skills and relationships through portfolio companies so that you can win over time, even if you “fail” with many bets going to zero. Only bet what you are comfortable losing and what you can recoup in other ways. Though my angel investing snowballed, I began with $10K checks and advising for sweat equity. Think of this as tuition for a real-world MBA. Are you willing to move to the hub of activity to ensure the best possible information and deal flow, as I did when I moved to SF lifetimes ago? Or make commensurate commitments or sacrifices to ensure you are in a position to win? If not, I’d suggest choosing a different game. Other people will take the initiatives that you won’t, and they will beat you. Much of early-stage investing is cooperative, but let’s not kid ourselves, a lot of it is competitive, and not everyone will podium finish.
(2) For the rest—which could be everything—follow Buffett’s advice. Keep it simple.
One cautionary example of doing the opposite: I spotted the COVID curve ball early, and I made a lot of very “sophisticated” (complicated) decisions related to investing, and the associated research, diligence, phone calls, and so on chewed up an unbelievable amount of time and energy. Eighteen to twenty-four months later, I’d done very well but decided to look at how passive S&P 500 returns would’ve added up over the same period, and… they were roughly the same. Of course, you can’t always bank on this outcome, but beware of seeking complexity if you’ve been rewarded for problem-solving throughout your life. Looking back over the last 15+ years, the handful of investment decisions that made all the difference have been simple and were somewhat obvious to me, no major gear-grinding required.
(3) Knowing when to buy isn’t enough. Have policies and rules for when you will sell, or the universe will punish you with very bad and very expensive decisions.
(4) Don’t discount luck, including lucky timing. I started angel investing seriously in 2008 and hit a golden window of converging trends, cheap valuations (by today’s standards), and an uncrowded playing field. The financial crisis had culled the herd of a ton of investors and fair-weather founders. It was a target-rich environment, even for someone with very little to invest. Micro-VCs were just cracking out of their shells, and the big players hadn’t started assailing the seed stage stuff. In retrospect, it was a wildly rare combo of things. I don’t believe I could replicate what I did in 2008–2012 now.
(5) Personally, I’ve largely stepped back from angel investing to double down on writing and the podcast (The Tim Ferriss Show, soon to hit 1B downloads). This comes from a desire for more predictability and less stress. I love the excitement of startups, and I’ve had some lucky wins, but I don’t find it nearly as interesting as developing creative muscles that bring in forecastable revenue year after year. For me, that has compounded more reliably than the all-or-nothing bets. Massive ups and downs in sectors like crypto also take a toll that reduces my creative batteries. In this chapter of my life, I think simplicity is the name of the game (e.g., finding one decision that removes 100 decisions).
(6) Over-optimizing is just as bad, if not worse, than under-optimizing. Past a certain point, buying extra Skittles just doesn’t fucking matter. So, a note to self: stop fiddling around with your goddamn spreadsheets and get more interesting hobbies on the calendar. What hobbies? Exactly.
(7) If we assume the point of investing is ultimately to improve your quality of life and the quality of life of those you most care about, investments that consistently add stress over long periods of time probably don’t make sense. Money is traded for things or experiences that catalyze certain feelings. If your investments are generating the opposite spectrum of feelings, it might be time to reassess.
It’s easy to miss the forest for the trees. Money is a means, not an end.
And in the end, most things matter very, very little. Do what helps you sleep at night and wake up with a low heart rate. To me, those are the hallmarks of a world-class investor who gets the big picture.
tim.blog/2023/03/03/revisiti…
Adam Smith retweeted
Circles growing in place
[source: buff.ly/3WFKhao]
xitter.cf/AlianaBayram/status/16…
Adam Smith retweeted
If it seems like your teenage kid no longer listens to you, it may be because it's true.
jneurosci.org/content/42/20/…
Adam Smith retweeted
"My hope is that this essay will help form social antibodies not just against current efforts to suppress ideas, but against the concept of heresy in general."
Adam Smith retweeted
"The democratization of high-performance computing has now come all the way down to the start-up, enabling companies like ours to rapidly iterate and move from concept to field deployment in record time" - @KairosPower
nytimes.com/2021/05/25/techn…
Adam Smith retweeted
It is common for conversations to consist of people sharing their conclusions rather than exploring the reasoning that led to those conclusions. As a result, there is an overabundance of confidently expressed bad opinions. #principleoftheday
Adam Smith retweeted
“Life is just a series of peaks and troughs. And you don't know whether you're in a trough until you're climbing out, or on a peak until you're coming down. And that's it you know, you never know what's round the corner.” –David Brent
Adam Smith retweeted
"I'm here live. I'm not a cat."
A lawyer logged into the 394th Judicial District with a cat filter on and couldn't turn it off.
This may be the funniest video I've seen this year.






























