I'm now a Kaggle Competitions Master. Check it out: kaggle.com/willrice/competit…
I received a Competition Gold Medal in the AI Agent Security - Multi-Step Tool Attacks Competition! #kaggle #goldmedal - kaggle.com/certification/com…
Could be lobotomized because I work on ML research even though it’s not LLM, but Fable is straight up trash.
I find deep research from @OpenAI super useful. However, I would like to see improvement in the output format. I always want it to be in markdown but it leaves out information when asked to convert it to markdown. If anyone has luck with getting the full output in a markdown file, I would appreciate any tips.
I'd like to see the perfomance of a random sample from the same companies ChatGPT was given to pick from for a comparison.
Its going viral on Reddit.
Somebody let ChatGPT run a $100 live share portfolio, restricted to U.S. micro-cap stocks.
Did an LLM really bit the market?.
- 4 weeks +23.8%
while the Russell 2000 and biotech ETF XBI rose only ~3.9% and 3.5%.
Prompt + GitHub posted
---
ofcourse its a short‑term outperformance, tiny sample size, and also micro caps are hightly volatile.
So much more exahustive analysis is needed with lots or more info (like Sharpe ratios and longer back-testing etc), to explore whether an LLM can truly beat the market.
Not surprising to anyone that’s actually worked on generative models.
GPT-3’s score on the MMLU benchmark was 40%. First release of GPT-4 scored 86%, and today GPT-4o is 89%.
An increase of just 3% — that’s a full year of progress. If you plot the prior trend we were supposed to be at 100, maybe 120% by now. AI is hitting a wall.
ALT Photo of Andrew Huberman recording a podcast
Unpopular opinion: AI agents are going to do some things well, but fail to generalize enough to be useful.
Will Rice retweeted
Hot take: ML researchers are underestimating how quickly recent scaling laws may flatten out - it’s quite likely what people see as an exponential function is a sigmoid, and the harsh reality of the physics of high energy costs and power plant construction restrict the expected benefits from pretraining of ever larger models.
Moved up to rank 33 on #kaggle. I'm not addicted. I can quit when I want. kaggle.com/competitions/bird…
