Chris Simpson (@simplechris) header
Chris Simpson (@simplechris) profile picture

CTO at https://teapaw.org/t.co/hvD3ZW7gNY | Passionate about Software Engineering. Search/AI practitioner #search #relevancy #ml Always Learning. Previously @Vimeo

London (NW) / New York
Joined September 2008
Photo by Chris Simpson (@simplechris)Photo by Chris Simpson (@simplechris)Photo by Chris Simpson (@simplechris)Photo by Chris Simpson (@simplechris)Photo by Chris Simpson (@simplechris)Photo by Chris Simpson (@simplechris)Photo by Chris Simpson (@simplechris)Photo by Chris Simpson (@simplechris)Photo by Chris Simpson (@simplechris)Photo by Chris Simpson (@simplechris)
Chris Simpson retweeted
We removed ~80% of the Claude Code system prompt for our newest models, this is what we've learned about writing system prompts, skills and Claude.MDs for them.
464
1,901
706
16,322
4,961,546
Chris Simpson retweeted
Today, we’re sharing that a general-purpose internal @openai model achieved a breakthrough on one of the best-known combinatorial geometry problems. Less than 1 year ago frontier AI models were at IMO gold-level performance. I expect this pace of progress to continue.
Today, we share a breakthrough on the planar unit distance problem, a famous open question first posed by Paul Erdős in 1946. For nearly 80 years, mathematicians believed the best possible solutions looked roughly like square grids. An OpenAI model has now disproved that belief, discovering an entirely new family of constructions that performs better. This marks the first time AI has autonomously solved a prominent open problem central to a field of mathematics.
81
191
27
2,374
460,280
Chris Simpson retweeted
We set out to build a better retriever, so we looked for the hardest IR benchmarks. For each, we asked how much headroom remained by running oracle reranking with a frontier LLM. Most had little room left! So we built OBLIQ-Bench to study much harder search queries than before.
9
59
17
281
150,297
Chris Simpson retweeted
As promised, here's a recording of my 30-min keynote and the subsequent Q&A for the inaugural late interaction retrieval (LIR) workshop, cc @bclavie @antoine_chaffin. The talk is admittedly advanced, as it's directed at an expert IR community. But hopefully still broadly useful!
Lots of people interested in the late Interaction workshop, listening to @lateinteraction's keynote!
15
105
20
801
237,517
Yup! Search is more relevant than ever—it’s the natural abstraction for connecting AI with evolving reality. As AI systems move from static reasoning to acting in the real world, search becomes the bridge between what models know and what they need to discover.
The recipe: 1. Solve Search. 2. Use it to solve everything else.
1
9
1
38
3,543
Let’s fucking goo!! DeepSeek R1 1.5B running FULLY LOCALLY in your browser at 60 tok/ sec powered by WebGPU🔥 Intelligence truly is too cheap to meter! ⚡️
124
655
79
6,130
973,488
Chris Simpson retweeted
🚀 DeepSeek-R1 is here! ⚡ Performance on par with OpenAI-o1 📖 Fully open-source model & technical report 🏆 MIT licensed: Distill & commercialize freely! 🌐 Website & API are live now! Try DeepThink at chat.deepseek.com today! 🐋 1/n
1,940
6,661
2,772
35,017
12,564,062
Retrieval is the cornerstone of reliable AI, so it's full circle. From @sequoia sequoiacap.com/article/ai-in…
4
8
72
3,729
The only thing I know for sure is that retrieval is the cornerstone of reliable AI.
Never a dull moment in AI. Current market summary: * Big, bigger, biggest: biggest VC round ever (OpenAI), biggest seed round (Safe SuperIntelligence, $1B), biggest acqui-hire (Character, $2.7B), biggest super computer (xAI's Colossus, etc) * Rich valuations all around: NVIDIA at 65 P/E (vs 20 average), several startups at multi-billion valuations pre-revenue (sometime pre-product). Can argue whether deserved or not, but lots of growth expectations built in * Fortunately, this generation of AI startups is growing faster than their SaaS cousins ever did (source: Stripe data) * Despite concerns about over-building of AI infra, Mag 7 companies in recent earnings all attest to very strong (or even "insane") levels of demand for AI. Numbers are comparatively small by Mag 7 standards, however. * Big question around continued progress of AI research/performance, or not. Concerning reports that GPT-5 may not show as much exponential progress as prior versions did. Question around reasoning for LLMs. Fuziness around what AGI and ASI actually mean. Optimistic view is that great products/companies can be built deploying what we currently have, even if progress slowed down dramatically * Foundation/frontier LLM market seems to have crystallized around a few early winners (unclear whether any can build long term differentation). Open question about the impact of Llama 4 and open source on commercial API providers. Plenty of room still for specialized LLMs, per modality (audio, video) or vertical (bio, materials sciences, etc) * AI tooling layer (orchestration, evaluation, RAG, etc) interesting, but crowded and fast evolving * AI consumer application layer wide open. Every paradigm shift saw the rise of dominant consumer companies. Who will build the Uber of Generative AI? * From a customer perspective, enterprise (Global 2000) adoption of AI is still very early: mostly low hanging fruit kind of use cases: chat (GPT/Azure), search (Glean), code (Github CoPilot), or easy to deploy applications (Synthesia for video). For anything more company-specific or industry specific: consultants are the big winners so far. Next: enterprises will go from PoC to production for custom use cases. * From a vendor perspective, AI (intelligence wrapper) is the new SaaS (database wrapper). Furious pace of building across use cases (AI for finance, sales, marketing, custome service, HR etc) and verticals (law, accounting, banking, etc). New business models ("sell the work" vs just selling software) * Brave new world ahead of us. In the enterprise, could mean AI agents connecting with each other to orchestrate tasks end-to-end. Tomorrow's enterprise could need a lot less people and jobs would evolve to managing a few humans and a lot of AI.
1
6
39
3,800
This is an incredible (and entertaining) video explaining ColPali. I admire Weaviate for sponsoring these; they have invested in a lot of educational content and deserve recognition.
ColPali is changing the game for PDF retrieval by eliminating the need for OCR and chunking methods 🚀 Inspired by ColBERT’s success with text, ColPali splits an image of a document into patches, which are then processed through a vision LLM called PaliGemma. The embeddings for each patch retain contextual information, similarly to text embeddings in methods like ColBERT. During retrieval, user queries are embedded in the same space, and then compared to document patches using the MaxSim operator. ColPali recipe POC @weaviate_io: github.com/weaviate/recipes/… ColPali paper: arxiv.org/abs/2407.01449 As always, shoutout to the awesome @drdannywilliams for the help! 💙
6
20
226
15,119
Holy fuck ian.sh/tsa
12
33
13
244
34,690
ColBERT is in my timeline at the moment. Since it was initially proposed by @lateinteraction et al., we @ir_glasgow have worked a lot with the model. Here’s a thread of our main ColBERT research findings, with @_XiaoWang_, @ntonellotto, @iadh, @macavaney 🧵1/10 👇
5
28
4
199
54,618
Chris Simpson retweeted
Check out @Vimeo's new AI-powered video creation suite— the first of its kind— including a script generator, built-in teleprompter and text-based video editor. Imagine, script, record, edit and share a video in literal MINUTES. This is a game changer for me, and will be for many others… techcrunch.com/2023/06/19/vi…
9
32
3
228
55,501
What a time to be alive in AI.
Watching @karpathy build GPT from scratch on one screen, and using ChatGPT to explain what he's doing on the other. It's LLMs all the way down.
1
1
25
6,864
Chris Simpson retweeted
Weaviate v1.18 (coming later this month) is the first with native support for bitmap filters. The difference is massive! Check this comparison between v1.17 and a v1.18 preview done on the DEEP1B (9.99M objects) dataset. 🚀
3
11
3
39
7,057
Generative Search 😍
1
5
464
👏👏👏
My unpopular opinion is that most LLM use cases don’t need a fine tuned model They actually need a semantic search system that adds context to the prompt, or can accomplish their goals with a few shot approach instead Reasons 👇
2
1
5
1,171
Latest AI newsletter issue is live! 👀 newsletter.airstreet.com/iss…
5
20
Played around with #golang 1.19rc1 today, specifically with GOMEMLIMIT as I see a ton of potential to improve the Weaviate Operations Experience with this new feature. Here are my findings 👇
1
2
4