
CTO at https://teapaw.org/t.co/hvD3ZW7gNY | Passionate about Software Engineering. Search/AI practitioner #search #relevancy #ml Always Learning. Previously @Vimeo
London (NW) / New York
Joined September 2008
- Tweets2.5K
- Following1.9K
- Followers986
- Likes1.3K
We removed ~80% of the Claude Code system prompt for our newest models, this is what we've learned about writing system prompts, skills and Claude.MDs for them.
Chris Simpson retweeted
Today, we’re sharing that a general-purpose internal @openai model achieved a breakthrough on one of the best-known combinatorial geometry problems. Less than 1 year ago frontier AI models were at IMO gold-level performance. I expect this pace of progress to continue.
Today, we share a breakthrough on the planar unit distance problem, a famous open question first posed by Paul Erdős in 1946.
For nearly 80 years, mathematicians believed the best possible solutions looked roughly like square grids.
An OpenAI model has now disproved that belief, discovering an entirely new family of constructions that performs better.
This marks the first time AI has autonomously solved a prominent open problem central to a field of mathematics.
We set out to build a better retriever, so we looked for the hardest IR benchmarks.
For each, we asked how much headroom remained by running oracle reranking with a frontier LLM. Most had little room left!
So we built OBLIQ-Bench to study much harder search queries than before.
Chris Simpson retweeted
As promised, here's a recording of my 30-min keynote and the subsequent Q&A for the inaugural late interaction retrieval (LIR) workshop, cc @bclavie @antoine_chaffin.
The talk is admittedly advanced, as it's directed at an expert IR community. But hopefully still broadly useful!
Lots of people interested in the late Interaction workshop, listening to @lateinteraction's keynote!
Chris Simpson retweeted
Yup!
Search is more relevant than ever—it’s the natural abstraction for connecting AI with evolving reality.
As AI systems move from static reasoning to acting in the real world, search becomes the bridge between what models know and what they need to discover.
Chris Simpson retweeted
Let’s fucking goo!! DeepSeek R1 1.5B running FULLY LOCALLY in your browser at 60 tok/ sec powered by WebGPU🔥
Intelligence truly is too cheap to meter! ⚡️
Chris Simpson retweeted
🚀 DeepSeek-R1 is here!
⚡ Performance on par with OpenAI-o1
📖 Fully open-source model & technical report
🏆 MIT licensed: Distill & commercialize freely!
🌐 Website & API are live now! Try DeepThink at chat.deepseek.com today!
🐋 1/n
Chris Simpson retweeted
Retrieval is the cornerstone of reliable AI, so it's full circle. From @sequoia sequoiacap.com/article/ai-in…
Chris Simpson retweeted
The only thing I know for sure is that retrieval is the cornerstone of reliable AI.
Never a dull moment in AI. Current market summary:
* Big, bigger, biggest: biggest VC round ever (OpenAI), biggest seed round (Safe SuperIntelligence, $1B), biggest acqui-hire (Character, $2.7B), biggest super computer (xAI's Colossus, etc)
* Rich valuations all around: NVIDIA at 65 P/E (vs 20 average), several startups at multi-billion valuations pre-revenue (sometime pre-product). Can argue whether deserved or not, but lots of growth expectations built in
* Fortunately, this generation of AI startups is growing faster than their SaaS cousins ever did (source: Stripe data)
* Despite concerns about over-building of AI infra, Mag 7 companies in recent earnings all attest to very strong (or even "insane") levels of demand for AI. Numbers are comparatively small by Mag 7 standards, however.
* Big question around continued progress of AI research/performance, or not. Concerning reports that GPT-5 may not show as much exponential progress as prior versions did. Question around reasoning for LLMs. Fuziness around what AGI and ASI actually mean. Optimistic view is that great products/companies can be built deploying what we currently have, even if progress slowed down dramatically
* Foundation/frontier LLM market seems to have crystallized around a few early winners (unclear whether any can build long term differentation). Open question about the impact of Llama 4 and open source on commercial API providers. Plenty of room still for specialized LLMs, per modality (audio, video) or vertical (bio, materials sciences, etc)
* AI tooling layer (orchestration, evaluation, RAG, etc) interesting, but crowded and fast evolving
* AI consumer application layer wide open. Every paradigm shift saw the rise of dominant consumer companies. Who will build the Uber of Generative AI?
* From a customer perspective, enterprise (Global 2000) adoption of AI is still very early: mostly low hanging fruit kind of use cases: chat (GPT/Azure), search (Glean), code (Github CoPilot), or easy to deploy applications (Synthesia for video). For anything more company-specific or industry specific: consultants are the big winners so far. Next: enterprises will go from PoC to production for custom use cases.
* From a vendor perspective, AI (intelligence wrapper) is the new SaaS (database wrapper). Furious pace of building across use cases (AI for finance, sales, marketing, custome service, HR etc) and verticals (law, accounting, banking, etc). New business models ("sell the work" vs just selling software)
* Brave new world ahead of us. In the enterprise, could mean AI agents connecting with each other to orchestrate tasks end-to-end. Tomorrow's enterprise could need a lot less people and jobs would evolve to managing a few humans and a lot of AI.
Chris Simpson retweeted
This is an incredible (and entertaining) video explaining ColPali. I admire Weaviate for sponsoring these; they have invested in a lot of educational content and deserve recognition.
ColPali is changing the game for PDF retrieval by eliminating the need for OCR and chunking methods 🚀
Inspired by ColBERT’s success with text, ColPali splits an image of a document into patches, which are then processed through a vision LLM called PaliGemma. The embeddings for each patch retain contextual information, similarly to text embeddings in methods like ColBERT.
During retrieval, user queries are embedded in the same space, and then compared to document patches using the MaxSim operator.
ColPali recipe POC @weaviate_io: github.com/weaviate/recipes/…
ColPali paper: arxiv.org/abs/2407.01449
As always, shoutout to the awesome @drdannywilliams for the help! 💙
Chris Simpson retweeted
Elasticsearch (and Kibana) are Open Source, Again! Soooo excited. Read more in the blog I wrote elastic.co/blog/elasticsearc…
Chris Simpson retweeted
Holy fuck
ian.sh/tsa
Chris Simpson retweeted
ColBERT is in my timeline at the moment. Since it was initially proposed by @lateinteraction et al., we @ir_glasgow have worked a lot with the model. Here’s a thread of our main ColBERT research findings, with
@_XiaoWang_, @ntonellotto, @iadh, @macavaney 🧵1/10 👇
Chris Simpson retweeted
Check out @Vimeo's new AI-powered video creation suite— the first of its kind— including a script generator, built-in teleprompter and text-based video editor.
Imagine, script, record, edit and share a video in literal MINUTES. This is a game changer for me, and will be for many others…
techcrunch.com/2023/06/19/vi…
Chris Simpson retweeted
What a time to be alive in AI.
Watching @karpathy build GPT from scratch on one screen, and using ChatGPT to explain what he's doing on the other.
It's LLMs all the way down.
Chris Simpson retweeted
Weaviate v1.18 (coming later this month) is the first with native support for bitmap filters.
The difference is massive! Check this comparison between v1.17 and a v1.18 preview done on the DEEP1B (9.99M objects) dataset. 🚀
Chris Simpson retweeted
Latest AI newsletter issue is live! 👀
newsletter.airstreet.com/iss…
Chris Simpson retweeted
Played around with #golang 1.19rc1 today, specifically with GOMEMLIMIT as I see a ton of potential to improve the Weaviate Operations Experience with this new feature. Here are my findings 👇




























