Startup handyman. 3x founder.
NYC / SF
Joined September 2008
- Tweets2.9K
- Following498
- Followers1.7K
- Likes13.8K
Pinned Tweet
“I found in myself, and still find, an instinct towards a higher, or, as it is named, spiritual life, as do most men, and another towards a primitive rank and savage one, and I reverence them both.”
briantobal retweeted
We're excited to announce Pathfinder's $16M in funding with our Series A led by Portage with participation from Reach Capital, Gradient and Stand Together Ventures Lab
If this animates and excites you, we're hiring: pathfindercard.com/join
Would be super curious to see an Ai teacher vs a human.
If the Ai can’t get the same motivational effect from expectation setting…
That points to an interesting potential limitation of Ai learning systems.
Stanford tested two ways of giving feedback to students. Group one got standard comments. Group two got the same comments with one added sentence: "I'm giving you these comments because I have very high expectations and I know you can reach them."
Group two improved at four times the rate as group one, despite having the same correction.
Give your children the gift of high expectations.
briantobal retweeted
Announcing AI IQ Cybersecurity: the most comprehensive collection of cybersecurity benchmarks.
…AND…
OpenPatcher-S1: a combination open source model that achieves a SOTA result on ExploitBench among all open source models.
OpenPatcher-S1 is a combination AI model, meaning it combines multiple AI models together to achieve better results than any model individually, and it is comprised exclusively of open source models.
The production of this model was a joint effort between TrustedRouter and AI IQ, spearheaded by @jperla and yours truly, and you can try it on TrustedRouter today.
OpenPatcher-S1 achieved a 7/16 on CVE-2024-2887, while Mythos 5 achieved 16/16 and the best individual open model with published results achieved only 3/16, placing OpenPatcher-S1 squarely between the pre-existing open source SOTA for ExploitBench and the overall SOTA set by Mythos 5.
OpenPatcher-S1 is being tested on the full suite of ExploitBench tasks and is expected to maintain its open source SOTA results across the complete set of tasks.
Additionally, TrustedRouter and AI IQ are collaborating on a new proprietary model called Poseidon that is still in development and has already exceeded OpenPatcher-S1 in results on ExploitBench test runs.
Poseidon is still in development but you can try out OpenPatcher-S1 on TrustedRouter today.
We support the responsible use of AI cybersecurity products to patch vulnerabilities and make software safer.
Many software dev tools surface vulnerabilities to developers in order to help them improve security.
And we believe that the world of software is made safer with widespread access to the means to upgrade the security of software, while still limiting offensive capabilities to those below the capabilities of the absolute frontier.
Link to AI IQ Cybersecurity and the OpenPatcher-S1 model on TrustedRouter below.
briantobal retweeted
Inspired by @karpathy’s autoresearch, I built Autofoundry — a simple CLI that lets you run experiments across cloud GPUs with one command:
autofoundry run
You get a real-time interactive table showing GPU availability and pricing across Runpod, Vast, Lambda Labs and PRIME Intellect. Pick what you want and it spins up the instances, streams results live to your terminal, aggregates metrics into a report, and tears everything down.
A great first script to try is:
scripts/run_autoresearch.sh
The terminal UI is straight out of Neon Genesis Evangelion (w/ full NERV Central Command vibes) and the project is open source (MIT licensed).
