
Labs @Langchain, music maker, tryhard
Lumbridge
Joined February 2012
- Tweets286
- Following229
- Followers2.4K
- Likes1.8K
The internet is exploding
despite the unfortunate timing, we take disclosures seriously at @typesafeai
at approximately 6:49PM this Friday evening, we became aware of a massive unauthorized leak of ALL customer noul outputs
in effort to maximize transparency, here is the link: gist.github.com/diogo149/810…
Yo @OddStats I assume you know about this guy but here's this xitter.cf/Oddstatts32
The future is small, fine-tuned models!
xitter.cf/corridor/status/211296…
this is only the beginning! LangChain is cooking rn
.@corridor used smithtune’s trace-based workflow to build the training data for Argos, a fine-tuned 9B model that scores the highest of the 14 models they tested on their security context benchmark.
🧵 Full thread ⤵️
I am still using K3 as main
Jev is out! LangChain has made it super easy to get up and running.
writeup from @sydneyrunkle: xitter.cf/sydneyrunkle/status/21…
Jev is now available to everyone. No waitlist.
Start using it here: console.typesafe.ai
I have this theory that the LLMs are actually producing incredibly useful output, the humans just don't read it because lazy
is 1M tokens just... the correct max context?
above 400k with some models, things get expensive. above 600k you almost definitely have context rot
at least, until we have a new approach for managing 1M+
tonight's project: set up my extra machine to serve deepseek v4 flash 2bit
currently running a 128 mem M4 ultra with:
- hetzner VPS as a gateway
- Netdata for machine status + stats
- two books to keep the computer elevated
What am I missing? certainly books isn't the solve...
Ok I think I want tabs
4 multiplexed TUI sessions per tab
shared memory/tools/maybe agent per-tab
org-wide per-subject memory
Replying to @jordienr
My hot take is that individual convo threads are the wrong high level unit of organization
What is a better unit?
















