cheez | Local LLM Benchmarks (@cheeez42) header
cheez | Local LLM Benchmarks (@cheeez42) profile picture

Local LLM benchmarks on consumer GPUs | tests, reproducible configs, practical verdicts R9700 | 5070 | 2060s

Joined December 2018
Photo by cheez | Local LLM Benchmarks (@cheeez42)Photo by cheez | Local LLM Benchmarks (@cheeez42)Photo by cheez | Local LLM Benchmarks (@cheeez42)Photo by cheez | Local LLM Benchmarks (@cheeez42)Photo by cheez | Local LLM Benchmarks (@cheeez42)Photo by cheez | Local LLM Benchmarks (@cheeez42)Photo by cheez | Local LLM Benchmarks (@cheeez42)Photo by cheez | Local LLM Benchmarks (@cheeez42)Photo by cheez | Local LLM Benchmarks (@cheeez42)Photo by cheez | Local LLM Benchmarks (@cheeez42)
found this plugin for tern: github.com/yoyooyooo/tern-ta… and was trying to get it to work cross-host and seems there was an issue and it cant...so i asked the clanker what else we can do and status icons like this are already native in tern, and i already have it set up cross host. has @can1357 really thought of everything?
1
97
so between the @Beelinkofficia, @Hi_MINISFORUM or @gmktecdotcom mini pc boxes (not ai boxes, just mini pcs) which brand would everyone pick? who has experience with minisforum and gmk? gimmie the scoop
anyone have experience in @Beelinkofficial mini pcs? thinking about getting this one a.co/d/01ZpdWFF as a desktop mini pc to replace the laptop in its "docked" state.
2
138
this is huge if true...hyprland is going to shit now. ggs
JUST LEARNED @vaxryy HAS A GIRLFRIEND. END OF AN ERA
2
168
anyone have experience in @Beelinkofficial mini pcs? thinking about getting this one a.co/d/01ZpdWFF as a desktop mini pc to replace the laptop in its "docked" state.
2
1
2
273
this dog right here….. ❤️
1
1
5
101
the chonk out there putting in the work! absolutely crushing it
Two taste tests on two ChonkELLM models: DREAMER (prototype) and CODERED-327. Modest settings, old fashioned layer architecture. Can CODERED do fibonacci finally? I tweaked the corpus to boost it a bit. Is DREAMER still dreaming about eating people? 2.5 hours n 6 hours away each
1
3
99
such a great read from an absolute jobmaxxing legend. go get your bag…its out there if you want to work for it.
39
literally, you can learn to do anything you want. just go for it, learn, fail, learn some more…life will be infinitely better
My default posture is that I can learn how to do anything and yours should be too. You'd be amazed how much opportunity for happiness and fulfillment it opens up.
1
116
COME AND TAKE EM...
i just scratched the serial number off my GPU
2
1
5
189
yup, i need this @KeychronMK like yesterday.
#Orcaecho の先行モニター説明会にご招待いただいております。プチ天キー(写真2枚目)も開催されている。
4
170
its officially that day of the week again...my weekend has started, i am cramming as much stuff as possible into these hours before the work week starts....
2
68
tern mobile is such a great experience. i may never use my laptop ever again.
2
86
i strive to be like iarb. you should too.
4
210
supply and command or whatever
Can someone tell me when are RAM, SSD & GPU prices expected to fall back to normal? This inflation is horrible and I swear to god I am not going to be part of this nonsense. AI is good and all but it has done so much harm to the consumer market. When will this be fixed? Or are people really okay with things as is? Personally it frustating to see such crazy prices. Idc about local AI as much as others. All I want is to be able to buy the parts mentioned above, play games, store my lives memories, and live a good life like I am meant to without feeling extorted for every silicon purchase and bankrupting myself for sake of those 2 good hours, and remembering the good times in life at the end of the day. Just fix it please. Its horrible as is.
71
this is why you give the clanker full sudo access always: on tuesday i decided to rethink my zfs set up that i have been running since january as my "NAS". simply because the 10tb hard drives that i bought are now 459 dollars(250 when i got them). so i sat down with sol and formulated a plan to basically double the actual storage space with simple ext4+mergerfs+snapraid and maybe 30-45 minutes later sent 6.1-sol off to do its thing.......somewhere around 8tb of data....and 4 days later we are hitting the home stretch now. i blame big parts of this on me having to sleep and also me having to be at work and not having eyes on the clanker....it sat idle waiting for me to run commands and enter a password because i did not open the doors freely to my best employee. still getting stuff done though so can not be to hard on the fella
4
7
392
my timeline is filled with loads of Japanese nerds building their first PC and its awesome! i love it. idk what happened to my algo but its on 🔥 lately. if any of yall see this and need help just ask!
1
7
208
its halloween: im going to be @DarioAmodei and go around and tell people to be scared of AI, open source ai, and chinese ai all while being ceo and co founder of one of the largest american ai companies
2
1
9
611
i had a dream last night, q1 of 2027 brings me 128gb ddr5, 1 r9700, and a gorgon halo..... @AIatAMD im coming for you ;)
1
8
320
"local inference wastes scarce resources" ok sam. datacenter buildouts are stalling and people are calling a gpu glut for next year.... cheap cards are coming. the clankers stay home.
1
87