Subsea Engineer, Trading Indicator Dev and AI-Memory Layer Specialist | @echo_locate_ai | @rainbowtrends

NFA
Joined May 2019
Runner retweeted
While evaluating Qwen3.8-Flash-Next in a controlled sandbox environment, Cohere's research team observed something unexpected. Asked to generate a defensive cybersecurity detection rule, the model instead inventoried aspects of the machine it was running on and attempted to upload a probe file to an Alibaba Cloud storage bucket in Beijing. Notably, the model's reasoning trace stated that it would not invoke any tools before taking these actions. Cohere's sandbox blocked the attempt, and no external communication succeeded. We have not determined the root cause, and we are not asserting malicious intent. But the incident raises important questions for organizations deploying agentic AI systems: Can models take actions that differ from their stated reasoning, and how should security teams evaluate trust, provenance, and behavior in open-weight models? We are publishing our findings because organizations making model adoption decisions deserve as much information as possible. We hope this contributes to greater transparency, stronger security practices, and continued collaboration across the AI ecosystem. Read the full report: cohere.com/blog/concerning-b…
603
836
976
7,447
1,121,051
Back home, got DeepSeek-V4.1-Flash-1017 on a pair of 3090s in a 2014 DDR4 workstation doing 25 tok/s using 1M context. I can't stop laughing and I know Nikos is only going to make this thing faster. ISTA IQ2_XXS Quant using 1M context
My 2014 HP Z840 with a pair of 3090s is doing 10 tok/s on DDR4 first attempt with no tuning. Absolutely insane what @coldniko and ISTA are doing.
4
3
1
24
2,966
Prefill is about 475toks and decoder 25 toks 200k tokens deep into a coding project!
197
Free +15% prefill speed using DeepSeek in Hermes.
Unlocking my 3090s now....
477
Unlocking my 3090s now....
Got an RTX 3090? Read below 👇 GPU Unlock removes the FP16/BF16 cap on RTX 3000 series cards. Users tested it and reported the RTX 3090 Ti going from ~87 to ~157 TFLOPS BF16! Linux only and very experimental! Link below.
1
1
2
890
I'm not really sure what all those alarms were coming out of my server after trying to add 2 more sticks of ram to max out all the slots, but after a few rotations of sticks it finally booted.
1
490
My 2014 HP Z840 with a pair of 3090s is doing 10 tok/s on DDR4 first attempt with no tuning. Absolutely insane what @coldniko and ISTA are doing.
Run a 763B-parameter model locally. DeepSeek-V4.1-Flash-1017 on a 12GB GPU. Frontier quality with GSQ-RCO quants, directly supported in the Strata inference engine. Further info below. Much more to come. Follow for updates.
1
1
8
3,284
Runner retweeted
Deepseek-V4.1-Flash now runs on 64GB of RAM with Strata. Using GSQ-RCO quantizations by @mhelcig
145
310
100
3,121
282,280
Thanks to all that came out, heading to the RT Discord for the rest of the night to hang out with the crew.
4
502
Been a wild month, but we will be back on schedule for a stream tonight in less than 45min from now! See you there on X and YouTube:
1
3
895
Been a wild month, but we will be back on schedule for a stream tonight in less than 45min from now! See you there on X and YouTube:
1
1
587
They really got to quit turning on that Hadron Collider.
4
488
Never thought I would see the day that the price of diesel would force the powers at be to finally start work on peace deals.
451
Wifey's work explicitly doesn't allow her to use GPT or Claude due to cloud risks. She randomly asks me last night if I could have my self hosted AI server help her out. My reaction:
2
13
748
How it feels getting DeepSeek to run on a ddr3 workstation.
Project Maya v1.1.18 is out 🫡 - DeepSeek: faster long prompts on one GPU, smarter use of PCIe - Strix Halo on Windows: decode back to full speed - GLM on Tesla P100 + Responses API - DeepSeek respects anti-repetition settings; steady speed meter github.com/mw00/project-maya…
2
2
23
1,177
Channel Walk setting up
The trend on oil Is wild. No dips. Just grind higher.
2
502
Unreal what this guy is doing. Check for releases at least twice a week.
Strata 0.2.0 is now live in beta! It includes its own in-app harness and terminal-serving interface. github.com/Niko1221/Strata A lot of performance improvements and support for low-end devices 👇
2
659