taf2

it's ok but not great compared to the commerical LLM's it's really not very good. it's benchmarks are clearly fake. even still we run it internally for a ton of workloads on our rack of gpu's

I remember my parents working for a company in the 90s and the mailroom was one the most common places things went missing… aka theft. I recall my mom had her purse stolen at her cube… theft from within similar to security exploits from within seem to be the most real security vulnerability to be focused on. That sshd that can only be accessed from a few specific ips with the right port knocking is not how you get hacked… at least not normally

Bought the rtx 6000 pros one per month starting in January- since they doubled in price I wish I just used a line of credit back in Jan to buy all of them. For me it’s about keeping internal company content internal. Slack channels etc with tools for teams to use. Triage tools for Zendesk etc.

Spent most of today reworking a rack and rig of gpus for all of our internal ai work… our big server is 8 rtx 6000 pro and 3 psu, I definitely feel I made a mistake not upgrading our wall power to 240v but so far we have multiple 30amp 120v and with 3 PSU uninterrupted power we have been very stable. My big upgrade will be moving to epyc motherboard from threadripper so we get gen5x8 with bifurcation instead of what we are stuck with today gen5x4 due to bios limitations . What has been so encouraging though is first deepseek v4 flash at 200+ t/s for single user and much more in aggregate- now on qwen 3.8 flash next for image support and eyes on glm5.3 flash for some testing … next is realistically considering co location and quiet a sizable loan to scale this to real hardware instead of miner rip vibes

Fun fact you can even ask codex what questions should I ask about this code because I seeing the following x,y,z (image 1), etc…

Reminds me of the children of time books - think it’s the second book with the octopus

i trained another AI on all my codex logs... it's pretty good actually

a quick scan of tech things once or twice daily helps pass the time in boring situations and also catch me up on the latest

vim, ls , cd, grep, cat being close seconds