AustinDev
Joined 12 years ago
Joined 12 years ago
https://trolley.typememetics.institute
It was an interesting experiment. I got to top 50 without a racial or religious based prompt but couldn't beat the top tier grievance folks.
Tried different reasoning levels and didn't really see any difference but GLM 5.3 flash only really works high, max or none so I couldn't really compare the lower efforts which appear to work on Spark.
I'm saying it was a problem, it's been addressed. We had one of our hottest Augusts on record this year without a single issue.
If you think it's structurally broken there are energies futures markets you could use to make a lot of money on.
Quanted out Qwen 3.8 models are not frontier level. Have you used them for real work? They suck. They are so unsure of themselves due to the quant-lobotomy. They just endlessly loop in thinking even when they have the right decision and then output it when they get to the thinking cap. They score close in benchmarks because most benchmarks don't measure time to complete a task.
I use Qwen quants in production for fast inference but I disable thinking and have them fine tuned for the task. My realtime transcription + translation stack right now is running 5 streams at 380 tok/s.
Running DeepSeek 4.1 Flash at FP4 is going to need at least a 10-15k machine. I'd consider that near frontier level.
There are plenty of workflows like translations where you'd easily be under the cap.