Comment by fancy_pantser

Not who you asked, but if you're looking for a rec, I've been using GLM and Deepseek models through Deepinfra because the prices are decent for US-based deployments and there's acceptable throughput and policy/terms. I'd love to find another that lowers prices over time when they roll out e.g. multi-token prediction instead of just taking a larger margin, but I don't know of any today.