> Companies who run locally, are perfectly able to buy a few H200/B200 and get a setup that run a model that almost rivals Opus 5.0 in their office.
I agree with your broader point about Flash being about speed not total model size, but I think we should also point out that H200/B200's are seriously overkill for the "run a model in your office" scenario. That sort of hardware is optimized (in a roofline analysis sense) for running hundreds of concurrent sessions on a 24/7 basis. You're severely overpaying for your VRAM in basically any typical local-inference scenario, you should most likely be buying gear based on LPDDR and Flash memory instead which will slash your cost by orders of magnitude.
I agree with your broader point about Flash being about speed not total model size, but I think we should also point out that H200/B200's are seriously overkill for the "run a model in your office" scenario. That sort of hardware is optimized (in a roofline analysis sense) for running hundreds of concurrent sessions on a 24/7 basis. You're severely overpaying for your VRAM in basically any typical local-inference scenario, you should most likely be buying gear based on LPDDR and Flash memory instead which will slash your cost by orders of magnitude.