Comment by kennywinker

I don’t know. You can run models that are in the ballpark of this on $1500 of hardware (e.g. strata on 12gb vram + 64gb ram), so I feel like unless you’re training stuff you either run smaller local models, rent your hardware, or pay for tokens.