Comment Comment by moralestapia >The main problem with the Groq LPUs is, they don't have any HBM on them at all. Just a miniscule (230 MiB) [0] amount of ultra-fast SRAM [...]IDGAF about any of that, lol. I just want an API endpoint.480 tokens/sec at $0.27 per million tokens? Sign me in, I don't care about their hardware, at all. parent moralestapia 2 years ago
IDGAF about any of that, lol. I just want an API endpoint.
480 tokens/sec at $0.27 per million tokens? Sign me in, I don't care about their hardware, at all.