Comment Comment by kraken12 The 4090 has half the memory bandwidth, so it could not get a 5X gain, it would actually run slower on a memory bound LLM like this. parent kraken12 3 years ago
