Comment Comment by smallnamespace An 14-inch M4 Max Macbook Pro with 128GB of RAM has a list price of $4700 or so and twice the memory bandwidth.For inference decode the bandwidth is the main limitation so if running LLMs is your use case you should probably get a Mac instead. parent smallnamespace 1 year ago
For inference decode the bandwidth is the main limitation so if running LLMs is your use case you should probably get a Mac instead.