Comment by nabla9

Memory is the bottleneck. It limits the size of the models you can run and what you pay for.

  Spark: 128 GB LPDDR5x, unified system memory
  5090 :  32 GB GDDR7,

Model sizes (parameter size)

  Spark: 200B 
  5090 :  12B (raw)