Comment by foota

This is somewhat off topic, but does anyone know why they haven't tried putting SSD in a GPU like chip for inference? My understanding is that SSDs have a different access pattern for reading that adds latency vs RAM, but I don't otherwise know why it couldn't serve as a high bandwidth source for reads (ignoring write latencies and durability concerns).