Comment by kennywinker

180b * 1.76 bits per weight = 39.6 gigabytes.

Best you could realistically run in 32gb is like 28gb, or a 127B param model