Comment by aappleby

What's the cheapest hardware setup that can run a 70B model at tolerably interactive rates? (say 10 characters a second)