Comment by kcb

There's no magic bullet for inference on cheap accelerators. Any accelerator will still require large amounts of high bandwidth memory.