Comment Comment by dsrtslnd23 What hardware are you running the 30b model on? I guess it needs at least 24GB VRAM for decent inference speeds. parent dsrtslnd23 9 months ago
