Comment Comment by swifthesitation I don't think so. It seems to just lower the ram needed for the context window. Not for loading the model on the vram. parent swifthesitation 1 year ago