Comment

Comment by anushka_gandhi

For 4bit, it takes you 5-10 minutes to compress a model. With this, you can do that in seconds. You do not have to worry about tokenizer configuration or anything. Just one-click compress and run.

This is our first version and yes, it will have some errors that will be fixed in the upcoming versions.

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton