philoko

Joined 4 years ago

Karma

2

Submissions

1

Member since

Feb 23

View on Hacker News

Recent submissions

Comment · 3 years ago

For Falcon 40b, the 8-bit version would probably need about 48GB of VRAM while the 4-bit would need something closer to 28GB.