Comment

Comment by werediver

Is speculative decoding possible across 1/4/12/27 B Gemma 3 variants?

LM Studio doesn't allow that (yet), but maybe the s/w requires some adjustments to support speculative decoding with Gemma 3.

parent werediver 1 year ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton