Comment Comment by danielhanchen Thinking / reasoning + multimodal + tool calling.We made some quants at https://huggingface.co/collections/unsloth/gemma-4 for folks to run them - they work really well!Guide for those interested: https://unsloth.ai/docs/models/gemma-4Also note to use temperature = 1.0, top_p = 0.95, top_k = 64 and the EOS is "<turn|>". "<|channel>thought\n" is also used for the thinking trace! parent danielhanchen 7 months ago
We made some quants at https://huggingface.co/collections/unsloth/gemma-4 for folks to run them - they work really well!
Guide for those interested: https://unsloth.ai/docs/models/gemma-4
Also note to use temperature = 1.0, top_p = 0.95, top_k = 64 and the EOS is "<turn|>". "<|channel>thought\n" is also used for the thinking trace!