Comment by sethkim

Yes! Both Llama 3 and Gemma 3 have 128k context windows.