Comment by msp26

>The 4k context length is nice, but RoPE makes it irrelevant anyway. Can you elaborate on this?