Comment Comment by _pastel Why is max_seq_len set to 2048 [1] when the model card says the context size is 8k [2]?[1] https://github.com/meta-llama/llama3/blob/14aab0428d3ec3a959...[2] https://github.com/meta-llama/llama3/blob/14aab0428d3ec3a959... parent _pastel 2 years ago
[1] https://github.com/meta-llama/llama3/blob/14aab0428d3ec3a959...
[2] https://github.com/meta-llama/llama3/blob/14aab0428d3ec3a959...