Comment by le-mark

> Their context windows are big enough to encompass an entire codebase,

There’s clearly a range from small to large where this is not true. Plus it’s well known llm degrade with large context favoring content at the ends more than the middle.