Context windows have grown from a few thousand tokens to hundreds of thousands or more, enough to read long reports or codebases in one request. Anything outside the window is invisible to the model unless it is retrieved again.

Bigger is not automatically better: long inputs cost more, respond more slowly and can distract the model. Retrieval that selects only relevant passages is often more accurate for large knowledge bases.