impossible → routineHow much a model reads at oncePutting a long document into a model's input and asking questions about all of it.Impossible2020-05-28GPT-3 is published with a fixed context window of 2,048 tokens for every model size.2,048 tokenssource4 yearsRoutine2024-06-27Google opens a two-million-token context window to every developer on its public API.2,000,000 tokenssourceAll dated pairs
Putting a long document into a model's input and asking questions about all of it.Impossible2020-05-28GPT-3 is published with a fixed context window of 2,048 tokens for every model size.2,048 tokenssource4 yearsRoutine2024-06-27Google opens a two-million-token context window to every developer on its public API.2,000,000 tokenssource