It seems like OpenAI and Anthropic have been in a battle of context windows for the better part of a year.
In May of 2023, Anthropic breathlessly...
For further actions, you may consider blocking this person and/or reporting abuse
I agree that larger context is not a silver bullet. In you experience, in which use cases it really improves LLM performance?
Great question!
I think the longer context window is actually more relevant for other kinds of workflows - for example, if you wanted to summarize or rewrite a very long piece of text requiring a context window that large.