How Long Contexts Fail
Taking care of your context is the key to building successful agents. Just because there’s a 1 million token context window doesn’t mean you should fill it.
Context Rot: How Increasing Input Tokens Impacts LLM Performance | Chroma Research