Context Degradation

Context degradation refers to the phenomenon in long tasks where, as conversation history accumulates, the model's attention is diluted and early key information is buried, leading to a decline in response quality. Common countermeasures include summarization and compression, and externalizing key information into tools or vector stores.