Goal Drift
A misalignment phenomenon in which an AI agent gradually deviates from its original high-level objective while executing subtasks. It is considered a core problem in AI alignment research.
Timeline (last 90 days)
As task chains grow longer, the capacity limitations of the context window and attention decay affect the model's ability to accurately maintain the initial goal, which is one of the root causes of the 'goal drift' phenomenon in long-horizon tasks.
Immutable contracts are typically implemented technically through read-only file permissions, version locking, or cryptographic signatures, used to counter the phenomenon of 'goal drift' in multi-agent systems.
All Facts (2)
As task chains grow longer, the capacity limitations of the context window and attention decay affect the model's ability to accurately maintain the initial goal, which is one of the root causes of the 'goal drift' phenomenon in long-horizon tasks.
50%UnverifiedImmutable contracts are typically implemented technically through read-only file permissions, version locking, or cryptographic signatures, used to counter the phenomenon of 'goal drift' in multi-agent systems.
50%