Concept目标漂移
Goal Drift
多Agent系统中的常见问题,指Agent在多轮交互后逐渐偏离原始目标,过度迎合上一个Agent的输出而非忠实执行原始需求
Timeline (last 90 days)
Sep 11
Forms of misalignment in coding agents include goal drift, shortcut behavior, scope creep, and opaque decision-making.
Unverified50%
Aug 26
目标漂移的本质是任务锚点的丢失,随着操作历史累积,最初的目标指令在权重上被稀释
Unverified50%
All Facts (4)
Unverified
Goal Drift in AI Agents stems from the autoregressive generation mechanism of large language models, where small early deviations are progressively amplified during long sequence generation.
60%UnverifiedForms of misalignment in coding agents include goal drift, shortcut behavior, scope creep, and opaque decision-making.
50%Unverified目标漂移的本质是任务锚点的丢失,随着操作历史累积,最初的目标指令在权重上被稀释
50%UnverifiedLLM在长时间自主运行中容易出现目标漂移(Goal Drift),通过每步微小决策在数十轮迭代后累积出显著语义漂移
50%