Unverified50% confidenceFactExact time
The FOCUS method uses selective branching and active learning to alleviate two problems in credit assignment for long-horizon agents under sparse outcome rewards: inaccurate critic value estimates and the high cost of continuation sampling.
1
Sources
50%
Confidence
Long-term
Relevance
10/27/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe advantages of sparse rewards are low authoring cost and resistance to contamination by subjective bias; the disadvantage is that credit assignment is difficult, making it hard to determine which step in a long action sequence caused the failure.78% similarUnverifiedCredit assignment is a core challenge in reinforcement learning: when a trajectory receives only a single scalar return, it is difficult to judge the contribution of each step's action; in a 1000-token chain of thought with only a final-answer signal, the intermediate steps have no direct feedback, resulting in extremely high policy gradient variance.77% similarUnverifiedUnbiased credit assignment alone is insufficient to guarantee reliable learning; sufficiently frequent and informative feedback is equally necessary.75% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1102722API
curl https://kongchang.com/api/v1/knowledge/claims/1102722MCP
get_claim(id=1102722)