Unverified50% confidenceFactExact time
In on-policy rollouts, incorrect pseudo-label words rarely appear, so the group-relative advantage always aligns with clean transcriptions; this is the mechanistic explanation for GRPO's noise robustness.
1
Sources
50%
Confidence
Long-term
Relevance
10/26/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAnswer-level advantage assignment algorithms like GRPO are not omnipotent; when the quality of sentences within an answer varies greatly, evenly distributing the advantage value dilutes the signal and may even reinforce wrong behavior.72% similarUnverifiedGRPO can be summarized as PPO minus the critic, plus an intra-group mean baseline.70% similarUnverifiedGRPO's supervision granularity is sequence-level, with the entire response sharing a single advantage value, so it cannot indicate which step in the reasoning chain went wrong.67% similarUnverifiedGRPO generates a group of candidate outputs for the same input and updates the model using intra-group relative reward signals rather than absolute reward signals, reducing reliance on an independent value network (critic).64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1098813API
curl https://kongchang.com/api/v1/knowledge/claims/1098813MCP
get_claim(id=1098813)