Unverified50% confidenceFactExact time
Existing RL methods based on group-relative advantage have two weak links in the correction chain from reward to parameter update: advantage collapse during the rollout stage and gradient invisibility at the optimization level.
1
Sources
50%
Confidence
Long-term
Relevance
9/25/2026
First Seen
Sources
Related Entities
Related Claims
Unverified提示词优化的收益受限于底层工程链路的稳定性，若接口不稳定或测试环境不可复现，提示词优化效果将无法被客观衡量66% similarUnverifiedGroup-relative advantage is the core mechanism of methods such as GRPO, which computes each output's relative advantage using the within-group mean reward as a baseline, replacing the value function that is difficult to estimate in traditional RL.66% similarUnverifiedRLHF存在奖励黑客行为等根本性局限，当AI能力超越评估员水平时人类评估的可靠性也会下降65% similarUnverifiedRLHF faces challenges such as reward hacking, inconsistent human preference annotations, and training instability, which are among the motivations for Anthropic proposing Constitutional AI as a complementary approach.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/949033API
curl https://kongchang.com/api/v1/knowledge/claims/949033MCP
get_claim(id=949033)