Expert Prefix
A conditional supervised injection mechanism within the DEEPO method. When a query's semantic entropy exceeds a threshold, fact-based guided continuations are dynamically injected to restore gradient diversity signals in RL training under high-uncertainty scenarios.
Timeline (last 90 days)
DEEPO's expert prefix is a dynamically triggered supervised injection mechanism that injects fact-based guided continuations only when a query's semantic entropy exceeds a threshold, in order to restore the variance of the advantage.
Forcibly injecting expert prefixes on easy questions with low semantic entropy instead introduces bias; intervening only on hard questions is a precise intervention for restoring learning signals.
All Facts (2)
DEEPO's expert prefix is a dynamically triggered supervised injection mechanism that injects fact-based guided continuations only when a query's semantic entropy exceeds a threshold, in order to restore the variance of the advantage.
50%UnverifiedForcibly injecting expert prefixes on easy questions with low semantic entropy instead introduces bias; intervening only on hard questions is a precise intervention for restoring learning signals.
50%