State-Space Coverage
A conceptual measure of the proportion of all reachable environment states that an agent has visited during training or operation. It can be used to diagnose the sufficiency of exploration and the overconfidence of policies.
Timeline (last 90 days)
State-space coverage is a conceptual metric measuring the proportion of all reachable states that an agent has visited during training or operation.
In practice, state-space coverage can be approximately estimated via state hashing, clustering of observation embeddings, or deduplicated counting.
If state-space coverage stagnates over time while task success rate does not rise, it often means the agent has fallen into repetitive loops, and the weight of the exploration reward or the granularity of the memory mechanism needs adjustment.
All Facts (3)
State-space coverage is a conceptual metric measuring the proportion of all reachable states that an agent has visited during training or operation.
50%UnverifiedIn practice, state-space coverage can be approximately estimated via state hashing, clustering of observation embeddings, or deduplicated counting.
50%UnverifiedIf state-space coverage stagnates over time while task success rate does not rise, it often means the agent has fallen into repetitive loops, and the weight of the exploration reward or the granularity of the memory mechanism needs adjustment.
50%