Unverified50% confidenceFactExact time
The occupancy measure d^π(s,a) characterizes the expected number of visits or the normalized distribution of a policy π visiting state-action pairs (s,a) in an MDP, and in episodic MDPs it simultaneously encodes the long-term behavior of the policy.
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAn MDP is defined by the 4-tuple (S, A, P, R): the state set S, the action set A, the state transition probability P, and the reward function R.79% similarVerifiedA Markov Decision Process (MDP) consists of five core elements: state space, action space, state transition probability, reward function, and discount factor.72% similarUnverifiedThe paper assumes access to a generative model of the MDP, meaning the algorithm can query samples for any state-action pair.72% similarVerifiedA Markov Decision Process (MDP) is mathematically defined by a five-tuple (S, A, P, R, γ).72% similarUnverifiedThe research object is a finite Markov decision process (MDP) whose trajectories are generated by a fixed behavior policy, with the state-action chain being irreducible and allowing for periodicity.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1012956API
curl https://kongchang.com/api/v1/knowledge/claims/1012956MCP
get_claim(id=1012956)