Interaction-Mediated Non-Stationarity

A source of non-stationarity in multi-agent reinforcement learning: a single agent faces a stationary environment when the policies of others are fixed, but simultaneous learning by all agents causes the joint policy distribution to drift, so that the effective environment each agent actually faces keeps changing.