Product
Xbox Gaming Copilot
An AI gaming assistant introduced by Xbox that provides players with game-related intelligent question answering and auxiliary features, driven by non-deterministic generative models.
Timeline (last 90 days)
Oct 20
Offline evaluation practices for Xbox's Gaming Copilot include: building synthetic datasets to simulate user questions, having the system generate answers, and then using an "LLM as judge" to score them on metrics such as hallucination rate, relevance and friendliness.
Unverified50%