Unverified50% confidenceFactExact time
MC-EvoBench sets four source condition comparisons for each probe—no prior, relevant, irrelevant, and shuffled—and runs with five random seeds under a matched environment step budget
1
Sources
50%
Confidence
Long-term
Relevance
10/12/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe experiments used three training random seeds paired with a fixed test set split, along with a limited hyperparameter tuning budget.71% similarUnverifiedThe experimental scale was 5 reward configurations × 5 random seeds × 2,000 episodes per run.66% similarUnverifiedThe common practice in the community of running multiple random seeds starts at 3–5 and goes to more than 10 when rigor is required, with mean, standard deviation, and confidence intervals reported.65% similarUnverifiedThe study set up five experimental conditions, varying three variables—evidence masking, ownership marking, and neutral-fill replacement—across six initialization clusters, each containing two data orderings.65% similarUnverifiedThe results of a single-task evaluation are subject to randomness, and the same model may produce noticeably different answers under different prompts and different random seeds.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1001984API
curl https://kongchang.com/api/v1/knowledge/claims/1001984MCP
get_claim(id=1001984)