Concept情境互换审计
context-swap audit
An auditing method for verifying the stability of a scoring system. It keeps document content unchanged and only alters the visibility of random ID strings in the prompt, in order to detect whether human-contribution scores are affected by irrelevant statistical features.
Timeline (last 90 days)
Oct 15
The researchers designed a context-swap audit: keeping the document content completely unchanged and only showing or hiding the random ID strings in the prompt to the evaluator, the human contribution score of the same unmodified text fluctuated by one-third to one-half on the scale, and the score rose across all tested documents.
Unverified50%