Conceptprompt sensitivity
Prompt Sensitivity
The phenomenon in which a large language model produces different outputs in response to variations in prompt wording. This can arise from deficiencies in model robustness or from flaws in evaluation methodology design, and is a core challenge in the field of model evaluation.
Timeline (last 90 days)
Oct 6
When a model gives answers of vastly different quality for semantically equivalent but differently phrased questions, it indicates that the model has overfitted to surface-level wording rather than truly mastering the underlying task.
Unverified50%