Prompt Sensitivity
The degree to which the output quality of a large language model fluctuates with surface-level changes in the prompt, such as instruction wording, the number and order of examples, or the choice of language. Low sensitivity indicates that a model is more robust to variations in the prompt.
Timeline (last 90 days)
Prompt sensitivity refers to the degree to which model output quality fluctuates with surface-level changes in the prompt (such as instruction wording, number and order of examples, and language choice).
In controlled experiments, researchers typically fix the model and decoding parameters and systematically vary only one dimension of the prompt to isolate that factor's effect on performance.
Studying prompt sensitivity in low-resource languages is essentially examining the model's generalization boundary when training distribution coverage is insufficient, and its conclusions often cannot be simply extrapolated from experimental results in high-resource languages.
All Facts (3)
Prompt sensitivity refers to the degree to which model output quality fluctuates with surface-level changes in the prompt (such as instruction wording, number and order of examples, and language choice).
50%UnverifiedIn controlled experiments, researchers typically fix the model and decoding parameters and systematically vary only one dimension of the prompt to isolate that factor's effect on performance.
50%UnverifiedStudying prompt sensitivity in low-resource languages is essentially examining the model's generalization boundary when training distribution coverage is insufficient, and its conclusions often cannot be simply extrapolated from experimental results in high-resource languages.
50%