Nondeterminism
The property whereby a system may produce different outputs for the same input. In traditional software engineering this is typically treated as a defect, whereas in large language models it arises from sampling strategies and is part of their operating mechanism.
Timeline (last 90 days)
In code generation scenarios, non-determinism may cause the same prompt to sometimes generate the correct bounds check and sometimes omit it, posing a risk to software engineering processes that require auditing and reproducibility.
For scenarios such as content generation, creative assistance, and dialogue systems, non-determinism is not a bug but a feature: it makes interactions more natural and outputs more diverse.
In model comparison or prompt engineering optimization, non-determinism introduces extra variance, requiring a large number of repeated experiments to eliminate noise, which significantly increases evaluation cost.
All Facts (3)
In code generation scenarios, non-determinism may cause the same prompt to sometimes generate the correct bounds check and sometimes omit it, posing a risk to software engineering processes that require auditing and reproducibility.
50%UnverifiedFor scenarios such as content generation, creative assistance, and dialogue systems, non-determinism is not a bug but a feature: it makes interactions more natural and outputs more diverse.
50%UnverifiedIn model comparison or prompt engineering optimization, non-determinism introduces extra variance, requiring a large number of repeated experiments to eliminate noise, which significantly increases evaluation cost.
50%