Probabilistic LLM
A large language model that generates text through a sampling mechanism, so the same input may yield different outputs. It possesses intrinsic non-determinism and is suited to tasks such as natural-language generation where rules cannot be exhaustively enumerated.
Timeline (last 90 days)
The AI tutor system is split into three types of components: humans write and run the SQL; deterministic code handles the try-first rule, the hint/answer rules, the answer checker and the leak-prevention guard; and the probabilistic LLM only writes the hint text.
Deterministic code refers to programs that always produce the same output for the same input and can be exhaustively verified with unit tests, whereas the sampling mechanism of a probabilistic LLM gives its output inherent randomness.
All Facts (2)
The AI tutor system is split into three types of components: humans write and run the SQL; deterministic code handles the try-first rule, the hint/answer rules, the answer checker and the leak-prevention guard; and the probabilistic LLM only writes the hint text.
50%UnverifiedDeterministic code refers to programs that always produce the same output for the same input and can be exhaustively verified with unit tests, whereas the sampling mechanism of a probabilistic LLM gives its output inherent randomness.
50%