ConceptParametric Knowledge
Parametric Knowledge
The implicit memory formed when a language model compresses knowledge into its weight parameters during pre-training. It contrasts with non-parametric knowledge retrieved at inference time, and the tension between the two represents a core challenge in retrieval-augmented generation (RAG) systems.
Core Facts
Timeline (last 90 days)
Oct 11
Parametric knowledge refers to the implicit memory compressed into the weight parameters of a language model during pre-training, while non-parametric knowledge refers to knowledge retrieved at inference time.
Verified85%