[KongchangAI]
ConceptGrokking

Grokking

A phenomenon in which a model's performance on the validation set suddenly improves substantially after its training loss has converged, reflecting the counterintuitive nature of capability emergence in neural networks.

Timeline (last 90 days)

Oct 20

The double descent phenomenon and the grokking phenomenon show that training dynamics are more complex than traditional learning theory predicts.

Unverified50%

All Facts (1)

Source Articles