[KongchangAI]
ConceptIn-Context Learning / 上下文学习

ICL

The ability of pretrained language models to perform new tasks solely from examples provided in the prompt, without updating model parameters.

Timeline (last 90 days)

Nov 11

The cost of ICL is that every prediction must carry examples, and the longer the context, the higher the inference cost; the selection and ordering of examples affect performance; scenarios with extremely large data volumes or very high feature dimensions still require sampling and retrieval strategies.

Unverified50%
Nov 4

Recent research provides the complete circuit for arbitrary labels in few-shot sentence classification, revealing the mechanism of ICL.

Unverified50%
Nov 4

ICL in this setting is a gated associative lookup, built from a few identifiable components, with causality traced from demonstrations to predictions.

Unverified50%

All Facts (3)

Source Articles