[KongchangAI]
Concept注意力空间分布 / spatial attention distribution

Attention Distribution

A continuous distribution centered on the fixation point that decays with spatial distance, used to model the allocation of human visual attention resources and injectable into models as an inductive bias.

Timeline (last 90 days)

Nov 11

A new work models visual attention as a continuous distribution centered on the current fixation point that decays with spatial distance, and encodes this distribution into reward model training as an additional supervisory signal.

Unverified50%
Nov 11

Whether the parameterization of the attention distribution applies to non-reading tasks remains an open question.

Unverified50%
Oct 17

Placing system prompts and the current task goal at the beginning and end of the context window is an engineering strategy with empirical backing, because models pay more attention to the beginning and end content.

Unverified50%

All Facts (3)

Source Articles