Frequency-Collapse Attention

A novel attention mechanism that projects Query and Key vectors into the frequency domain, uses bandpass filters to select information from specific frequency intervals, and then computes the inner product of the filtered representations as attention scores, replacing conventional Q/K dot-product operations.