[KongchangAI]
ConceptAnswer Subspace

Answer Subspace

A low-dimensional subspace in the activation space of a given model layer that is spanned by the answer directions of multiple samples. It is used to separate answer-related components from the remaining representations and serves as a tool for mechanistic interpretability analysis.

Timeline (last 90 days)

Nov 18

A recent study proposes estimating a low-dimensional answer subspace from answer-position representations, separating answer-related components from the rest of the representation.

Unverified50%
Nov 18

Experiments show that the information predicting cross-modal inconsistency lies mainly outside the answer subspace, concentrated in a reproducible two-dimensional representation, and that this representation cannot be explained by fixed modality offsets.

Unverified50%
Nov 18

Matched intervention experiments show that perturbing the answer subspace significantly changes model predictions, whereas perturbing the disagreement representation (even with the same dimensions) barely changes predictions, with an effect similar to a random subspace.

Unverified50%
Nov 18

Cross-modal disagreement can be induced by misaligning modality-specific answer representations: perturbing the answer subspace of only a single modality is enough to induce disagreement, whereas applying the same perturbation to both modalities largely preserves consistency.

Unverified50%
Nov 18

Improving cross-modal consistency may require interventions targeting modality alignment within the answer subspace, rather than merely adjusting high-level fusion strategies.

Unverified50%
Nov 18

The answer subspace refers to a low-dimensional subspace in the activation space of a given layer of the model (usually the position corresponding to the answer token) spanned by the answer directions of multiple input-output samples.

Unverified50%

All Facts (6)

Source Articles