Unverified50% confidenceFactExact time
Sparse autoencoder (SAE) feature attribution maps are actually determined by the feature's "margin", i.e., the distance between the pre-activation value and the TopK truncation threshold.
1
Sources
50%
Confidence
Long-term
Relevance
11/3/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedSparse autoencoders (SAEs) introduce sparsity regularization in addition to reconstruction loss, encoding activation vectors as overcomplete sparse representations.74% similarUnverified2023年的单义性研究探索了如何通过稀疏自编码器(SAE)在更高维稀疏激活空间中分离混叠特征70% similarUnverifiedStandard SAEs use a single-pass linear encoder to map activations to sparse coefficients, and the coefficients obtained from a single forward pass are suboptimal relative to per-sample optimization.68% similarUnverifiedGradient analysis found that adversarial optimization is highly concentrated on a small number of parameters (robustness-critical parameters, RCPs), with robustness encoded in a sparse subspace.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1129394API
curl https://kongchang.com/api/v1/knowledge/claims/1129394MCP
get_claim(id=1129394)