[KongchangAI]
Unverified50% confidenceFactExact time

Experiments in the original paper found that the weight updates during model adaptation are essentially low-rank, and that even setting the rank to r=1 or r=2 and applying it only to the query and value matrices in the attention mechanism can achieve quite good results on some tasks.

1
Sources
50%
Confidence
Long-term
Relevance
10/16/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/1047746
API
curl https://kongchang.com/api/v1/knowledge/claims/1047746
MCP
get_claim(id=1047746)