Unverified50% confidenceFactExact time
The influence of each LoRA module on the output is compressed into a low-dimensional subspace, whose rank is called the "bottleneck rank."
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedLow-rank decomposition and quantization compression are orthogonally complementary dimensions; quantizing the smaller matrices A and B separately results in smaller errors, and the combined compression ratio can reach several times that of either method alone70% similarUnverifiedThe key component of the architecture is a residual low-dimension discrete bottleneck, which transmits information through a finite discrete codebook, thereby producing quantization and information loss.69% similarUnverifiedMLA projects K and V into a latent vector space through low-rank joint compression, and at inference time only the compressed latent vectors are cached, compressing the KV cache several times over while maintaining expressive capability.68% similarUnverifiedLatent Space Constraint, by imposing specific constraints on the latent space during the inference stage, can greatly reduce the variance of generated results without retraining the model, trading generation diversity for speed and stability in specific scenarios.67% similarUnverifiedLatent-space diffusion models first use an encoder to compress images into a low-dimensional latent space for denoising iterations, then use a decoder to reconstruct them, reducing the computational cost of the diffusion process by several orders of magnitude.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1069407API
curl https://kongchang.com/api/v1/knowledge/claims/1069407MCP
get_claim(id=1069407)