Unverified50% confidenceFactExact time
Compared with multimodal large models, the associative descriptions produced by humans have greater semantic distance, higher entropy, and more novel expressions.
1
Sources
50%
Confidence
Long-term
Relevance
10/21/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe degree of model memorization is highly correlated with the number of data repetitions; when the number of parameters greatly exceeds the information entropy of the training data, the model tends to memorize rather than generalize.67% similarUnverifiedThe larger the parameter count, the richer the visual patterns, semantic associations, and physical laws the model can encode, but VRAM consumption grows linearly or even super-linearly.67% similarUnverifiedThe semantic entropy method does not rely on the internal structure of a specific model; it infers uncertainty through semantic consistency at the output level, giving it relatively strong generalization ability.66% similarUnverifiedThe concept of perplexity originates from entropy (Shannon Entropy) in information theory, and is essentially the average branching factor per prediction step of a language model.65% similarVerifiedThe semantic entropy method is technically implemented by obtaining candidate answers through multiple samplings, using an NLI model to determine semantic equivalence for clustering, and then computing entropy over the semantic categories.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1079454API
curl https://kongchang.com/api/v1/knowledge/claims/1079454MCP
get_claim(id=1079454)