[KongchangAI]
Unverified50% confidenceSolutionExact time

The causal mask is implemented by generating a matrix with ones in the upper triangle and zeros in the lower triangle using torch.triu, ensuring that the i-th token can only attend to tokens at positions no greater than i.

1
Sources
50%
Confidence
Long-term
Relevance
9/11/2026
First Seen

Sources

Related Entities

Related Claims

Cite This Claim

Stable URI
https://kongchang.com/claim/904314
API
curl https://kongchang.com/api/v1/knowledge/claims/904314
MCP
get_claim(id=904314)