Unverified50% confidenceFactExact time
OctLLM replaces compressed implicit representations with explicit octree occupancy token sequences, and introduces 3D capabilities via independent parameter branches without disrupting the pretrained language pathway.
1
Sources
50%
Confidence
Long-term
Relevance
10/5/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThe arXiv paper 'Octrees as an Explicit 3D Language' proposes OctLLM, targeting two pain points of 3D large models: compressed geometric information and fine-tuning that damages language capabilities.74% similarUnverifiedDiscrete masked diffusion draws on BERT's masked language modeling idea—randomly masking and restoring sequences during training and iteratively filling in from a fully masked sequence at inference—with representative works including MDLM and SEDD.67% similarUnverifiedTraditional stitched multimodal approaches typically connect a pretrained visual encoder (such as CLIP) to a language model via an adapter layer, resulting in relatively fragmented cross-modal understanding.66% similarUnverified模型的格式方言源于指令微调阶段训练数据的格式差异，被模型深度内化形成强烈格式偏好，难以通过运行时提示词完全覆盖65% similarVerifiedRelative positional encoding schemes such as RoPE (Rotary Position Embedding) and ALiBi enable models to handle text sequences far longer than those seen during training.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/975909API
curl https://kongchang.com/api/v1/knowledge/claims/975909MCP
get_claim(id=975909)