LLM representations have implicit symbolic structure

An academic paper investigating the internal representational structure of large language models, exploring whether LLMs spontaneously form discrete, symbol-like structures in high-dimensional vector spaces during training. The paper addresses a core proposition in the field of AI interpretability.