[KongchangAI]
Model

Arborformer

An experimental language model project built entirely on decision trees, intended to explore non-Transformer language modeling approaches, with an emphasis on interpretability.

Timeline (last 90 days)

Nov 16

Arborformer is a language model experimental project built entirely on decision trees, aimed at replacing the Transformer architecture.

Unverified50%
Nov 16

The author of Arborformer emphasizes that it is "100% decision trees," meaning the entire reasoning path consists of tree nodes with no hidden neural network layers.

Unverified50%
Nov 16

The original poster explicitly states "seeking feedback," indicating the project is still at an early stage.

Unverified50%
Nov 16

The Reddit community's doubts about Arborformer center on expressiveness, scalability, and the lack of public evaluation results comparing it with Transformers.

Unverified50%
Nov 16

Arborformer currently looks more like a proof of concept than a mature product.

Unverified50%

All Facts (5)

Source Articles