[KongchangAI]
ModelSSD-MIMO

SSD-MIMO

A MIMO variant based on state space duality that routes an independent value for each rank when the local retrieval rank is greater than one, avoiding information aliasing across channels.

Timeline (last 90 days)

Nov 3

The MIMO construction of Mamba 3 promotes one value at each local interface; SSD-MIMO routes independent values for cases where the local retrieval rank is greater than one.

Unverified50%
Nov 3

In small-model multi-token recall experiments, both HybridMamba and SSD-MIMO designs outperformed Mamba 1-3 at the hardest level.

Expired50%
Nov 3

On single-seed language models of about 500 million parameters and 2B tokens, HybridMamba and SSD-MIMO outperformed Mamba 1/2 on test loss, but the gains from routing did not translate into lower language model loss.

Expired50%

All Facts (1)

Source Articles