Mamba Architecture

A sequence modeling architecture based on state space models (SSMs) that replaces the quadratic complexity of standard attention with a recurrent state growing approximately linearly with sequence length, substantially reducing memory and computation overhead in long-context scenarios.