Concept
Q-Mamba
A quantization scheme for the recurrent state of the Mamba model that rounds the state immediately after each generated token. Its performance at four-bit precision is lower than that of PACE.
Timeline (last 90 days)
Oct 22
PACE using 4-bit heads throughout scores higher than Q-Mamba at the same memory.
Unverified50%