The A3B having fewer activated parameters (activating 3B) does not mean it has lower memory usage, as the full weights still need to be loaded, and the actual memory overhead is close to the 14 GB level.