DeepSeek 1017's expert weights are already FP4 (4 bits per parameter), so conventional 4-bit quantization is of little help; the Engram memory table can be placed on SSD (reading only about 12KB per token), but the expert weights must reside in high-speed memory, because the router selects 6 of 384 experts per layer and makes a different selection for each token.