cyankiwi
A model quantization publisher on Hugging Face that releases AWQ INT4 quantized models.
Timeline (last 90 days)
There is currently no NVFP4 build of AREX-2; available quantized versions include BAAI's original BF16 (54.7 GB), prithivMLmods' FP8 (35.9 GB), cyankiwi's AWQ INT4 (20.2 GB), and numsu's INT4 W4A16 (18.6 GB).
Qwen3 Coder Next is an 80B-parameter mixture-of-experts (MoE) coding model, deployed by vLLM on a single A100 80GB, using the 4-bit AWQ quantized version published by cyankiwi.
All Facts (2)
There is currently no NVFP4 build of AREX-2; available quantized versions include BAAI's original BF16 (54.7 GB), prithivMLmods' FP8 (35.9 GB), cyankiwi's AWQ INT4 (20.2 GB), and numsu's INT4 W4A16 (18.6 GB).
50%UnverifiedQwen3 Coder Next is an 80B-parameter mixture-of-experts (MoE) coding model, deployed by vLLM on a single A100 80GB, using the 4-bit AWQ quantized version published by cyankiwi.
50%