mradermacher
A well-known publisher of GGUF model quantizations in the open-source community. It has long provided GGUF quantized versions of various open-source large models for use with local inference tools such as llama.cpp.
Timeline (last 90 days)
AntAngelMed officially provides an FP8 version, and the community has a GGUF quantized version made by mradermacher that can be used with llama.cpp.
bartowski and mradermacher are the two most active GGUF-format quantization publishers: bartowski runs perplexity tests on each quantized version, while mradermacher offers broad coverage and faster update speeds.
All Facts (2)
bartowski and mradermacher are the two most active GGUF-format quantization publishers: bartowski runs perplexity tests on each quantized version, while mradermacher offers broad coverage and faster update speeds.
50%UnverifiedAntAngelMed officially provides an FP8 version, and the community has a GGUF quantized version made by mradermacher that can be used with llama.cpp.
50%