#Bonsai-27B

Bonsai-27B Extreme Quantization: Running 1-bit LLMs on Consumer Hardware

Bonsai-27B supports binary/ternary extreme quantization for 27B LLMs running on 8GB VRAM. Covers llama.cpp upstream progress, RTX 4060 benchmarks (30 t/s), and real-world limitations.