#Bonsai PrismML
5 related articles
·3 min
Running AI Inside DRAM: A Processing-in-Memory Experiment That Breaks DDR4 Timing Rules
Explore how deliberately violating DDR4 timing rules enables running PrismML's Bonsai AI model inside DRAM, covering the principles, energy benefits, and challenges of processing-in-memory.
Read more →
·3 min
Running a 27B Model on iPhone: How 1-bit Quantization Achieves Extreme Compression
PrismML's Bonsai compresses a 27B model from 54GB to 3.9GB, running at ~11 tokens/sec on iPhone. A deep dive into QAT, knowledge distillation, and speculative decoding.
Read more →
GitHub Daily · July 17: AI Coding Infr…
·3 min
GitHub Daily · July 17: AI Coding Infrastructure Explodes — From Context Graphs to Vector Indexes
AI coding infrastructure explodes on GitHub: context management, code graphs, and vector indexes become the new battleground as the community shifts from apps to underlying capabilities.
Read more →
·2 min
Apple in Talks to Acquire PrismML: Can Extreme Quantization Really Run AI on an iPhone?
Apple is reportedly in talks to acquire AI startup PrismML, whose 1-bit extreme quantization could run large models on iPhone. Community tests reveal tool-calling failures and high hallucination rates.
Read more →
·3 min
Bonsai-27B Extreme Quantization: Running 1-bit LLMs on Consumer Hardware
Bonsai-27B supports binary/ternary extreme quantization for 27B LLMs running on 8GB VRAM. Covers llama.cpp upstream progress, RTX 4060 benchmarks (30 t/s), and real-world limitations.
Read more →