Unverified50% confidenceFactExact time
The iOS export uses Core ML 8-bit weights, with a model size of 26MB and 99.96% agreement with fp32 labels, and in the keyboard it actually uses the CPU compute unit, taking about 4ms per sentence in a release build; the Android version uses ONNX opset 17 with int8 dynamic quantization, 27MB, 99.1% agreement, and likewise about 4ms per sentence on CPU.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/12/2026
First Seen
Valid until: 1/10/2027
Sources
Related Entities
Related Claims
Unverified苹果A18 Pro统一内存架构最高支持16GB，内存带宽达68GB/s，Neural Engine算力达35 TOPS77% similarUnverifiedLocal inference is constrained by the user's hardware: a 7B-parameter quantized model (such as the Q4 version of Llama 3 8B) has a file size of approximately 4–5 GB, can reach 20–40 tokens per second on a Mac with an Apple M-series chip, and may drop to 3–5 tokens per second on a laptop with only an integrated GPU and 8 GB of RAM.75% similarUnverifiedA developer connected an iPhone 17 Pro Max to a 24GB-memory M4 Pro MacBook via a 10 Gb/s USB-C cable, using the phone as a second GPU to share the computational load for a locally running Qwen 3.8 27B (IQ4_XS quantization) model.75% similarVerifiedThe Apple M3 Max (128 GB unified memory) can run unquantized 70B models smoothly.74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1009462API
curl https://kongchang.com/api/v1/knowledge/claims/1009462MCP
get_claim(id=1009462)