ModelQwen2.5 7B / 通义千问2.5 7B
Qwen2.5 7B
A 7-billion-parameter open-source large language model released by Alibaba's Qwen team, supporting a 128K context and employing a GQA architecture.
Timeline (last 90 days)
Oct 11
Testing with a 4-bit quantized Qwen2.5 7B model on an M2 Mac mini with 16 GB unified memory, throughput dropped from 16.8 tokens/s without batching to 8.7 tokens/s with batching.
Unverified50%