#Qwen compression

159 related articles

Jul 25, 2026·3 min

DeepSeek Open-Sources DeepSpec: A Full-Stack Speculative Decoding Library with 60–85% Inference Speedup

DeepSeek open-sources DeepSpec, a full-stack speculative decoding library delivering 60–85% inference speedup and up to 661% throughput gains in production. MIT license, 9 checkpoints, 9 benchmarks.

Jul 25, 2026·3 min

How China's Open-Source LLMs Are Closing In on America's Closed-Source Giants

Kimi, Alibaba Qwen, and DeepSeek leverage MoE architecture, home-field data advantages, and the open-source flywheel to close in on OpenAI and Anthropic at ultra-low cost. A deep dive into China's open-source LLM catch-up.

Jul 25, 2026·6 min

How the Creator of Redis Squeezed a 284B-Parameter DeepSeek into an Ordinary Laptop

Redis creator antirez built DS4 "Dwarf Star," a pure-C inference engine, using asymmetric quantization to compress DeepSeek V4 Flash from 500GB to 80.8GB for local 128GB unified-memory deployment at 26.7 tokens/sec.

Jul 25, 2026·6 min

How the Creator of Redis Squeezed a 284-Billion-Parameter DeepSeek Into an Ordinary Laptop

Redis author antirez built the pure-C inference engine DS4 "Dwarf Star," compressing DeepSeek V4 Flash from 500GB to 80.8GB via asymmetric quantization for local deployment on 128GB unified memory at 26.7 tokens/sec.

Jul 25, 2026·3 min

The T-Parameter Era of Open-Source LLMs: Four Chinese AI Companies Break the Trillion-Parameter Barrier

Moonshot AI, Alibaba, DeepSeek, and Meituan all crossed the trillion-parameter threshold. China's open-source LLMs made the B-to-T leap in just 18 months.

Jul 24, 2026·4 min

Complete Guide: Connecting DeepSeek and Other Chinese LLMs to Codex

No ChatGPT account? No problem. Learn how to connect DeepSeek and other Chinese LLMs to Codex using the Codex++ management tool — including Base URL setup, API Key creation, and token top-up.

Jul 24, 2026·3 min

LoRA Fine-tuning or Prompt Engineering? Two Paths to Solving LLM Long-Conversation Memory

A developer fine-tunes a small model with LoRA to extract conversation state, tackling the LLM long-conversation memory problem. A deep dive into the technical approach, dataset design, and the real trade-offs between fine-tuning and prompt engineering.

Jul 24, 2026·4 min

Spring AI 1.0 Practical Guide: A Java Developer's Fast Track to Building AI Applications

Spring AI 1.0 is here — Java developers can now build AI apps without switching to Python. This guide covers LLM integration, RAG, intelligent customer service, and Agent patterns for enterprise deployment.

Jul 24, 2026·7 min

DeepSeek's Mysteriously Retracted Paper: Breaking AI's Multimodal Reasoning Bottleneck with Visual Primitives

DeepSeek's paper 'Thinking with Visual Primitives' was online for just 4 hours before being pulled. It uses bounding boxes and points as reasoning primitives, letting models 'point at' images to outperform GPT, Gemini, and Claude on maze navigation and counting.

Jul 23, 2026·6 min

Hands-On with Qwen 3.8 Max: How an Open-Source Model Closes In on Top-Tier Closed Models

Qwen 3.8 Max has 2.4 trillion parameters and will be open-sourced. In KingBench testing it scored 81.25%, ranking second, beating Claude Opus 4.8 and trailing only Fable 5. A deep dive into its performance across 8 tests.

Jul 23, 2026·7 min

Qwen3 235B A22B in Practice: A 2.4-Trillion-Parameter Open Model Surpasses Claude Opus

Hands-on with Alibaba Tongyi Qianwen's strongest Qwen3: a 2.4-trillion-parameter open weight model scoring 81.25% on KingBench, ranking second and beating Claude Opus 4.8 with perfect scores in game dev, math, and agent tasks.

Jul 23, 2026·6 min

Tongyi Qianwen Qwen-Image-3.0: The Leap of AI Image Generation from Toy to Productivity Tool

Tongyi Qianwen Qwen-Image-3.0 image generation model gets a comprehensive upgrade: supporting 4,500-token ultra-long instructions, pixel-level detail rendering, 12-language knowledge understanding, and ancient painting restoration. This article analyzes its three core capabilities.

Jul 23, 2026·4 min

Open Source AI Closes the Gap: How Chinese Models Are Challenging America's AI Dominance

From DeepSeek to Kimi K3 and Qwen 3, Chinese open source AI models are closing in on OpenAI and Anthropic at stunning speed. A deep dive into narrowing gaps, IPO valuation risks, the "open source decelerationism" debate, and why Google may be the biggest winner.

Jul 23, 2026·7 min

AI Daily: T-Head Open-Sources SAIL Software Stack at WAIC, Flurry of Large Model Releases

T-Head open-sources AI software stack T-Head SAIL at WAIC to lower the barrier for domestic chip development; Kimi K3 tops the WebDev leaderboard; Qwen 3.8 Max Preview cuts prices aggressively; Moonshot prepares a Hong Kong IPO; and Oracle switches its data center to a fuel cell microgrid.

Jul 23, 2026·3 min

China's AI Labs Strike Back: Qwen, DeepSeek, and Kimi Reshape the Frontier Model Landscape

Qwen launches a massive open-weight model, DeepSeek V4 priced at $0.0028/M tokens, Kimi K3 hits compute limits — Chinese AI labs are aggressively disrupting OpenAI and Anthropic's frontier model dominance.

Jul 23, 2026·4 min

The Rise of Chinese Open-Source AI Models: A Head-On Challenge to Closed-Source Dominance

Chinese open-source models rapidly close the capability gap with top closed-source AI. DeepSeek shocks the industry while Qwen matches global benchmarks.

Jul 22, 2026·4 min

DeepSeek Open-Sources DeepSpec: A Full-Stack Breakdown of Speculative Decoding

DeepSeek open-sources DeepSpec, a full speculative decoding training and evaluation toolkit featuring three draft model algorithms (Ego3, DeepFlash, DeepSpark), 12 checkpoints, MIT license, and 60–85% real-world speedup.

Jul 21, 2026·3 min

27B Parameter LLM on an iPhone? A Deep Dive into On-Device Full-Parameter AI

Startup Prismo claims to compress a 27B-parameter model to 4GB for full local inference on iPhone 17 Pro. We break down the compression tech, compare it to Apple's MoE approach, and assess real-world limits.

Jul 21, 2026·3 min

Claude Opus 5 Launch Imminent, Alibaba Qwen Officially Integrated into Apple Intelligence

Claude Opus 5 launches next week; Alibaba Qwen integrates into Apple Intelligence for Chinese users; 27B on-device model compressed to 3.8GB; open-source models narrow gap to closed-source by 3.3%.

Local AI Models vs. Cloud: This Tech J…

Jul 21, 2026·2 min

Local AI Models vs. Cloud: This Tech Judgment Call Is Testing Your Thinking

"Your opinion on local AI is an IQ test" — this viral claim reveals the cognitive divide between local and cloud AI deployment, from data sovereignty to TCO.