#BF16

137 related articles

Jul 10, 2026·7 min

Krea2 Tested: Does the FP8 vs BF16 Quality Gap Still Exist?

A Reddit user compared FP8 and BF16 precision on the Krea2 model and found almost no difference in image quality. This article analyzes the technical reasons behind the shrinking quantization gap and its real-world impact on VRAM usage and inference speed.

Jul 28, 2026·3 min

AMD CDNA5 Architecture Deep Dive: Technical Evolution and the AI Computing Competition Landscape

Deep analysis of AMD's CDNA5 architecture covering Chiplet packaging upgrades, HBM memory evolution, and low-precision compute optimization, examining how AMD challenges NVIDIA's AI chip dominance.

Jul 27, 2026·3 min

DeepSeek-OCR Deployment & Fine-Tuning in Practice: From vLLM Inference to Unsloth Fine-Tuning

Complete guide to DeepSeek-OCR from vLLM inference deployment and Unsloth model loading to fine-tuning, covering cloud server setup, GPU selection, and code examples — all on a single 4090 GPU.

Jul 27, 2026·3 min

HuggingHack Update: S3 Storage, Dual-Engine Scheduling, and GGUF Inspection Get Major Upgrades

HuggingHack releases major updates with S3/MinIO storage, Ollama + vLLM dual-engine scheduling, GGUF inspection, and local accounts for enterprise-grade local LLM management.

Jul 27, 2026·4 min

Building Self-Hosted Tunnels Under Extreme Censorship: A Layered Architecture with VLESS Reality

Deep analysis of building layered tunnel architectures using VLESS+Reality to evade DPI and domestic relays with whitelisted IPs to bypass geographic blocking in extreme censorship environments.

Jul 27, 2026·6 min

AmneziaVPN Deep Dive: The Open-Source Powerhouse for Self-Hosted, Censorship-Resistant VPN

Deep dive into the AmneziaVPN open-source client: AmneziaWG anti-DPI obfuscation, self-hosted VPS deployment, multi-protocol support, and cross-platform privacy.

Jul 27, 2026·7 min

DIY Companion Robot: Building Your AI Desktop Buddy with Jetson Orin

A maker builds a DIY companion robot with NVIDIA Jetson Orin and 4S LiPo battery. Explore the full development journey from first power-up to AI interaction, including edge computing, power design, and companion robot trends.

Jul 25, 2026·5 min

DeepSeek's Five-Step Ladder to AGI: A Restrained Roadmap Built on 20,000 GPUs

DeepSeek founder Liang Wenfeng reveals a five-step AGI roadmap—from chain-of-thought to embodied intelligence—under a 20,000-GPU constraint, using the TileLang compiler to break domestic substitution challenges while API cash flow backs AGI exploration.

Jul 25, 2026·3 min

Laguna S 2.1: The Open-Source Coding Model That's 14x Smaller Yet Stronger

Poolside releases Laguna S 2.1, an open-source agentic coding model: 118B total params with only 8B active, scoring 40.4% on DeepSWE — ~4.5x DeepSeek V4 Pro Max. Supports 1M-token context, deployable on a single workstation.

Jul 25, 2026·6 min

How the Creator of Redis Squeezed a 284B-Parameter DeepSeek into an Ordinary Laptop

Redis creator antirez built DS4 "Dwarf Star," a pure-C inference engine, using asymmetric quantization to compress DeepSeek V4 Flash from 500GB to 80.8GB for local 128GB unified-memory deployment at 26.7 tokens/sec.

Jul 25, 2026·6 min

How the Creator of Redis Squeezed a 284-Billion-Parameter DeepSeek Into an Ordinary Laptop

Redis author antirez built the pure-C inference engine DS4 "Dwarf Star," compressing DeepSeek V4 Flash from 500GB to 80.8GB via asymmetric quantization for local deployment on 128GB unified memory at 26.7 tokens/sec.

Jul 25, 2026·3 min

The T-Parameter Era of Open-Source LLMs: Four Chinese AI Companies Break the Trillion-Parameter Barrier

Moonshot AI, Alibaba, DeepSeek, and Meituan all crossed the trillion-parameter threshold. China's open-source LLMs made the B-to-T leap in just 18 months.

Jul 24, 2026·4 min

jlens-gguf: Bringing Jacobian Lens Visualization and Steering to llama.cpp Local LLMs

jlens-gguf is an open-source tool bringing Anthropic's Jacobian Lens interpretability method to GGUF and llama.cpp, enabling internal observation, real-time steering, and abliteration for both dense and MoE models.

Jul 24, 2026·5 min

China Weighs Restricting Top AI Model Exports as DeepSeek Develops Its Own Inference Chip

China's Commerce Ministry weighs restricting overseas access to top open-weight AI models from Alibaba, ByteDance, and DeepSeek, while DeepSeek develops its own inference chip amid a US-China AI export standoff.

Jul 24, 2026·5 min

China Weighs Restricting Top AI Model Exports, While DeepSeek Quietly Builds Its Own Inference Chip

China's Ministry of Commerce is weighing restrictions on overseas access to top open-weight AI models from Alibaba, ByteDance, and DeepSeek. Meanwhile, DeepSeek is quietly building its own inference chip and raising ~$7B in first external funding.

Jul 23, 2026·3 min

Qwen3.8 Deep Dive: How Does a 2.4 Trillion Parameter MoE Model Claim Second Place?

Alibaba's Qwen3.8 challenges larger models with a 2.4T-parameter MoE architecture, claiming second only to Gemini. A deep dive into MoE mechanics, continuous updates, two-speed release strategy, and real local deployment requirements.

Jul 23, 2026·4 min

Qwen-Image 3.0 Released: Image Generation Moves Toward Production-Ready Design

Qwen-Image 3.0 supports 4.5K token instructions, 10px text rendering, and 12-language typography for production-ready posters and infographics. Plus: Anthropic settlement, Grok in Excel, Tencent HRAP 1.0.

Jul 23, 2026·4 min

The Rise of Chinese Open-Source AI Models: A Head-On Challenge to Closed-Source Dominance

Chinese open-source models rapidly close the capability gap with top closed-source AI. DeepSeek shocks the industry while Qwen matches global benchmarks.

Jul 22, 2026·3 min

Qwen's Six-Generation Evolution: A Complete Breakdown from Architecture Innovations to the Reasoning Race

From Qwen1 to Qwen3-2507: a complete breakdown of six generations of evolution over two years — GQA, MoE, GRPO, dynamic thinking, and the core shift from architecture to reasoning.

Jul 21, 2026·3 min

Claude Opus 5 Launch Imminent, Alibaba Qwen Officially Integrated into Apple Intelligence

Claude Opus 5 launches next week; Alibaba Qwen integrates into Apple Intelligence for Chinese users; 27B on-device model compressed to 3.8GB; open-source models narrow gap to closed-source by 3.3%.