#CUDA optimization
258 related articles
·5 min
Why Are China's Open-Source AI Models Getting Stronger? A Deep Dive Into Three Comeback Strategies
Facing US chip bans and closed-source monopoly, how do China's open-source AI models keep fighting back? A deep dive into three core paths: open-source pricing games, optical interconnect positioning, and on-device scenarios.
Read more →
·5 min
Why Are China's Open-Source AI Models Getting Stronger? A Deep Dive into Three Comeback Paths
Facing US chip bans and closed-source monopolies, how do China's open-source AI models keep striking back? A deep dive into three core paths: open-source pricing-power games, optical interconnect positioning, and edge-side use cases.
Read more →
·5 min
Liang Wenfeng's In-Depth Confession: DeepSeek's Philosophy of Restraint, Open-Source Strategy, and AGI Roadmap
DeepSeek founder Liang Wenfeng systematically explains: a KPI-free culture, 10-month break-even pricing, long-term open-source strategy, continual learning to break the AGI bottleneck, and his prediction of a mature domestic chip ecosystem within a year.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics in Model Quantization and Inference Deployment
A systematic review of must-know topics for AI Application Engineer interviews: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics on Model Quantization and Inference Deployment
A systematic guide to must-know AI application engineer interview topics: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →
·3 min
DeepSeek's In-House AI Chip: A Critical Step Toward Breaking China's NVIDIA Dependence
DeepSeek is reportedly developing its own AI chip, moving from algorithms to hardware to achieve software-hardware co-optimization. An in-depth analysis of its strategic rationale, key challenges, and implications for China's AI industry autonomy.
Read more →
·6 min
The AI Industrial Age Arrives: Compute Wars, Chip Reconstruction, and the GPT-5.6 Cheating Scandal Explained
Five key AI industry trends: Doubao surpasses 180 trillion daily calls, OpenAI's in-house AI chip, NVIDIA's $3-4 trillion compute forecast, China catching up, and the GPT-5.6 cheating scandal.
Read more →
·6 min
Hands-On with Panel AI On-Premises Deployment: One-Click Enterprise Adoption and Unified Compute Cluster Scheduling
In-depth review of Panel AI v1.1.1: second-level installation, no-public-IP networking, batch compute cluster management. Learn how enterprise AI on-premises deployment barriers are dramatically lowered.
Read more →
·4 min
Dify Local Deployment Guide: One-Click Private AI Platform with Docker
Step-by-step guide to deploying Dify AI platform locally with Docker. Covers Linux, Windows, macOS setup, docker compose launch, and first-time initialization in under 30 minutes.
Read more →
·3 min
InvokeAI In-Depth Review: Can It Replace SD WebUI and ComfyUI?
A hands-on InvokeAI review covering installation, VRAM optimization, infinite canvas, node workflows, and model management — with an objective comparison to SD WebUI and ComfyUI.
Read more →
·7 min
AI Daily: T-Head Open-Sources SAIL Software Stack at WAIC, Flurry of Large Model Releases
T-Head open-sources AI software stack T-Head SAIL at WAIC to lower the barrier for domestic chip development; Kimi K3 tops the WebDev leaderboard; Qwen 3.8 Max Preview cuts prices aggressively; Moonshot prepares a Hong Kong IPO; and Oracle switches its data center to a fuel cell microgrid.
Read more →
·4 min
The Rise of Chinese Open-Source AI Models: A Head-On Challenge to Closed-Source Dominance
Chinese open-source models rapidly close the capability gap with top closed-source AI. DeepSeek shocks the industry while Qwen matches global benchmarks.
Read more →
·7 min
Alibaba Open-Sources 2.4T Qwen Model as Chinese AI Sweeps the Global Competitive Landscape
Alibaba open-sources a 2.4 trillion parameter Qwen model and launches the Qwen Token Plan. Chinese models surge, Kimi K3 tops global rankings, and China's AI is reshaping the global competitive landscape.
Read more →
·2 min
Agent A1 Open Source: 35B MoE Local Inference Speed Test & Deployment Guide
Agent A1 is a 35B MoE open-source model from Shanghai's Intern Science, activating only 3B params. Hits 95 tok/s on M4 Mac Studio. Supports 256K context, tool calling, and free local deployment via Ollama.
Read more →
llmfit: One Command to Check Which Loc…
·2 min
llmfit: One Command to Check Which Local LLMs Your Hardware Can Run
llmfit is an open-source Rust CLI tool that predicts whether your local hardware can run a given LLM — no model download required. Covers hundreds of models and backends like Ollama and llama.cpp.
Read more →
CS Self-Study Guide: The 74K-Star Comp…
·2 min
CS Self-Study Guide: The 74K-Star Computer Science Learning Roadmap
A 74K-star GitHub project by Peking University students curates MIT, Stanford, and CMU open courses into a complete CS self-study roadmap covering algorithms, OS, databases, and more.
Read more →
transcribe.cpp: A Unified Speech Recog…
·2 min
transcribe.cpp: A Unified Speech Recognition Engine Built on ggml, Supporting 16+ Model Families
transcribe.cpp is an open-source ggml-based speech recognition engine supporting 16+ model families in a single C++ codebase — lightweight, cross-platform, and quantization-ready for local STT.
Read more →
·3 min
Bernini Tile-Based Generation: An Engineered Approach to Video Super-Resolution in ComfyUI
Bernini is a ComfyUI video super-resolution node package using Tile Split/Select/Merge to solve seams, drift, and VRAM overflow. Benchmarked at 325s for 39 frames at 1920×1080.
Read more →
Handwritten C/CUDA Inference Engine: P…
·2 min
Handwritten C/CUDA Inference Engine: Pushing Qwen 35B to the Limits on RTX 5090
A deep dive into a handwritten C/CUDA inference engine for Qwen 35B on RTX 5090 (Blackwell), covering quantization, FlashAttention kernels, and memory optimization.
Read more →
GitHub Daily · July 19: The Dual Advan…
·3 min
GitHub Daily · July 19: The Dual Advance of Heterogeneous Inference and Agent Toolchains
GitHub Trending July 19: ktransformers tops the list with heterogeneous inference optimization, while jcode, cua, and AstrBot signal a maturing Agent ecosystem.
Read more →