#CUDA performance tuning
133 related articles
·2 min
antirez Strikes Again: ds4, a Pure C Local Inference Engine for DeepSeek 4
Redis creator antirez open-sources ds4, a pure C local inference engine for DeepSeek 4 Flash and PRO with native Metal, CUDA, and ROCm support, earning nearly 20K GitHub stars.
Read more →
·4 min
SELENE Open-Source Project: An Interactive Notebook Library for Systematically Learning AI and Machine Learning from Scratch
SELENE is an open-source AI learning resource built on Jupyter Notebooks, systematically covering ML, deep learning, Transformers, and LLMs with interactive code and math derivations for beginners.
Read more →
·3 min
MI355X Running Kimi K3 Benchmark: The Logic Behind Outperforming B300 in Performance per Dollar
Deep analysis of AMD MI355X running Kimi K3 with superior cost-efficiency vs NVIDIA B300, and its implications for the AI inference hardware market.
Read more →
·3 min
GPT-5.6 Sol Self-Optimization in Practice: How AI Cuts Its Own Costs and Boosts Its Own Efficiency
GPT-5.6 Sol achieves 20% GPU serving cost reduction and 15%+ token generation efficiency gains through self-optimization. A deep dive into AI recursive efficiency improvement.
Read more →
·3 min
Practical Guide to Setting Up a Local AI Coding Environment on MacBook Pro M4
Complete guide to setting up a local AI coding environment on MacBook Pro M4, covering Ollama, MLX, Continue, Qwen3-Coder 30B configuration, and performance optimization strategies for 32GB RAM.
Read more →
·3 min
GPT-5.6 Autonomously Optimizes Its Own Kernels: How AI Recursive Self-Improvement Could Cut Service Costs by 20%
OpenAI's internal model GPT-5.6 reportedly autonomously rewrites production kernels, achieving ~20% service cost reduction. Deep analysis of this AI recursive self-optimization event's technical plausibility and industry impact.
Read more →
·3 min
GPT-5.6 Autonomously Optimizes Its Own Kernels: How AI Recursive Self-Improvement Could Cut Service Costs by 20%
OpenAI's internal model GPT-5.6 reportedly autonomously rewrote production compute kernels, achieving ~20% cost reduction. Deep analysis of this AI recursive self-optimization event's technical plausibility, industry impact, and key questions.
Read more →
·3 min
GitHub Daily · July 29: Voice AI and On-Device Training Take Flight as Open-Source Alternatives Rise
GitHub Trending July 29: Microsoft's VibeVoice leads voice AI open-source wave, MoonshotAI's FlashKDA CUDA kernel surges 25%, and open-source alternatives rise.
Read more →
·3 min
Jensen Huang's First Tweet Backs AI Open Source — But It's Really About NVIDIA's Ecosystem Anxiety
Jensen Huang's first tweet backs AI open source, but behind it lies NVIDIA's deep anxiety over CUDA ecosystem displacement. We analyze why open-source models matter and what's really at stake.
Read more →
·3 min
Jensen Huang's First X Post Backs Open AI: Why the Computing Power King Sides with Open Source
NVIDIA CEO Jensen Huang's first X post champions open AI access. We analyze the business logic, policy dynamics, and the open vs. closed AI debate shaping the industry.
Read more →
·3 min
DeepSeek-OCR Deployment & Fine-Tuning in Practice: From vLLM Inference to Unsloth Fine-Tuning
Complete guide to DeepSeek-OCR from vLLM inference deployment and Unsloth model loading to fine-tuning, covering cloud server setup, GPU selection, and code examples — all on a single 4090 GPU.
Read more →
·2 min
Jensen Huang Praises DeepSeek and Kimi: Markets Have Twice Misjudged the Impact of Chinese Open-Source Models
NVIDIA CEO Jensen Huang says markets have twice misjudged the impact of DeepSeek and Kimi, arguing Chinese open-source models boost rather than reduce overall AI compute demand.
Read more →
·2 min
RX 9060 XT vs RTX 5060 Ti: Which GPU to Pick for Local AI?
RX 9060 XT vs RTX 5060 Ti — both 16GB VRAM, but which is better for local AI? We compare CUDA ecosystem, ROCm compatibility, LLM inference, and real-world usability.
Read more →
·2 min
RX 9060 XT vs RTX 5060 Ti: How to Choose a GPU for Local AI
RX 9060 XT vs RTX 5060 Ti both offer 16GB VRAM — which is better for local AI inference? A full comparison of CUDA ecosystem, ROCm compatibility, LLM performance, and real-world usability.
Read more →
·7 min
DIY Companion Robot: Building Your AI Desktop Buddy with Jetson Orin
A maker builds a DIY companion robot with NVIDIA Jetson Orin and 4S LiPo battery. Explore the full development journey from first power-up to AI interaction, including edge computing, power design, and companion robot trends.
Read more →
·5 min
Why Are China's Open-Source AI Models Getting Stronger? A Deep Dive Into Three Comeback Strategies
Facing US chip bans and closed-source monopoly, how do China's open-source AI models keep fighting back? A deep dive into three core paths: open-source pricing games, optical interconnect positioning, and on-device scenarios.
Read more →
·5 min
Why Are China's Open-Source AI Models Getting Stronger? A Deep Dive into Three Comeback Paths
Facing US chip bans and closed-source monopolies, how do China's open-source AI models keep striking back? A deep dive into three core paths: open-source pricing-power games, optical interconnect positioning, and edge-side use cases.
Read more →
·5 min
Liang Wenfeng's In-Depth Confession: DeepSeek's Philosophy of Restraint, Open-Source Strategy, and AGI Roadmap
DeepSeek founder Liang Wenfeng systematically explains: a KPI-free culture, 10-month break-even pricing, long-term open-source strategy, continual learning to break the AGI bottleneck, and his prediction of a mature domestic chip ecosystem within a year.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics in Model Quantization and Inference Deployment
A systematic review of must-know topics for AI Application Engineer interviews: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics on Model Quantization and Inference Deployment
A systematic guide to must-know AI application engineer interview topics: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →