#CUDA AI inference
358 related articles
Tech Frontiers·2 min
SGLang v0.5.12.post1 Released: DeepSeek V4 Stability Fixes and Blackwell Adaptation
SGLang v0.5.12.post1 stability patch details: 12 critical fixes covering DeepSeek V4 garbled text and crashes, NIXL PD disaggregated inference logic, Blackwell B300 adaptation, and cold start optimization.
Read more →
Industry Insights·2 min
AMD MI355X Beats B200: Full-Stack Optimization Breakdown for 5% Lower TCO on DeepSeek-R1 Inference
AMD Instinct MI355X achieves 5% lower TCO than NVIDIA B200 on DeepSeek-R1 disaggregated inference via SGLang+MoRI full-stack optimization with 1.25x per-GPU throughput.
Read more →
Industry Insights·3 min
Deep Dive into Three Major LLM Career Paths: Requirements, Tech Stacks, and Career Prospects
Deep analysis of three core LLM roles—Application Engineer, Development Engineer, and Algorithm Engineer—covering technical requirements, salary thresholds, and career prospects including RAG, fine-tuning, and inference deployment.
Read more →
Product Reviews·3 min
AIStarter and PanelAI Architecture Upgrade Explained: The Evolution of an All-in-One AI Toolbox
Deep dive into AIStarter and PanelAI architecture upgrades covering project market, model management, AI assistant features, and pricing strategy for this all-in-one AI toolbox.
Read more →
Product Reviews·3 min
WaLiCode v0.2.0: Indie AI IDE Adds Multi-Project Chat and Task Decomposition
Indie developer releases AI IDE WaLiCode v0.2.0 with multi-project chat, task decomposition mode, and Ollama local model support, addressing pain points in mainstream AI IDEs.
Read more →
Industry Insights·2 min
NVIDIA Dynamo Snapshot: A Snapshot Recovery Solution for GPU Inference Cold Start Problems
Deep dive into how NVIDIA Dynamo Snapshot reduces LLM inference cold start time from minutes to seconds via GPU state snapshot and recovery, covering Kubernetes integration and elastic inference.
Read more →
Tutorials·3 min
Running AI Models on a P106 Mining GPU: Build a Local AI Workstation for Under $10
Build a local AI workstation with a P106 mining GPU for under $10. Run Live Portrait and other AI models locally with full privacy, zero marginal cost, and incredible value.
Read more →
Tutorials·3 min
LLM Learning Roadmap: A Complete Guide from Beginner to Project Implementation Across Seven Core Modules
A systematic breakdown of seven core LLM learning modules covering environment setup, Prompt Engineering, RAG, Agents, dev frameworks, fine-tuning, and hands-on projects for developers.
Read more →
Tutorials·2 min
Complete Guide to Local LLM Deployment with Ollama: AI That Works Offline
Complete guide to deploying open-source LLMs locally with Ollama. Covers installation, model selection, VRAM requirements, and performance comparison of Llama 3 and Qwen models. Free, offline-capable AI.
Read more →
Product Reviews·3 min
DLSS 4.5 Deep Integration with UE5 and Multilingual AI Characters: Major NVIDIA RTX Game Development Update
NVIDIA releases major RTX update with DLSS 4.5 deep UE5 integration for frame generation performance leaps and multilingual AI characters supporting dynamic dialogue with real-time speech synthesis.
Read more →
Product Reviews·1 min
NVIDIA CompileIQ: Auto-Tuning Compiler Options to Squeeze Every Drop of GPU Kernel Performance
Deep dive into NVIDIA CompileIQ auto-tuning tool that intelligently searches compiler option combinations to find optimal build parameters for CUDA kernels.
Read more →
Tutorials·1 min
NVIDIA CUDA Tile: A Detailed Look at the New Tile-Based GPU Programming Paradigm
In-depth analysis of NVIDIA's new CUDA Tile programming model: how tile-based GPU kernel development integrates with C++, optimizes data locality, and accelerates Tensor Core computation for HPC, deep learning, and AI inference.
Read more →
Tech Frontiers·2 min
Anthropic's Compute Expansion Explained: How More Chips Make Claude Stronger and Faster
Anthropic announces a massive compute expansion with "More chips, more Claude." This article analyzes the impact on user experience, service capacity, response speed, and next-gen models.
Read more →
Industry Insights·2 min
SpaceX Investing $55 Billion to Build AI Chip Factory Terafab in Texas
SpaceX plans to invest $55 billion in Austin, Texas to build an AI chip factory called Terafab — a key step in Elon Musk's vertical AI integration empire and one of the largest U.S. chip investments ever.
Read more →
Industry Insights·2 min
In-Depth Analysis of C++ + AI Full-Stack Training Programs: Career Transition Paths for Developers in 2026
An in-depth analysis of C++ + AI full-stack training programs covering CUDA, YOLO, RAG, and interest-aligned employment guarantees for C++ developers transitioning to AI roles.
Read more →
Tutorials·1 min
Ollama Local LLM Deployment Tutorial: Complete Guide from Installation to API Integration
Complete guide to deploying open-source LLMs locally with Ollama, covering installation, model selection, quantization strategies, Python API integration, and performance optimization tips.
Read more →
Product Reviews·2 min
DeepSeek V4 Deep Dive: Three Major Innovations — Hybrid Attention, Manifold-Constrained Hyperconnections, and MOM Optimizer Fully Explained
Deep dive into DeepSeek V4's three core innovations: Hybrid Attention for million-token context, Manifold-Constrained Hyperconnections, and MOM Optimizer. Pro model rivals Claude Opus 4.6 at 1/7 the cost.
Read more →
Tech Frontiers·1 min
Jensen Huang Admits Huawei Is Formidable: NVIDIA Has Ceded China's AI Chip Market
NVIDIA CEO Jensen Huang calls Huawei "very powerful" and admits NVIDIA has ceded China's AI chip market to domestic players. A deep dive into the implications.
Read more →
Tutorials·2 min
FastEmbed Tutorial: Installation and Practical Guide for a Lightweight Local Vector Embedding Library
A detailed guide to FastEmbed, a lightweight Python embedding library covering installation, text and image embedding usage, and seamless Qdrant vector database integration for building local AI apps without GPU.
Read more →
Tutorials·2 min
ONNX Model Deployment in Practice: A Complete Guide from PyTorch Export to Cross-Framework Inference
Complete guide to ONNX neural network exchange format: PyTorch and TensorFlow model export, ONNX Runtime inference, MNIST classifier deployment, and HuggingFace model downloads with runnable code examples.
Read more →