#memory bandwidth GPU
410 related articles
Deep Dives·3 min
Google TPU v8t and v8i Deep Dive: The New Era of Separated Training and Inference AI Chips
Google Cloud Next unveils TPU v8t (training) and TPU v8i (inference) chips. Deep analysis of their architecture, strategic significance, and impact on AI chip competition.
Read more →
Industry Insights·3 min
Google Cloud Next 2025: A Deep Dive into the Future of AI Infrastructure
At Google Cloud Next 2025, Amin Vahdat, Jeff Dean, and other tech leaders discuss AI infrastructure evolution, network-compute convergence, TPU development, and the next decade of cloud services.
Read more →
Tutorials·3 min
GPT-OSS-20B Private Deployment Guide: Hardware Selection + Deployment Process + Performance Testing
Complete guide to privately deploying OpenAI's open-source GPT-OSS-20B: GPU selection (RTX 5090/V100/4070Ti), Linux deployment steps, API configuration, and real-world benchmarks with 120B hardware comparison.
Read more →
Expert Opinions·4 min
Is CI/CD Dead? The Continuous Computation Architecture Revolution in the AI Agent Era
Traditional CI/CD pipelines are being shattered by AI Agents. This article analyzes the shift from PR-driven to intent-driven architecture, exploring Pre-Merge queues, stateful environments, and multiverse development as new continuous computation paradigms.
Read more →
Tech Frontiers·3 min
Gemma 4 + DGX Spark: How Open-Source LLMs and Desktop-Level Compute Are Changing AI Development
NVIDIA and Google DeepMind jointly showcase Gemma 4's vision translation, long-context Q&A, and real-time code generation on DGX Spark, signaling the convergence of open-source AI and edge compute.
Read more →
Product Reviews·4 min
Razer Blade 18 Review: Is the $500 Price Hike Worth It for the Ultra 9 290HX Plus?
The 2025 Razer Blade 18 packs Intel Core Ultra 9 290HX Plus and RTX 5070 Ti/5090 GPUs, starting at $3,999. Deep dive into the processor upgrade, Blackwell GPU performance, and whether the $500 price hike is justified.
Read more →
Tech Frontiers·3 min
NVIDIA Nemotron Hackathon Korea Winners Announced: Asia-Pacific AI Developers Showcase Their Strength
NVIDIA Nemotron Hackathon Korea winners officially announced, showcasing Korean AI developer innovation. Analysis of Nemotron LLM ecosystem, Korea's AI landscape, and NVIDIA's global developer strategy.
Read more →
Expert Opinions·3 min
Sequoia Capital's Conversation with AI Expert: How the Von Neumann Architecture Shapes the Future of AI
Sequoia Capital's deep conversation with AI expert Konstantine explores how von Neumann's architecture and ideas profoundly shape modern AI development, from computing paradigms to the pursuit of AGI.
Read more →
Tutorials·3 min
4-bit QLoRA Fine-tuning LLaMA 3 in Practice: A Guide to Training 8 Billion Parameter LLMs on Consumer GPUs
Learn how to fine-tune LLaMA 3 8B on consumer GPUs using QLoRA and Unsloth. Covers 4-bit quantization, LoRA adaptation, Alpaca data format, training pipeline setup, and model deployment—runs on RTX 3090.
Read more →
Research·3 min
SVDQuant: 4-bit Quantization Enables Efficient Diffusion Model Inference on Consumer GPUs
SVDQuant, an ICLR 2025 Spotlight paper, achieves 4-bit diffusion model quantization via low-rank decomposition that absorbs outliers, reducing memory by 75%. Open-source engine Nunchaku (3800+ stars) enables FLUX inference on consumer GPUs like RTX 4060.
Read more →
Product Reviews·3 min
The Complete Guide to AnythingLLM: A Privacy-First AI Assistant for Local Deployment
Deep dive into AnythingLLM: a privacy-first, zero-config open-source local AI tool. Supports RAG, multi-model switching, and document chat. Nearly 60K GitHub Stars, ideal for enterprise and personal local deployment.
Read more →
Tutorials·3 min
Unsloth Tutorial: Fine-Tune LLMs Locally with Multi-fold Speed Boost and 60% VRAM Savings
Unsloth is an open-source LLM fine-tuning tool with 63K GitHub stars, supporting Gemma 4, Qwen3, and DeepSeek. It achieves multi-fold training speedup and 60% VRAM reduction through kernel optimization, enabling fine-tuning on consumer GPUs.
Read more →
Product Reviews·3 min
Cube Studio: Tencent's Open-Source One-Stop AI Platform — A Deep Dive into Full MLOps Lifecycle
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering Notebook development, Pipeline orchestration, distributed training, LLM fine-tuning, inference deployment, and domestic hardware adaptation for full MLOps lifecycle.
Read more →
Product Reviews·1 min
Unsloth: An Efficient Open-Source Tool for Local LLM Fine-Tuning
Unsloth is a 63,000+ star open-source project on GitHub with a Web UI for locally training and fine-tuning LLMs like Gemma 4, Qwen3, and DeepSeek on consumer GPUs.
Read more →
Tutorials·3 min
Ollama Tutorial: The Complete Guide to Running Large Models Locally (2025 Updated)
Complete guide to deploying LLMs locally with Ollama. Supports DeepSeek, Qwen, Kimi-K2.5 and more. 170K GitHub Stars, one-click install, full data privacy, zero API costs.
Read more →
Tutorials·2 min
Ollama Tutorial: Complete Guide to Running DeepSeek, Qwen, and Other LLMs Locally with One Click
Complete guide to Ollama: install and run DeepSeek, Qwen, Kimi-K2.5, GLM-5 and more LLMs locally. 170K+ GitHub Stars, the most popular local LLM framework for offline AI inference and privacy.
Read more →
Tech Frontiers·3 min
Osaurus: A Native macOS Offline AI Agent Framework — 5,000+ Star Open Source Project Deep Dive
Deep dive into Osaurus — a native macOS AI agent framework supporting fully offline operation, persistent memory, cryptographic identity, and arbitrary model integration. Built with Swift and C for Apple Silicon. 5,100+ GitHub stars.
Read more →
Product Reviews·4 min
Cube Studio: Tencent's Open-Source All-in-One AI Platform Covering the Full Pipeline from Large Model Training to Inference
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning, vLLM inference, VGPU virtualization, and Huawei Ascend adaptation.
Read more →
Product Reviews·4 min
Deep Dive into Cube Studio: Tencent's Open-Source All-in-One AI Platform
Deep dive into Tencent's open-source AI platform Cube Studio, covering distributed training, large model fine-tuning and inference, Pipeline orchestration, VGPU virtualization, and Huawei Ascend support for enterprise cloud-native MLOps.
Read more →
Product Reviews·2 min
Unsloth: The Open-Source Tool for Fine-Tuning LLMs on a Single GPU with 70% Less VRAM
Unsloth is an open-source LLM fine-tuning tool with 63K+ GitHub stars. Fine-tune Gemma 4, Qwen 3, DeepSeek on a single RTX 3090 with 70% less VRAM, 2-5x faster training, and an intuitive Web UI.
Read more →