#GPU memory optimization
783 related articles
Deep Dives·3 min
Google TPU v8t and v8i Deep Dive: The New Era of Separated Training and Inference AI Chips
Google Cloud Next unveils TPU v8t (training) and TPU v8i (inference) chips. Deep analysis of their architecture, strategic significance, and impact on AI chip competition.
Read more →
Industry Insights·3 min
Google Cloud Next 2025: A Deep Dive into the Future of AI Infrastructure
At Google Cloud Next 2025, Amin Vahdat, Jeff Dean, and other tech leaders discuss AI infrastructure evolution, network-compute convergence, TPU development, and the next decade of cloud services.
Read more →
Deep Dives·3 min
Alibaba's QwQ-32B Open-Sourced: How 32B Parameters Rival DeepSeek R1's 671B
Alibaba's open-source reasoning model QwQ-32B achieves performance rivaling DeepSeek R1 (671B) with only 32B parameters through a two-stage reinforcement learning strategy on verifiable tasks.
Read more →
Tutorials·3 min
GPT-OSS Open-Source Model Local Deployment Tutorial: Real-World Performance and VRAM Usage Analysis
Complete guide to deploying OpenAI's open-source GPT-OSS model locally with Ollama. Real-world testing of the 20B version on RTX 4090 covering Chinese comprehension, logical reasoning, and VRAM usage analysis under MoE architecture.
Read more →
Tutorials·4 min
Whisper Local Deployment Guide: Step-by-Step Setup for a Free Speech-to-Text Tool
Step-by-step tutorial for locally deploying OpenAI Whisper speech recognition, covering Conda setup, PyTorch installation, model selection, and transcription operations with free SRT subtitle generation.
Read more →
Tutorials·3 min
Build a Local Image Generation MCP Server with One Prompt: Let Codex Batch Generate and Edit Images
Learn how to build a local image generation MCP Server with one Prompt, letting Codex call Flux models for zero-token batch image generation and editing.
Read more →
Tutorials·4 min
2025 LLM Career Transition Roadmap: A Three-Phase Plan from Foundations → Frameworks → Real-World Projects
A systematic 2025 LLM career transition roadmap covering Python, Transformers, LangChain, LlamaIndex, RAG, Agent development, and fine-tuning across three phases achievable in 2-3 months.
Read more →
Tech Frontiers·3 min
OpenAI Codex Hits Mobile: The AI Programming Tool Ecosystem War Goes Full Scale
OpenAI Codex integrates with ChatGPT mobile, Microsoft tightens Claude Code licensing, Tencent open-sources Agent Memory cutting tokens by 61%, NVIDIA launches Rubin platform, RSI valued at $4.6B.
Read more →
Expert Opinions·4 min
Is CI/CD Dead? The Continuous Computation Architecture Revolution in the AI Agent Era
Traditional CI/CD pipelines are being shattered by AI Agents. This article analyzes the shift from PR-driven to intent-driven architecture, exploring Pre-Merge queues, stateful environments, and multiverse development as new continuous computation paradigms.
Read more →
Tech Frontiers·3 min
Mistral AI Teams Up with NVIDIA to Build Open-Source AI Models — How Will This Partnership Reshape the Industry?
Mistral AI and NVIDIA announce a strategic partnership to co-develop frontier open-source AI models. A deep analysis of the collaboration's background, technical synergies, and impact on the open vs. closed source AI landscape.
Read more →
Tech Frontiers·3 min
NVIDIA Nemotron Hackathon Korea Winners Announced: Asia-Pacific AI Developers Showcase Their Strength
NVIDIA Nemotron Hackathon Korea winners officially announced, showcasing Korean AI developer innovation. Analysis of Nemotron LLM ecosystem, Korea's AI landscape, and NVIDIA's global developer strategy.
Read more →
Tutorials·3 min
Deploying Gemma 4 on DGX Spark: A Complete Guide to Local AI Supercomputing + Open-Source LLMs
Deep dive into deploying Google Gemma 4 on NVIDIA DGX Spark. Covers hardware architecture, Gemma 4 highlights, local AI deployment benefits, and developer best practices for desktop-class AI supercomputing.
Read more →
Expert Opinions·3 min
Sequoia Capital's Conversation with AI Expert: How the Von Neumann Architecture Shapes the Future of AI
Sequoia Capital's deep conversation with AI expert Konstantine explores how von Neumann's architecture and ideas profoundly shape modern AI development, from computing paradigms to the pursuit of AGI.
Read more →
Deep Dives·3 min
Microsoft Tutel: A Deep Dive into the MoE Model Acceleration Library with FP4/FP8 Low-Precision Support
A deep dive into Microsoft's open-source Tutel MoE optimization library, supporting FP8, NVFP4, and MXFP4 multi-precision computation for DeepSeek, Kimi-K2, Qwen3, and other leading MoE models.
Read more →
Tutorials·3 min
4-bit QLoRA Fine-tuning LLaMA 3 in Practice: A Guide to Training 8 Billion Parameter LLMs on Consumer GPUs
Learn how to fine-tune LLaMA 3 8B on consumer GPUs using QLoRA and Unsloth. Covers 4-bit quantization, LoRA adaptation, Alpaca data format, training pipeline setup, and model deployment—runs on RTX 3090.
Read more →
Product Reviews·3 min
awesome-LLM-resources: A Comprehensive Analysis of the 8,200-Star LLM Learning Resource Repository on GitHub
In-depth analysis of the 8,200-star GitHub project awesome-LLM-resources, covering multimodal generation, Agents, model training, MCP protocol, and more — a one-stop LLM learning guide.
Read more →
Tech Frontiers·2 min
Cursor Launches Claude Opus 4 Fast Mode: 2.5x Faster, 6x More Expensive — Is It Worth It?
Cursor launches Claude Opus 4 Fast Mode with 2.5x speed but 6x cost. We analyze use cases, cost tradeoffs, and practical tips to help you decide if it's worth it.
Read more →
Deep Dives·4 min
Hugging Face Transformers: Deep Dive into the 160K-Star Open Source AI Framework
Deep dive into Hugging Face Transformers: the 160K-Star open-source framework covering Pipeline API, Auto Classes, multi-modal models, and the full HF ecosystem for AI inference and training.
Read more →
Product Reviews·3 min
Cube Studio: A Comprehensive Analysis of Tencent's Open-Source Cloud-Native AI Platform
Deep dive into Tencent Music's open-source Cube Studio cloud-native AI platform, covering distributed training, LLM fine-tuning & inference, Pipeline orchestration, and domestic hardware adaptation.
Read more →
Tutorials·3 min
GitHub 8K Stars: Deep Dive into the Most Comprehensive LLM Resource Repository
Deep analysis of the GitHub project awesome-LLM-resources with 8,200+ Stars, covering multimodal AI, Agents, MCP protocol, model training, inference optimization, and coding assistants.
Read more →