#hardware-software co-design
15 related articles
Hardware-Software Co-Design: A Guide t…
·2 min
Hardware-Software Co-Design: A Guide to Building Hardware-Friendly LLM Architectures
Explore AI Model Co-Design principles and how hardware-friendly LLM architecture design — covering MoE, GQA, and FP8 quantization — optimizes the accuracy, throughput, and latency trade-off.
Read more →
·5 min
Running GPT-5.6 Inside Claude Code: Best Practices for Subagent Orchestration and System Prompts
Deep dive into running OpenAI GPT-5.6 inside Claude Code: comparing Codex vs Claude Code on subagent orchestration, workflow design, and system prompt quality, revealing how harness engineering determines model output.
Read more →
·3 min
Google Gemma 4 On-Device Model: Optimized for Pixel 10 TPU — Offline Multimodal Capabilities Tested and Analyzed
Google's Gemma 4 E2B for TPU runs offline on Pixel 10's Tensor G5 chip, enabling local AI chat, image recognition, and audio transcription. We break down the features and real-world test results.
Read more →
·2 min
Decoding the AI Full-Stack Approach: Google's Vertical Integration Strategy from Chips to Applications
Deep analysis of Google's AI full-stack strategy: from custom TPU chips and system software frameworks to Gemini models and applications, examining how vertical integration delivers performance, cost, and autonomy advantages.
Read more →
·3 min
The Software Compounding Effect: The Real Deciding Factor in AI Infrastructure Competition
Beyond the GPU arms race, software is becoming AI infrastructure's true compounding engine. A deep dive into optimization stacking, the CUDA ecosystem moat, and how open source scales individual breakthroughs into community wealth.
Read more →
·3 min
Alibaba Bans Claude Across the Board: Chinese Cloud Giants Move to Eliminate Closed-Source Model Dependencies
Alibaba bans all Claude products starting July 10, requiring employees to uninstall Sonnet, Opus, and Claude Code. We break down the three drivers behind the ban and its impact on enterprise AI deployment, domestic model development, and the Agent tool ecosystem in China.
Read more →
·6 min
AMD Ryzen AI Halo Dev Kit: A $4,000 Local LLM Powerhouse Taking on Apple and NVIDIA
AMD officially unveils the Ryzen AI Halo local AI dev kit, priced around $4,000 with 128GB unified memory, capable of running 70B LLMs locally. An in-depth look at its specs, pricing, and market competition.
Read more →
·4 min
NVFP4 Quantization in Practice: A Guide to Compressing Large Models with NVIDIA Model Optimizer
Deep dive into NVFP4 quantization: using NVIDIA Model Optimizer to compress Nemotron 3 Ultra to FP4 checkpoints, reducing memory by 75% and boosting inference throughput on Blackwell GPUs.
Read more →
NVIDIA GQE Deep Dive: How GPU Query En…
·2 min
NVIDIA GQE Deep Dive: How GPU Query Engines Break Through Memory Bandwidth Bottlenecks
A deep dive into NVIDIA GQE's architecture: how HBM, NVLink, and memory-hierarchy-aware execution models help GPU query engines overcome I/O and bandwidth bottlenecks.
Read more →
·1 min
Google TPU: Five Generations Decoded — From v2 to Ironwood, a 30x Leap in Energy Efficiency
Deep dive into Google's latest paper tracing TPU v2 to Ironwood: 36x chip scaling, 30x energy efficiency gains, 3D Torus interconnects, liquid cooling, and resilience design.
Read more →
OpenAI's First Custom AI Chip Jalapeño…
·2 min
OpenAI's First Custom AI Chip Jalapeño: A Deep Dive into Its Full-Stack AI Platform Strategy
OpenAI unveils Jalapeño, its first custom AI chip built with Broadcom, optimized for LLM inference. A deep dive into its architecture, strategy, and impact on NVIDIA and the AI chip landscape.
Read more →
Tutorials·3 min
VSCode + Claude Code + DeepSeek: Complete Guide to Setting Up an AI Programming Environment
Complete guide to setting up a VSCode + Claude Code + DeepSeek AI programming environment from scratch, covering Git installation, Claude Code configuration, CC Switch multi-model management, and VSCode plugin integration for embedded developers.
Read more →
Research·2 min
Agent Loops in Practice: Transforming Token Output into Productivity from CUDA Kernels to Automated Research
Deep dive into how the Humanize framework transforms LLM tokens into engineering productivity via Agent Loops. Covers KDA winning CUDA kernel contests, virtual hardware optimization, and 50% research cost reduction.
Read more →
Tutorials·2 min
NCCL Multi-GPU Communication Optimization in Practice: A Guide to Scaling HPC High-Performance Computing
Deep dive into NVIDIA NCCL multi-GPU communication library principles and optimization strategies, covering AllReduce, NVLink, and GPUDirect RDMA to help HPC and AI developers master scaling from single-node to massive clusters.
Read more →
Product Reviews·5 min
Deep Dive into the Hermes-Agent Open-Source Framework: The AI Agent with 130K Stars on GitHub
NousResearch open-sources Hermes-Agent framework, earning 130K+ GitHub Stars. Deep analysis of its progressive architecture, modular design, and Hermes model integration vs. LangChain and AutoGPT.
Read more →