#GPU throughput

431 related articles

Jul 23, 2026·8 min

LangChain Crash Course: A Complete Roadmap from Zero to Agent Development

A systematic roadmap from LangChain and LangGraph to multi-agent development, covering RAG, Tool Calling, MCP, and more, helping developers break into AI app development.

Jul 23, 2026·4 min

The Rise of Chinese Open-Source AI Models: A Head-On Challenge to Closed-Source Dominance

Chinese open-source models rapidly close the capability gap with top closed-source AI. DeepSeek shocks the industry while Qwen matches global benchmarks.

Jul 23, 2026·3 min

Qwen 3.8 Open Source Incoming, DeepSeek Coding Agent, and the Latest in China's AI Ecosystem

Qwen 3.8 open source incoming, DeepSeek Resonics native coding agent debuts, Kimi pauses new subscriptions amid compute pressure, and Qiyimole shows domestic GPU interconnect solution at WAIC.

Jul 23, 2026·7 min

Alibaba Open-Sources 2.4T Qwen Model as Chinese AI Sweeps the Global Competitive Landscape

Alibaba open-sources a 2.4 trillion parameter Qwen model and launches the Qwen Token Plan. Chinese models surge, Kimi K3 tops global rankings, and China's AI is reshaping the global competitive landscape.

Jul 23, 2026·3 min

LangChain v1.3 Hands-On Tutorial: Deep Dive into Agents, RAG, and Local Model Deployment

Deep dive into LangChain v1.3: compare LangChain, LangGraph, and DeepAgent paradigms, explore RAG pipelines, multi-agent systems, and local LLM deployment for enterprise AI apps.

Jul 22, 2026·6 min

GPT-5.6 Hands-On Deep Dive: Three-Tier Models + Ultra Multi-Agent, Codex Fully Evolved

OpenAI launches GPT-5.6 with three tiered models—Sol, Terra, and Luna—Ultra multi-agent parallel collaboration, Codex integrated into ChatGPT desktop, and an upgraded Computer Use.

llmfit: One Command to Check Which Loc…

Jul 22, 2026·2 min

llmfit: One Command to Check Which Local LLMs Your Hardware Can Run

llmfit is an open-source Rust CLI tool that predicts whether your local hardware can run a given LLM — no model download required. Covers hundreds of models and backends like Ollama and llama.cpp.

Jul 22, 2026·3 min

Kimi K3 Hands-On: How a 2.8-Trillion-Parameter Open-Source Model Beat Fable5

A US engineer's live test of Kimi K3: 2.8T parameters, 1M token context, 87% audience vote over Fable5 in game generation. Full report covering benchmarks, speed, and code debugging.

Jul 22, 2026·3 min

V100 GPU Showdown: 4×16G PCIe vs. 2×32G SXM — Which Gives You More Bang for Your Buck?

Benchmarking 4×V100 16G PCIe vs. 2×V100 32G SXM adapter for local LLM inference. Prefill speed, decode speed, power limits, and bandwidth bottlenecks analyzed.

Jul 21, 2026·3 min

27B Parameter LLM on an iPhone? A Deep Dive into On-Device Full-Parameter AI

Startup Prismo claims to compress a 27B-parameter model to 4GB for full local inference on iPhone 17 Pro. We break down the compression tech, compare it to Apple's MoE approach, and assess real-world limits.

Jul 21, 2026·2 min

Qwen3 Fine-Tuning in Practice: A Complete Guide to Local Deployment and Domain Training

A hands-on guide to LLM fine-tuning: from understanding model weights to local Qwen3 deployment, dataset preparation, and domain-specific training. Build a complete AI engineering skill set.

Jul 21, 2026·3 min

LoRA Training Showdown: We Tested 6 Base Models — Does Ideogram Beat Flux?

A developer ran a 4-day benchmark testing LoRA training across Ideogram, Flux 1 Dev, Flux 2 Dev & more — revealing overfitting traps and surprising rankings.

Jul 21, 2026·3 min

What Is a Large Language Model, Really? The Core Principles Explained Through the Lens of Functions

Demystify large language models using middle-school math: LLMs are complex functions, training solves for parameters, and inference predicts next-token probabilities.

Jul 21, 2026·3 min

GPT-5.6 Inference at 18x Speed: OpenAI's Compute Gamble and Business Logic

Why is OpenAI pushing its most powerful model to 750 tokens/s? A deep dive into GPU vs. Cerebras chip cost trade-offs, the $10B compute deal, and how speed, intelligence, and token efficiency are reshaping the AI landscape.

Jul 21, 2026·2 min

MiniMax M3 Local Deployment: 23B Active Parameters ≠ 23GB VRAM — A Complete Guide to MoE Architecture

MiniMax M3 is a 428B MoE model. Its 23B active parameters reflect per-token compute, not VRAM needs. Learn the MoE trade-offs, quantization options, and deployment paths to avoid the most common misconception.

Jul 20, 2026·2 min

Deterministic Attention Transformer: H100 Benchmark Achieves Just 0.63 Joules Per Token

Researchers propose the Deterministic Attention-Transformer, measuring just 0.63 J/token on NVIDIA H100 GPUs. Explore the tech behind it and its green AI implications.

Jul 20, 2026·4 min

Complete Guide to Running Claude Code on Amazon Bedrock

Complete guide to deploying Claude Code on Amazon Bedrock: environment setup, cross-region inference, prompt caching, cost attribution, Guardrails, and the Mantle endpoint for enterprise compliance.

Jul 20, 2026·3 min

GPT-5.6 Sol Deep Dive: Capability Breakthroughs and Alignment Risks

OpenAI previews GPT-5.6 with three variants — Sol, Terra, and Luna. Sol leads in agentic coding at 750 tokens/sec but is OpenAI's most misaligned model yet.

Jul 20, 2026·3 min

DeepSeek and Zhipu Race to Build Custom AI Chips: China's Path to AI Compute Independence

DeepSeek seeks $7B for custom AI inference chips; Zhipu AI explores ASIC. Deep dive into China's AI compute independence strategy, multimodal generation, agents, and hardware trends.

The Wild Juxtaposition of AI's Evoluti…

Jul 20, 2026·2 min

The Wild Juxtaposition of AI's Evolution: What Has Technology Crossed From Start to Now?

A "How it started vs. How it's going" comparison reveals generative AI's stunning leap. We explore the key drivers—compute, data, algorithms, and open source—plus the real challenges ahead.