#pipeline parallelism

171 related articles

Jul 12, 2026·3 min

Benchmarking LLMs on Smartphones: A Deep Dive into the MELTing Point Benchmark

The MELTing Point paper is the first to evaluate mobile LLM performance in real user scenarios, covering iPhone, Samsung, Pixel and more, testing TinyLlama, Mistral-7B and others—revealing GPU inference gains, 47°C heat warnings, and prefill-decode disaggregation.

Jul 12, 2026·2 min

Decoding the AI Full-Stack Approach: Google's Vertical Integration Strategy from Chips to Applications

Deep analysis of Google's AI full-stack strategy: from custom TPU chips and system software frameworks to Gemini models and applications, examining how vertical integration delivers performance, cost, and autonomy advantages.

Jul 12, 2026·3 min

DeepSeek-V4 Flash RL Training Successfully Ported to AMD MI355X GPU: A Complete Breakdown

The Miles team and AMD announce the full port of DeepSeek-V4 Flash RL training to AMD Instinct MI355X GPUs on ROCm, boosting AIME pass@1 from 0.39 to 0.49—a milestone for compute ecosystem diversity.

Jul 11, 2026·6 min

Grok 4.5 Hands-On: A Faster, Cheaper Coding Dark Horse — Can It Replace Opus and GPT?

In-depth Grok 4.5 hands-on review: priced at a fraction of Opus 4.8, twice the token efficiency of peers, and coding ability in the top tier. A real-project breakdown of its strengths, highlights, and shortcomings.

Jul 11, 2026·6 min

GPT Live Full-Duplex, Grok 4.5 Coding, Seedream 5.0 Images: AI Accelerates Across Three Tracks Simultaneously

OpenAI's GPT Live full-duplex voice model, Grok 4.5 coding model with Cursor, and ByteDance's Seedream 5.0 Pro image generation launched together. A deep dive into three AI releases.

Jul 11, 2026·6 min

Zuckerberg Says AI Will Run Your Entire Business — But Data Ownership Risks Can't Be Ignored

Meta launched an enterprise AI agent, with Zuckerberg claiming it can "run your entire business." This article explores the commercial value of AI agents, the hidden risks of data ownership, and how different businesses can balance efficiency with data sovereignty.

Jul 10, 2026·5 min

Real-World Comparison of 6 Open-Source LLMs for On-Premise Deployment: A Selection Guide to Avoid Pitfalls

A hands-on comparison of 6 open-source LLMs (DeepSeek, Qwen3, Zhipu GLM, Kimi K2, MiniMax M3, Tencent Hunyuan 3) for on-premise deployment—covering hardware cost, inference efficiency, and deployment difficulty.

Jul 10, 2026·4 min

DeepSeek-V4 Deep Dive: Million-Token Context Architecture Breakthrough and Core Innovations

Deep dive into DeepSeek-V4: 1.6T-parameter MoE, CSA+HCA hybrid attention, MHC & MUON optimizer. Inference FLOPs drop to 27% of V3.2, redefining open-source LLM SOTA.

Jul 10, 2026·5 min

TensorRT Multi-Device Inference: Engineering Practices for Breaking Through Single-GPU Memory Bottlenecks

NVIDIA TensorRT now supports multi-device inference via pipeline and tensor parallelism, distributing large models across multiple GPUs to break through single-card memory limits.

Jul 10, 2026·7 min

The Five Pillars of Production-Grade AI Agents: A Battle-Tested Guide from Demo to Deployment

Databricks tech lead Sandy shares a five-pillar framework for production-grade AI Agents—evaluation, observability, data foundation, orchestration, and governance—with a £85K retail banking failure case to bridge the demo-to-production gap.

Jul 10, 2026·6 min

Deploying Enterprise AI Agents to Production: The Five Pillars from Demo to Launch

A Databricks expert breaks down the complete methodology for taking AI Agents from demo to production, covering the five pillars of evaluation, observability, data foundation, multi-Agent orchestration, and AI governance, with a real eight-week banking chatbot POC case.

Jul 10, 2026·6 min

Grok 4.5 Deep Dive: Coding on Par with Top Models, at a Fraction of the Cost

A senior developer's 24-hour deep test of Grok 4.5: a 1.5T-param MoE model at $2/M input tokens, with coding benchmarks rivaling GPT-5.5. Real performance, token efficiency, and limits explained.

Jul 10, 2026·3 min

Running LLMs Locally: The Illusion vs. the Real Value of Open-Weight Models

Open weight ≠ runnable locally. This article breaks down the hardware barriers, VRAM limits, electricity costs, and parallelism constraints of models like GLM 5.2 and DeepSeek — revealing where open-weight models truly add value: driving cloud competition, not home replication.

Jul 9, 2026·4 min

AI Weekly: GPT-5.6 Launches in Three Tiers, Open-Source Inference Frameworks and Robot Safety Break Through Across the Board

This week in AI: OpenAI launches GPT-5.6 in three tiers (Sol/Terra/Luna) hitting 91.9% on coding benchmarks; DeepSeek and PKU open-source DSpark for 85% faster inference; Prime Intellect trains trillion-param models on just 28 H200s; Anthropic Claude enters Slack.

Jul 9, 2026·4 min

Unsloth v0.1.463-beta: Fixes Studio Crash and llama-server Permission Issue

Unsloth v0.1.463-beta fixes a Studio crash caused by access-denied errors during llama-server service discovery. Improves stability for multi-user servers and Windows environments.

Jul 9, 2026·7 min

Getting Started with OpenAI LLM Development: A Practical Guide to Model Selection, Token Pricing, and API Usage

A systematic guide to the three cores of OpenAI LLM app development: GPT-4/GPT-3.5 model selection, token billing and cost-saving tips, and practical use of the Models, Completion, and Chat Completion APIs.

Jul 8, 2026·7 min

Learning Python from Scratch: A Complete Guide to the Three-Stage Learning Path

Want to learn Python from scratch but don't know where to begin? This article breaks down three stages—basic syntax, advanced mastery, and hands-on practice—with real projects in crawling, automation, and data analysis to help you build programming thinking.

Jul 8, 2026·3 min

Google's AI Blitz: Gemini 3.5 Live Translate, NotebookLM Upgrades, and DiffusionGemma Explained

Google's packed AI week: Gemini 3.5 Live Translate, NotebookLM agentic upgrades, DiffusionGemma text diffusion, and Project Genie. A full breakdown of Google's latest AI moves.

Jul 8, 2026·6 min

GPT-5.6 Hits 91.9% on Coding Benchmark: A Guide to Choosing Among Three Tiers and Avoiding Ultra Mode Pitfalls

GPT-5.6 launches Soul/Terra/Luna, with flagship Soul scoring 91.9% on Terminal Bench 2.1. This article breaks down the Ultra vs Max reasoning modes, three-tier pricing, and four hidden pitfalls to guide your technical selection.

Jul 7, 2026·5 min

Nonuniform Tensor Parallelism: NVIDIA's New Fault-Tolerance Approach to Boost LLM Training Goodput

NVIDIA introduces Nonuniform Tensor Parallelism, letting GPUs bear different compute loads so training can continue without checkpoint rollback during hardware failures—boosting LLM training Goodput and fault tolerance at scale.