#Roofline model
11 related articles
·3 min
LLM Inference Speed Formula: Memory Bandwidth Determines Your tokens/sec
Why memory bandwidth (GB/s), not VRAM size, determines local LLM inference speed. Includes tokens/sec formula, GPU bandwidth comparison, and a practical card selection framework.
Read more →
·3 min
LLM Inference Speed Formula: Memory Bandwidth Determines Your tokens/sec
Learn why memory bandwidth (GB/s)—not VRAM size—determines local LLM inference speed. Get the tokens/sec formula, GPU bandwidth comparisons, and a practical card selection hierarchy.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics in Model Quantization and Inference Deployment
A systematic review of must-know topics for AI Application Engineer interviews: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →
·6 min
AI Application Engineer Interview Guide: Core Topics on Model Quantization and Inference Deployment
A systematic guide to must-know AI application engineer interview topics: PTQ/QAT quantization, operator fusion, inference pipelines, latency/throughput analysis, and edge deployment of detection/segmentation/BEV models.
Read more →
·4 min
Two Paths to Better AI Reasoning: Test-Time Scaling and Formal Verification
This article synthesizes two MSR India Summit talks, exploring two key paths to better AI reasoning: test-time scaling with variable granularity search, and a formal verification framework for trustworthy agent execution.
Read more →
·3 min
Distributed AI Systems in Practice: A Complete Guide to Training, Inference, and Production Deployment
A deep dive into Distributed AI Systems: a new book distilling 10 years of AI engineering experience covering distributed training, inference optimization, and production model serving.
Read more →
·3 min
SlickToken: A Deep Dive into GPU Fleet and Agentic Workflow Planning
SlickToken is a GPU fleet and agentic workflow planning tool for AI teams, supporting offline simulation, load testing, and capacity planning—no internet required to protect enterprise data.
Read more →
·6 min
Rising RAM Prices Push Up Gaming Laptop Costs? A Value-Focused Buying Guide
Rising RAM and storage prices have eroded gaming laptop value. This guide breaks down the causes, cost pass-through, and offers practical buying advice plus MSI value picks.
Read more →
·4 min
NVFP4 Quantization in Practice: A Guide to Compressing Large Models with NVIDIA Model Optimizer
Deep dive into NVFP4 quantization: using NVIDIA Model Optimizer to compress Nemotron 3 Ultra to FP4 checkpoints, reducing memory by 75% and boosting inference throughput on Blackwell GPUs.
Read more →
NVIDIA Nsight Tools in Practice: A Per…
·3 min
NVIDIA Nsight Tools in Practice: A Performance Optimization Guide for Neural Reconstruction Pipelines
Learn how to optimize neural reconstruction pipelines using NVIDIA Nsight Systems and Nsight Compute — from CPU-GPU sync blocking to kernel-level profiling for autonomous driving simulation.
Read more →
NVIDIA GQE Deep Dive: How GPU Query En…
·2 min
NVIDIA GQE Deep Dive: How GPU Query Engines Break Through Memory Bandwidth Bottlenecks
A deep dive into NVIDIA GQE's architecture: how HBM, NVLink, and memory-hierarchy-aware execution models help GPU query engines overcome I/O and bandwidth bottlenecks.
Read more →