#HBM memory bandwidth
112 related articles
·3 min
Is LLM Inference Actually Profitable? Breaking Down the Cost Structure and Business Logic of Large Model Inference
A deep dive into LLM inference cost structure and profitability models—from GPU throughput, MoE architecture, and KV Cache to scale effects—revealing the business logic behind API price wars.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.
Read more →
·2 min
Korean Stocks Plunge 16% in Two Days: Why Retail Selling Triggered a Market Stampede
Korean stocks plunged ~16% in two trading days as concentrated retail selling triggered a market stampede. Analysis of structural vulnerabilities, leverage effects, and investment lessons.
Read more →
·2 min
AI Bubble Fears Intensify: The Logic Behind Chip Stocks Selling Off Across U.S. and Asian Markets
Chip stocks fall simultaneously across U.S. and Asian markets as AI bubble fears intensify. Analysis of the drivers, sustainability of AI capex, and the balance between short-term volatility and long-term trends.
Read more →
·2 min
AI Bubble Fears Intensify: The Logic Behind Chip Stocks Selling Off Across US and Asian Markets
Chip stocks decline simultaneously across US and Asian markets as AI bubble fears intensify. Analysis of the logic behind the selloff, sustainability questions around AI capex, and the relationship between short-term volatility and long-term trends.
Read more →
·3 min
Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention
A deep dive into Kimi Delta Attention (KDA): tracing the evolution from quadratic Softmax attention through linear attention, Delta rules, and gated decay mechanisms, with insights on associative memory and hardware optimization.
Read more →
·3 min
Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention
Deep dive into Kimi Delta Attention (KDA): from standard Softmax attention's quadratic bottleneck through linear attention, Delta Rule, and gated decay mechanisms — the complete evolution explained.
Read more →
·3 min
Kimi K3 Launch: A 2.8 Trillion Parameter Flagship Model Makes Its Grand Entrance
Moonshot AI launches Kimi K3 with 2.8 trillion parameters and 1M token context. Google delays Gemini 3.5 Pro, AI coding tools upgrade collectively as competition shifts to coding and Agent capabilities.
Read more →
·4 min
Colibri: Running a 744-Billion-Parameter LLM on an Ordinary Laptop
Colibri uses MoE hot-cold separation and 4-bit quantization to run 744B-parameter models like GLM 5.2 on consumer hardware. Learn about its three-tier memory architecture and speculative decoding.
Read more →
·4 min
Laguna S 2.1 Deep Dive: Hands-On Local Deployment of a 118B Parameter Coding Model
In-depth review of Poolside's Laguna S 2.1 open-source coding model: MoE architecture, RL training, DGX Spark local deployment, and real-world agentic coding tests with 8B active parameters.
Read more →
·4 min
Framework 13 Pro In-Depth Review: The Modular Laptop That Finally Stops Compromising
Framework 13 Pro in-depth review covering build quality, display, performance, and Linux experience. This modular laptop achieves 85% of MacBook Pro's refinement with far superior repairability and upgradeability.
Read more →
·3 min
Samsung Z Fold 8 Hands-On: The Compact Foldable Is the Biggest Surprise
Samsung unveils the Z Fold 8, Z Fold 8 Ultra, and Z Flip 8. The Z Fold 8's passport-style design weighs just 201g with a dramatically improved crease, preemptively countering Apple's rumored foldable iPhone.
Read more →
·3 min
Samsung Z Fold 8 Hands-On: The Compact Foldable Is the Biggest Surprise
Samsung launches Z Fold 8, Z Fold 8 Ultra, and Z Flip 8. The Z Fold 8's passport-style design weighs just 201g with dramatically reduced crease, preemptively countering Apple's rumored foldable iPhone.
Read more →
·3 min
Apple Silicon LLM Inference Speed Benchmarks: A Complete Guide to Local Large Model Performance on Mac
In-depth analysis of Apple Silicon local LLM inference speed benchmarks covering M-series memory bandwidth, model quantization, MLX framework optimization, and Mac configuration guidance.
Read more →
·3 min
AMD CDNA5 Architecture Deep Dive: Technical Evolution and the AI Computing Competition Landscape
Deep analysis of AMD's CDNA5 architecture covering Chiplet packaging upgrades, HBM memory evolution, and low-precision compute optimization, examining how AMD challenges NVIDIA's AI chip dominance.
Read more →
·3 min
DeepSeek Ignites Open Source vs. Closed Source Debate in Silicon Valley, Splitting Tech Giants into Rival Camps
DeepSeek's open source model shakes Silicon Valley. OpenAI defends closed source while Microsoft, NVIDIA, and Meta back open ecosystems. Analysis of the AI open/closed source debate, Apple-Micron chip tensions, and AI-driven historical disinformation.
Read more →
·3 min
Open Source vs. Closed Source: Who Will Win the US-China AI Battle?
Chinese open-source models DeepSeek and Kimi K3 are challenging OpenAI's closed-source dominance. Analyzing the business logic, chip ecosystems, and US-China strategic dynamics behind the open vs. closed AI debate.
Read more →
·3 min
Running AI Inside DRAM: A Processing-in-Memory Experiment That Breaks DDR4 Timing Rules
Explore how deliberately violating DDR4 timing rules enables running PrismML's Bonsai AI model inside DRAM, covering the principles, energy benefits, and challenges of processing-in-memory.
Read more →
·3 min
DeepSeek Ignites Open Source vs. Closed Source Debate in Silicon Valley, Splitting Tech Giant Alliances
DeepSeek's open source model shakes Silicon Valley. OpenAI defends closed source while Microsoft, NVIDIA, and Meta back open ecosystems. Analysis of the AI open/closed source debate, Apple-Micron chip tensions, and AI-driven historical disinformation.
Read more →