#Tensor chip
254 related articles
·3 min
How Cheap Can It Be to Serve a 2.8 Trillion Parameter Model? A Deep Dive into Inference Economics
Deep analysis of the real cost of serving a 2.8 trillion parameter model. From MoE sparse activation to batching scale effects and inference optimization, revealing why model size and serving cost are less correlated than assumed.
Read more →
·3 min
You Don't Always Need a Vector Database for Vector Search — Brute Force Might Be All You Need
In-depth analysis of when brute force vector search beats vector databases. For RAG apps with under a few hundred thousand vectors, brute force offers exact recall, simpler architecture, and easier debugging.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, challenging Intel Xeon and Nvidia. Analysis of specs, applications, ecosystem challenges, and strategic significance.
Read more →
·2 min
Hygon Launches 512-Thread CPU and AI GPU, Taking Aim at Intel Xeon and Nvidia
Hygon unveils a 512-thread server CPU and AI GPU, directly challenging Intel Xeon and Nvidia. A deep dive into specs, applications, ecosystem challenges, and strategic significance.
Read more →
·5 min
Halo: A Real-Time Anti-Deepfake Tool That Detects AI Face-Swapping in Video Calls
Halo is a local real-time deepfake detection tool that identifies AI-synthesized faces during Zoom, Teams, and Google Meet video calls to prevent face-swapping fraud.
Read more →
·3 min
Epilude: A Fully Local Mac AI Voice Input Tool Review
Epilude is a fully local macOS AI voice input tool that converts speech to polished written text with a push-to-talk hotkey. Review covers privacy, features, and cloud tool comparisons.
Read more →
·3 min
Why AI Companies Are Reluctant to Open Source: The Strategic Dilemma and Game Theory of Market Leaders
Deep analysis of why leading AI companies refuse to open-source core models. Exploring moat mentality, competitive game theory, and the open vs. closed source dialectic.
Read more →
·3 min
Why AI Companies Resist Open Source: The Strategic Dilemma and Game Theory of Market Leaders
Deep analysis of why leading AI companies resist open-sourcing core models. Exploring moat mentality, competitive game theory, and the evolving open vs. closed source dynamics in the AI industry.
Read more →
·2 min
Behind the Open-Source Model Frenzy: Who Will Provide Cheap Inference Services?
Open-source LLM weights don't equal low-cost access for developers. This article analyzes the inference service gap in open-source AI and how providers like Together AI and Groq are addressing it.
Read more →
·2 min
Behind the Open-Source Model Frenzy: Who Will Provide Cheap Inference Services?
Open-source LLM weights don't mean developers can use them cheaply. This article examines the inference service gap in open-source AI and how providers like Together AI and Groq are addressing it.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.
Read more →
·2 min
Reverse Engineering Apple's ANE: Open-Source Project Enables On-Device Training on the Neural Engine
Deep dive into the maderix/ANE GitHub project that reverse engineers Apple's private APIs to enable neural network training on the Apple Neural Engine, exploring its technical approach, efficiency gains, compliance risks, and implications for on-device AI.
Read more →
·3 min
Gemini Batch API Major Upgrade: 80% Latency Reduction, Success Rate Exceeds 99.998%
Google's Gemini Batch API completes major infrastructure upgrade with 80% lower p95 latency, 99.998%+ success rate, 98% fewer expirations, and new partial batch support for large-scale AI inference.
Read more →
·3 min
Kimi K3 Launch: A 2.8 Trillion Parameter Flagship Model Makes Its Grand Entrance
Moonshot AI launches Kimi K3 with 2.8 trillion parameters and 1M token context. Google delays Gemini 3.5 Pro, AI coding tools upgrade collectively as competition shifts to coding and Agent capabilities.
Read more →
·3 min
Backend Developer Transition to AI/LLM: 4 Core Skills and a Practical Learning Roadmap
Complete guide for backend developers transitioning to AI/LLM engineering. Covers the 4 core skills—Python, RAG, Fine-tuning, and Agents—with a phased learning roadmap and practical project advice.
Read more →
·2 min
Chrome Built-in AI Explained: How Locally Running Models Protect Your Privacy
Explore Chrome Built-in AI technology and how running AI models locally in the browser enables zero data upload, instant responses, and stronger privacy protection.
Read more →
·2 min
Chrome Built-in AI Explained: How Locally Running Models Protect Your Privacy
Deep dive into Chrome Built-in AI technology, exploring how running AI models locally in the browser achieves zero data uploads, instant responses, and stronger privacy protection.
Read more →
·3 min
Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA
Deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on RTX 5080. Exploring its architecture, Metal porting plans, and applications in VTuber, AR/VR, and sports analysis.
Read more →
·3 min
Monocular RGB Human Mesh Reconstruction: Real-Time Motion Capture at 18 FPS with Rust + CUDA
A deep dive into a real-time 3D human mesh reconstruction project using a single RGB camera, built with Rust, Candle, and CUDA, achieving 55ms/frame on an RTX 5080.
Read more →