#vector memory
1034 related articles
·5 min
A Deep Dive into Vector Search for AI Agents: The Technical Foundations of RAG and Long-Term Memory
An in-depth look at the core tech behind AI Agents: how the HNSW, IVF, and PQ vector search algorithms power RAG and long-term memory. Understand where a model's "memory" and "knowledge" come from.
Read more →
·3 min
Local LLM Agent Lagging? Lowering num_gpu Is the Key
Local LLM crashing in Agent frameworks? The issue may be num_gpu set too high. Learn what num_gpu really controls (GPU layer offloading, not GPU count) and how to tune it for stable Agent performance.
Read more →
·4 min
How Much Math Do You Need for Machine Learning? Finding the Balance Between Preparation and Practice
How much math do you really need before starting ML projects? This article analyzes the 'bottomless pit' trap, proposes a minimum viable math framework, and offers project-driven learning strategies.
Read more →
·2 min
AI-Driven Persistent RPG Engine: A Full-Stack Practice Guide with React + Supabase
Deep dive into an AI persistent RPG game engine built with React SPA and Supabase, exploring how LLMs combine with modern web stacks for cross-session memory, dynamic narrative, and game state management.
Read more →
·3 min
TokenTown: A Visual Approach to Understanding How LLMs Predict the Next Token
TokenTown is an open-source visualization project that intuitively presents the internal token prediction process of LLMs using a town metaphor. Learn its design philosophy and educational value.
Read more →
·3 min
A Guide to Selecting Datasets for RAG Experiments: Evaluating Dense, Sparse, and Hybrid Retrieval
A systematic guide to standardized datasets for RAG retrieval experiments, covering BEIR, MS MARCO, Natural Questions, and TREC benchmarks for dense, sparse, and hybrid retrieval evaluation.
Read more →
·3 min
Is LLM Inference Actually Profitable? Breaking Down the Cost Structure and Business Logic of Large Model Inference
A deep dive into LLM inference cost structure and profitability models—from GPU throughput, MoE architecture, and KV Cache to scale effects—revealing the business logic behind API price wars.
Read more →
·2 min
ComfyUI KREA 2 v1.2 Identity Edit Workflow: A Practical Guide to Low-VRAM Identity-Preserving Editing
A detailed guide to ComfyUI KREA 2 Identity Edit v1.2 workflow installation and usage, supporting low-VRAM GPUs for identity-preserving editing including pose changes, style transfer, face swap, and virtual try-on.
Read more →
·4 min
9 Hours, 4 Million Tokens: AI Creates a Stunning WebGPU Snow Rendering Masterpiece with Claude Code
Reddit user Noniv used Claude Code with the Opus model to build SNOWFLOW, a stunning WebGPU real-time snow renderer, in just 9 hours using 4 million tokens. A deep dive into prompt strategy, snow shaders, and performance optimization.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.
Read more →
·2 min
AI-Automated Cyberattacks Emerge: Security Boundaries Are Being Reshaped
In-depth analysis of AI-driven automated cyberattack trends, exploring LLM weaponization risks, what rogue AI really means, and how enterprises can build AI defense systems against emerging threats.
Read more →
·4 min
Project Rai-chan Technical Breakdown: A Complete Guide to Building a Fully Local AI Companion
Deep dive into Project Rai-chan's tech stack: Ollama+Gemma local LLM, Unity rendering, VOICEVOX speech synthesis, and more — exploring the technical path for local AI companions.
Read more →
·3 min
130+ Open-Source Interactive Security Awareness Training: Reshaping Habit Formation Through 3D Office Scenarios
A project with 130+ free open-source interactive security awareness exercises using immersive 3D office scenarios to simulate phishing, vishing, MFA fatigue attacks and more, building employee security habits.
Read more →
·3 min
130+ Open-Source Interactive Security Awareness Training: 3D Office Scenarios Reshape Habit Formation
A project with 130+ free open-source interactive security awareness exercises using immersive 3D office scenarios to simulate phishing, vishing, MFA fatigue attacks, and more. Fully white-labeled.
Read more →
·2 min
Stop Blindly Using Adam: The Hidden Pitfalls and Practical Boundaries of Optimizers
Deep analysis of Adam optimizer failure mechanisms in RL and deep Transformer training, revealing the mathematical roots of loss burstiness from second moment estimation, with practical solutions.
Read more →
·2 min
Andrew Ng's New Company LearnVector: Achieving One-on-One Personalized Learning with AI
Andrew Ng launches LearnVector, using generative AI to deliver one-on-one personalized learning. Explore its core vision, potential capabilities, challenges, and how LLMs can solve education's scalability problem.
Read more →
·2 min
Andrew Ng's New Company LearnVector: Achieving One-on-One Personalized Learning with AI
Andrew Ng launches LearnVector, leveraging generative AI to create one-on-one personalized learning experiences. Explore its core vision, potential capabilities, challenges, and how LLMs could solve education's scalability problem.
Read more →
·2 min
Hubbele: An Open-Source Note-Taking App Built for Both Humans and AI Agents
Hubbele is an open-source note-taking app designed for both humans and AI Agents, supporting self-hosted deployment. This article analyzes its Agent-native design philosophy and implications for the future of knowledge management.
Read more →
·3 min
From Demo to Production: The Real Challenges of Deploying LLM Systems
Deep analysis of deploying LLM systems from prototype to production: a real-world AI incident investigation assistant case study revealing key engineering challenges beyond the model.
Read more →