#RNN LSTM
106 related articles
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Learn about its technical principles, performance gains, and value for long-context training and inference acceleration.
Read more →
·3 min
Moonshot AI Open-Sources FlashKDA: A Deep Dive into High-Performance CUDA Kernels for KDA Attention
Moonshot AI open-sources FlashKDA, providing high-performance CUDA kernels for Kimi Delta Attention. Explore its technical principles, performance gains, and value for long-context training and inference.
Read more →
·3 min
The Collapse of the Lexical Assumption: Analyzing the Implicit Feature Inheritance Challenge in AI Alignment
Deep analysis of implicit feature inheritance in AI alignment: Anthropic's research reveals model behavior can propagate independently of semantics, fundamentally challenging traditional RLHF safety mechanisms.
Read more →
·3 min
Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention
A deep dive into Kimi Delta Attention (KDA): tracing the evolution from quadratic Softmax attention through linear attention, Delta rules, and gated decay mechanisms, with insights on associative memory and hardware optimization.
Read more →
·3 min
Kimi Delta Attention Explained: The Evolution from Standard Attention to Linear Attention
Deep dive into Kimi Delta Attention (KDA): from standard Softmax attention's quadratic bottleneck through linear attention, Delta Rule, and gated decay mechanisms — the complete evolution explained.
Read more →
·5 min
Learn AI Agent Development from Scratch: A 3-Step Practical Path to Get Started Quickly
How to learn AI Agent development from scratch? This article outlines a clear 3-step path: Python crash course, LLM theory & practice, and LangChain framework project implementation.
Read more →
·4 min
What Is the True Nature of Large Language Models? A Super Compressor Analogy to Help You Fully Understand
Large models aren't search engines — they're more like super compressors. This article explains how LLMs compress data to learn semantic patterns, and explores the phenomenon of intelligent emergence.
Read more →
·4 min
What Is the True Nature of Large Language Models? A Super Compressor Analogy That Makes Everything Click
LLMs aren't search engines — they're more like super compressors. This article explains how large models compress corpora to learn semantic patterns, and explores the principles and limitations of emergent intelligence.
Read more →
·3 min
Introduction to How AI Large Models Work: A Must-Read Guide for Test Engineers
A clear explanation of how AI large models work: from concept hierarchy and Transformer mechanics to probabilistic traits, helping test engineers grasp AI testing.
Read more →
·3 min
Introduction to AI Large Language Models: A Must-Read Guide for Test Engineers
A thorough explanation of the essence of AI large language models: from conceptual hierarchy and Transformer mechanics to probabilistic nature, helping test engineers understand LLM strengths and weaknesses.
Read more →
·2 min
From Zero to AI Career: A Complete Breakdown of a 3-Month Self-Study Roadmap
Want to break into AI from scratch? This article breaks down an efficient self-study roadmap: from Python, math, and machine learning basics to PyTorch, then to CV, NLP, and data mining—reaching entry-level career-switching intensity in 3 months.
Read more →
·6 min
Making Money with AI Coding Gigs: A Sober Breakdown and Honest Assessment of the Four-Week Learning Path
Can beginners really earn over 10,000 yuan in their first month with AI coding gigs? This article breaks down the four-week AI coding learning path week by week and objectively assesses the real monetization barriers.
Read more →
·3 min
From Word Vectors to Large Language Models: The Complete Evolution of AI 2.0 Technology
From word vectors and embeddings to RNNs, BERT, Transformers, and ChatGPT — a complete guide to the technical evolution of large language models and the AI 2.0 era.
Read more →
·7 min
The Complete Guide to LLM Application Engineer Interviews: Six High-Frequency Topics in the Agent Domain
A focused guide to the core interview topics for LLM application engineers, covering agent architecture, Multi-Agent, Langfuse evaluation & tracing, security, and RAG optimization.
Read more →
·7 min
The Complete Guide to LLM Application Engineer Interviews: Six High-Frequency Agent Topics
A focused guide to core LLM application engineer interview topics, covering agent architecture, Multi-Agent, Langfuse evaluation, security, and RAG optimization.
Read more →
·6 min
The AI Builder's Handbook: A Complete Guide to LLM Principles, RAG Architecture, and Agent Design
From the autocomplete nature of LLMs, tokens, and context windows to RAG vector databases, the MCP protocol, and AI agent loop design — this article uses vivid analogies to unpack the reality of AI engineering.
Read more →
·3 min
Don't Start AI Learning with Machine Learning: A Beginner's Guide to the Onion Model
Gaurav Sen reveals the fatal trap in AI learning: starting from ML fundamentals often leads to burnout. Learn the Onion Model approach—RAG, Agents first, Transformers next, math last.
Read more →
·3 min
How to Choose AI Learning Books: A 5-Dimension Rational Evaluation Framework
How to evaluate AI/ML books rationally? Use these 5 dimensions—content depth, code quality, currency, community reputation, and companion resources—to choose wisely.
Read more →
·3 min
Building a Transformer from Scratch: A PyTorch Hands-On Guide for Self-Taught Developers
A self-taught developer with 2 years of Python experience implements Transformer from scratch using plain PyTorch, following the original 'Attention Is All You Need' paper with a two-phase approach: inference first, then full training.
Read more →
·2 min
Variable-Length Matrix Classification: Choosing the Right Neural Network Architecture for Unordered Set Data
Why do CNNs and RNNs fail on unordered matrix data? Learn about permutation invariance, Deep Sets, and Set Transformer to pick the right architecture for set-based classification.
Read more →