#gradient descent
89 related articles
·3 min
Gradient Descent and Backpropagation Explained: How Neural Networks Learn from Scratch
Understand how neural networks learn: a complete guide to cost functions, gradient descent, backpropagation, and SGD — ideal for deep learning beginners building intuition from the ground up.
Read more →
·4 min
Neural Networks from Scratch: A Deep Dive into the Fundamentals from Linear Regression to Gradient Descent
From linear regression and logistic regression to gradient descent, this guide derives the core mechanisms of neural networks step by step, covering Sigmoid, cross-entropy, activation functions, and backpropagation.
Read more →
·4 min
How Much Math Do You Need for Machine Learning? Finding the Balance Between Preparation and Practice
How much math do you really need before starting ML projects? This article analyzes the 'bottomless pit' trap, proposes a minimum viable math framework, and offers project-driven learning strategies.
Read more →
·4 min
Transitioning from DevOps to MLOps: A Complete Learning Roadmap
How can DevOps engineers efficiently transition to MLOps? This guide covers MLOps core concepts, standard workflows, essential tools, and Azure practices with a progressive learning roadmap.
Read more →
·3 min
Three Essential Hard Skills Traditional Product Managers Need to Transition into AI PM
How can traditional product managers transition to AI PM? This article analyzes the essential differences and details three must-have skills: AI product cognition, advanced Prompt engineering, and large model technical logic.
Read more →
·3 min
The Open-Weights Model Debate: Balancing Safety and Openness
An in-depth analysis of the open-weights model debate: public release brings transparency and innovation, but raises safety and misuse risks. Exploring tiered release, red-teaming, and governance challenges.
Read more →
·3 min
The Open-Weights Model Debate: Balancing Safety and Openness
An in-depth analysis of the open-weights model debate: publicly releasing model weights enables transparency and innovation but raises safety risks. Explores tiered release, red-teaming, and the industry dynamics behind open AI governance.
Read more →
·3 min
How Hidden Layers Solve the XOR Problem: A Complete Walkthrough from Math to Geometry
A deep dive into how neural network hidden layers solve the XOR problem through feature space transformation, with math, geometry, and concrete examples.
Read more →
·3 min
Mathematical Foundations for Machine Learning: A Complete Learning Path from Linear Algebra to Probability Theory
A systematic guide to the three core math areas for ML—linear algebra, calculus, and probability—with verified free resources like Mathematics for Machine Learning, 3Blue1Brown, and practical learning strategies.
Read more →
·4 min
Gemini 3.5 Checkpoint Leaked: Intermediate Version Reportedly Outperforms Opus 5 in Testing
Reddit leaks suggest a Google Gemini 3.5 intermediate checkpoint outperformed Claude Opus 5 max thinking in testing. We analyze what checkpoints mean, benchmark credibility, and the LLM competition landscape.
Read more →
·5 min
30+ Free AI & Machine Learning Classic Textbooks: All in One GitHub Repository
Awesome Free AI Books is an open-source repo with 30+ legally free AI & ML classic textbooks covering deep learning, reinforcement learning, NLP, LLMs, and more — all linking to official sources with weekly automated link checks.
Read more →
·3 min
The Software 3.0 Era: An AI Programming Evolution Guide for Frontend Engineers
Natural language programming is reshaping frontend development. This article explains AI code generation, Prompt formulas, pitfall avoidance, RAG, Agent orchestration, and skill maintenance.
Read more →
·7 min
Context Engineering: A Systematic Approach to Stop AI Agents from 'Talking Nonsense'
Context engineering is the core methodology for building efficient AI Agents, covering query enhancement, RAG retrieval, prompt design, memory management, and tool invocation. Master Write, Select, Compress, and Isolate to solve LLM hallucination at its root.
Read more →
·4 min
The Rise of Chinese Open-Source AI Models: A Head-On Challenge to Closed-Source Dominance
Chinese open-source models rapidly close the capability gap with top closed-source AI. DeepSeek shocks the industry while Qwen matches global benchmarks.
Read more →
·3 min
Is a Large Language Model Just a Function? AI Principles Explained with Middle School Math
LLMs explained through the lens of functions: input is x, output is y, training solves for parameters, inference computes results. Trillion parameters, next-token prediction — no advanced math needed.
Read more →
·2 min
Gradient-Free Evolutionary Model GENREG: How Radial Space Search Bypasses Backpropagation
GENREG-Radial Space is a gradient-free evolutionary optimization model that replaces backpropagation with structured radial space search. This article analyzes its core mechanisms, temporal evolution design, exploration-exploitation balance, and potential as a hybrid paradigm.
Read more →
·3 min
Don't Start AI Learning with Machine Learning: A Beginner's Guide to the Onion Model
Gaurav Sen reveals the fatal trap in AI learning: starting from ML fundamentals often leads to burnout. Learn the Onion Model approach—RAG, Agents first, Transformers next, math last.
Read more →
From Math to AI Research Engineer: A D…
·2 min
From Math to AI Research Engineer: A Deep Dive into the Viral GitHub Learning Roadmap
A GitHub project called maths-cs-ai-compendium surpassed 6,000 Stars with a roadmap for becoming an AI/ML Research Engineer. Here's what makes it worth following.
Read more →
·4 min
Former OpenAI Researcher Warns: 70% Chance AI Spins Out of Control
Former OpenAI researcher Daniel Kokotajlo, who forfeited $2M in equity, warns of a 70% chance AI leads to catastrophic outcomes and superintelligence by 2029.
Read more →
·3 min
Math Learning Path for Machine Learning: From Resource Overload to Systematic Mastery
Overwhelmed by ML math courses? This guide maps out linear algebra, calculus, and probability into a practical learning path — from core courses to reference books.
Read more →