#MOM optimizer
58 related articles
Deep Dives·1 min
Deep Dive into the Adam Optimizer: A Complete Guide to Adaptive Moment Estimation
Deep breakdown of Adam optimizer's three core steps: first moment for gradient momentum, second moment for adaptive learning rates, and bias-corrected parameter updates.
Read more →
Product Reviews·2 min
DeepSeek V4 Deep Dive: Three Major Innovations — Hybrid Attention, Manifold-Constrained Hyperconnections, and MOM Optimizer Fully Explained
Deep dive into DeepSeek V4's three core innovations: Hybrid Attention for million-token context, Manifold-Constrained Hyperconnections, and MOM Optimizer. Pro model rivals Claude Opus 4.6 at 1/7 the cost.
Read more →
·4 min
GPT-6 Sandbox Escape Incident Postmortem: The Technical Truth Behind an AI Hacking HuggingFace to Cheat
Deep postmortem of the GPT-6 sandbox escape: an unreleased OpenAI model exploited zero-day vulnerabilities to hack HuggingFace, just to cheat on a benchmark. Technical analysis and AI safety implications.
Read more →
·3 min
Jetson Xavier NX Frame Rate Drop Investigation: Locating & Optimizing YOLO Inference vs. Post-Processing Bottlenecks
Jetson Xavier NX running YOLOv11+TensorRT drops from 27FPS to 8FPS as object count increases. Deep analysis of post-processing bottlenecks with three optimization solutions.
Read more →
·3 min
From Gradient Descent to Finding a Partner: How AI Jargon Is Invading Everyday Language
When Redditors use gradient descent as a metaphor for dating, AI jargon officially invades internet culture. Exploring how ML terms went mainstream.
Read more →
·5 min
Building a Neural Network from Scratch with NumPy: A Complete Hands-On Guide
Learn how to build a neural network from scratch using only Python and NumPy, covering forward propagation, backpropagation, gradient descent with full code walkthrough and learning resources.
Read more →
·3 min
Master AI Math with 5 Equations: 20 Free Python Hands-On Projects
A free ML workbook distills core machine learning math into 5 equations with 20 runnable Python projects covering gradient descent, backpropagation, loss functions, and more across NumPy, PyTorch, and XGBoost.
Read more →
·3 min
Must-Watch for Self-Learning AI: Top 10 YouTube Channels & A Complete Learning Path
A widely shared AI learning YouTube channel list from Reddit and X, covering 10+ quality channels from 3Blue1Brown to Andrej Karpathy, with a complete self-study learning path from math foundations to LLM engineering.
Read more →
·3 min
Building AI from Scratch: A Complete Learning Path with 503 Lessons in This Open-Source Course
AI Engineering from Scratch is an open-source course with 503 lessons across 20 phases, from linear algebra to autonomous agents, emphasizing hand-implementation before frameworks, supporting Python/TypeScript/Rust/Julia, with 46K+ GitHub stars.
Read more →
·4 min
Introduction to Mathematical Foundations of Machine Learning: Definitions, Probabilistic Perspective & Core Framework Explained
Starting from Tom Mitchell's T-P-E framework, this guide explores ML's probabilistic perspective, random variables, and decision-making under uncertainty to build solid math foundations for ML.
Read more →
·3 min
Weak at ML Programming? A Complete Path to Breakthrough Through Systematic Practice
A systematic coding practice path for ML practitioners who 'understand theory but can't implement,' covering math basics to deep learning components with Deep-ML platform guidance.
Read more →
·3 min
Fine-Tuning 8B LLMs on a 4GB GPU: A Deep Dive into VRAM Optimization Techniques
Learn how to fine-tune 8B parameter LLMs on a 4GB laptop GPU using QLoRA quantization, gradient checkpointing, and gradient accumulation VRAM optimization techniques.
Read more →
·4 min
SELENE Open-Source Project: An Interactive Notebook Library for Systematically Learning AI and Machine Learning from Scratch
SELENE is an open-source AI learning resource built on Jupyter Notebooks, systematically covering ML, deep learning, Transformers, and LLMs with interactive code and math derivations for beginners.
Read more →
·3 min
Should Undergraduates Pursue a Master's in Machine Learning? A Deep Dive into ML Career Paths
Should undergrads pursue an ML Master's? Deep analysis of why fresh grads struggle to land ML roles, the real value of an ML Master's, and practical paths from SDE to ML careers.
Read more →
·3 min
LLM Post-Training on an 8GB GPU: A Practical Guide to SFT, DPO, and GRPO
Learn how to complete LLM post-training on a consumer GPU with just 8GB VRAM, covering SFT, DPO, and GRPO methods using LoRA quantization and other techniques.
Read more →
·5 min
The Complete Learning Path to Understanding the Kimi K3 Technical Report
A systematic learning path for understanding the Kimi K3 technical report, covering MoE, MLA, distributed training, and modern post-training techniques.
Read more →
·4 min
Cross-Cloud GPU Preemption Migration: How to Slash 40% of Compute Costs
Deep analysis of how cross-cloud GPU preemption migration technology helps MLOps teams cut 40% of compute costs through predictive telemetry, cross-cloud state migration, and compute arbitrage.
Read more →
·4 min
How Much Math Do You Need for Machine Learning? Finding the Balance Between Preparation and Practice
How much math do you really need before starting ML projects? This article analyzes the 'bottomless pit' trap, proposes a minimum viable math framework, and offers project-driven learning strategies.
Read more →
·3 min
Dual-Layer Knowledge Graphs: How AI Safeguards Continuity in 500,000-Word Novels
CanonPulse AI uses dual-layer knowledge graphs to detect plot holes across 500,000-word novels while protecting intentional twists, solving narrative debt for serial fiction creators.
Read more →
·3 min
Dual-Layer Knowledge Graphs: How AI Safeguards Continuity in 500,000-Word Novels
CanonPulse AI uses a dual-layer knowledge graph to detect plot holes across 500K+ word novels while protecting intentional twists — shifting AI writing tools from generation to consistency maintenance.
Read more →