#SFT
129 related articles
·3 min
Why SFT Can't Fix the Root Cause of JSON Errors: How GRPO Correctness Training Breaks Through Coding Agent Bottlenecks
Analysis of why SFT can't fix coding agent JSON errors and how GRPO's binary reward signals and synchronized weight updates train directly for correctness.
Read more →
Deep Dives·3 min
Complete Guide to LLM Training: Pre-training, SFT Fine-tuning, and Preference Alignment Explained
Complete guide to the three core LLM training stages: pre-training, supervised fine-tuning (SFT), and preference alignment (DPO/PPO), covering LoRA, distillation, quantization, and pruning.
Read more →
·3 min
Deep Dive into Inkling: The First Frontier Open-Source Multimodal LLM from the West
Thinking Machines releases Inkling, an open-source multimodal LLM with near-trillion MoE parameters, 1M token context, Apache 2.0 license. Deep dive into architecture, benchmarks, and pricing.
Read more →
·4 min
Kimi K2/K3 Technical Speculation: Deep Dive into RL Hyperparameters and Multi-Teacher Distillation
Deep analysis of RL hyperparameter tuning challenges and 9-policy multi-teacher distillation in Kimi K2/K3 training, exploring the shift from scale to training craft.
Read more →
·3 min
A 9B Model Beats Frontier LLMs After Just $500 in RL Fine-Tuning
Just $500 in RL fine-tuning enables a 9B open-source model to outperform frontier LLMs on catalog review tasks. Analysis of when small-model RL works and its enterprise implications.
Read more →
·3 min
Google Launches Gemini 4 Pre-training: Its Most Ambitious AI Model Training Yet
Google DeepMind announces Gemini 4 pre-training has begun, calling it their most ambitious training yet. A deep dive into its technical direction, compute scale, multimodal breakthroughs, and competitive impact.
Read more →
·3 min
From RAG to Agent Tuning: A Complete Guide to Deploying LLM Agents
A deep dive into LLM Agent frameworks covering RAG, Agent core components (tools, memory, planning), and Agent Tuning workflows with cost considerations for production deployment.
Read more →
·4 min
The Dao of DeepSeek: Liang Wenfeng on Vision, Restraint, and the Philosophy of Open Source
Analysis of DeepSeek founder Liang Wenfeng's rare investor dialogue, exploring the company's vision-driven culture, strategic restraint toward AGI, and open-source philosophy in the US-China AI race.
Read more →
·5 min
Getting Started with Codex: Four Product Forms Explained & How to Choose Between Cursor, Claude Code, and Codex
In-depth analysis of OpenAI Codex's four forms (CLI, web, plugin, app), comparing Codex, Claude Code, and Cursor on price, stability, and use cases to help developers choose the right tool.
Read more →
·4 min
Making $3,000/Month Freelancing with Codex? A Rational Look at AI Coding Side Hustles
Can AI coding tools really earn you $3K/month with zero experience? We break down the marketing hype around Codex freelancing, examine the 4-week roadmap, and reveal what AI-assisted coding can realistically offer.
Read more →
·3 min
Is Gemini Getting Worse? A Deep Dive into the 'Model Degradation' Phenomenon
Reddit users report Gemini feeling "worse over time." This deep dive explains the real causes—silent updates, safety over-alignment, and compute throttling—plus how to rationally evaluate AI model performance.
Read more →
·7 min
Getting Started with Codex: Installation and Usage Guide for OpenAI's AI Coding Agent
A comprehensive guide to OpenAI's new AI coding agent Codex: from concept and comparison of its four forms, to installing Git/Node.js/VS Code, configuring the API Key, and creating a workspace.
Read more →
·6 min
The AI Industrial Age Arrives: Compute Wars, Chip Reconstruction, and the GPT-5.6 Cheating Scandal Explained
Five key AI industry trends: Doubao surpasses 180 trillion daily calls, OpenAI's in-house AI chip, NVIDIA's $3-4 trillion compute forecast, China catching up, and the GPT-5.6 cheating scandal.
Read more →
·7 min
DeepSeek's Mysteriously Retracted Paper: Breaking AI's Multimodal Reasoning Bottleneck with Visual Primitives
DeepSeek's paper 'Thinking with Visual Primitives' was online for just 4 hours before being pulled. It uses bounding boxes and points as reasoning primitives, letting models 'point at' images to outperform GPT, Gemini, and Claude on maze navigation and counting.
Read more →
·8 min
LangChain Crash Course: A Complete Roadmap from Zero to Agent Development
A systematic roadmap from LangChain and LangGraph to multi-agent development, covering RAG, Tool Calling, MCP, and more, helping developers break into AI app development.
Read more →
·3 min
Grok 4.5 Review: A Full Breakdown of Elon Musk's Most Powerful AI Coding Model
xAI releases Grok 4.5, ranking #1 on SWE Marathon and outperforming Claude Opus. Explore benchmark scores, Agent capabilities, free access, and CLI installation.
Read more →
·7 min
The Complete Guide to LLM Application Engineer Interviews: Six High-Frequency Topics in the Agent Domain
A focused guide to the core interview topics for LLM application engineers, covering agent architecture, Multi-Agent, Langfuse evaluation & tracing, security, and RAG optimization.
Read more →
·7 min
The Complete Guide to LLM Application Engineer Interviews: Six High-Frequency Agent Topics
A focused guide to core LLM application engineer interview topics, covering agent architecture, Multi-Agent, Langfuse evaluation, security, and RAG optimization.
Read more →
·7 min
Qwen3 235B A22B in Practice: A 2.4-Trillion-Parameter Open Model Surpasses Claude Opus
Hands-on with Alibaba Tongyi Qianwen's strongest Qwen3: a 2.4-trillion-parameter open weight model scoring 81.25% on KingBench, ranking second and beating Claude Opus 4.8 with perfect scores in game dev, math, and agent tasks.
Read more →
·3 min
Three Major Chinese AI Models Incoming: Qwen 4, DeepSeek V4, and GLM Next Version Breakdown
Alibaba Qwen 4, DeepSeek V4, and Zhipu GLM's next-gen models are all nearing release. A deep dive into the latest leaks, capability improvements, and timelines for these three Chinese AI flagships.
Read more →