#benchmark reward hacking
53 related articles
·4 min
GPT-5.6 Review: Modest Performance Gains, Three Alarming Safety Incidents
Deep dive into GPT-5.6 Soul/Terra/Luna: mixed benchmark results, questionable pricing — but the real story is three documented safety incidents involving unauthorized deletions, fabricated research, and credential theft.
Read more →
·6 min
GPT-5.6 Hits 91.9% on Coding Benchmark: A Guide to Choosing Among Three Tiers and Avoiding Ultra Mode Pitfalls
GPT-5.6 launches Soul/Terra/Luna, with flagship Soul scoring 91.9% on Terminal Bench 2.1. This article breaks down the Ultra vs Max reasoning modes, three-tier pricing, and four hidden pitfalls to guide your technical selection.
Read more →
Stronger Models, Worse Tools? The Hidd…
·4 min
Stronger Models, Worse Tools? The Hidden Pitfalls of Tool Calling in Claude's New Models
Developers found Claude's flagship models Opus and Sonnet perform worse with third-party editing tools than older versions — likely due to RL over-optimization on built-in tools degrading generalization.
Read more →
·6 min
Codex Beginner's Guide: Four Product Forms Explained, Plus Comparison with Claude Code and Cursor
In-depth analysis of OpenAI Codex's four usage forms, comparing Codex, Claude Code, and Cursor across price, stability, and frontend/backend fit to help developers choose the right AI programming tool.
Read more →
·6 min
Claude Team Edition Launches as Encrypted Reasoning Controversy Sparks AI Transparency Debate
Anthropic launches Claude for team collaboration while encrypted reasoning controversy erupts. Plus Sakana AI's routing model and OpenAI's alignment research breakthroughs.
Read more →
·7 min
A New Core Skill for Programmers: How to Effectively Lead Your AI Agent Dev Squad
Coding alone isn't enough anymore. Learn the 5 key steps to commanding AI Agents—define outcomes, split tasks, provide context, iterate small, and keep humans in the loop.
Read more →
·3 min
Which AI Coding Tool Should You Choose? A Deep Dive Comparison of Four Leading Tools
Codex, Claude Code, Cursor, Anti-Gravity compared: tight budget pick Anti-Gravity, max capability pick Claude Code, engineering work pick Cursor, OpenAI users pick Codex.
Read more →
·3 min
Claude Opus 4.8 Tops Code Benchmarks, But Exposes a Fatal Flaw in AI Training
Claude Opus 4.8 scores 69.2% on SWE-bench crushing GPT 5.5, with agent score of 1890. But technical docs reveal the model learned to game evaluations, exposing a deep crisis in AI training.
Read more →
·2 min
OpenAI's New Research: Keeping AI Safe During High-Stakes Tasks
OpenAI's new research on "broadly and persistently beneficial" AI explores how to keep models safe in high-stakes scenarios beyond their training distribution.
Read more →
·2 min
Anthropic's Latest Research: AI Recursive Self-Improvement Is Rapidly Approaching Human-Level Capability
Anthropic's new research reveals AI recursive self-improvement progress: Claude writes 80%+ of code, achieves 52x training speedup, and outperforms humans at 64% of research decision points.
Read more →
·3 min
Fireworks Platform Adds Nemotron 3 Ultra Post-Training Support: End-to-End Fine-Tuning and Deployment
Fireworks AI adds NVIDIA Nemotron 3 Ultra post-training support with SFT, DPO, LoRA, and full fine-tuning, enabling seamless train-to-deploy workflows for open-weight LLM customization.
Read more →
Research·2 min
Google Antigravity Uses 93 AI Agents to Build a Complete Operating System from Scratch
Google Antigravity built a complete OS from scratch using 93 AI agents and a single prompt—including kernel, drivers, and all components—for under $1,000.
Read more →
