#SOTA benchmark culture
3 related articles
·3 min
SlopCodeBench: Why AI Code Benchmarks Are Failing
SlopCodeBench sparks deep reflection on AI code evaluation. From benchmark contamination to pass-rate pitfalls, exploring why current benchmarks fail to measure real code quality.
Read more →
·4 min
The Pain of AI Paper Peer Review: Why Should Models Released After the Deadline Count Against You?
A Reddit post exposes ARR review misconduct: a reviewer scored 1 for not comparing against a model released after the submission deadline. This article analyzes structural problems in AI academic peer review and proposes reform directions.
Read more →
·2 min
FTC Reaches Settlement with John Deere: A Landmark Victory for the Right to Repair Movement
The FTC reached a landmark settlement with John Deere, granting farmers and independent repair shops the right to fix their own equipment. Here's what it means for the Right to Repair movement and the broader tech industry.
Read more →