Android World
A benchmark for Android AI agents developed by Google, covering over 20 applications and more than 100 multi-step tasks. It is designed to evaluate the cross-application operation capabilities of mobile AI agents, assessing their ability to complete complex, sequential interactions across a diverse set of real Android applications.
Timeline (last 90 days)
In Google's Android World benchmark, Artemis reported a success rate of 99%, covering more than 20 apps and over 100 multi-step tasks.
Qwen3.8 Flash Next scored 84.5 on the Android World benchmark and 91.9/95.7 on Live Code Bench (both are official figures)
Qwen3.8 Flash Next scores 62.5 on SWE-Bench Pro, 73.9 on Cowork Bench, 84.5 on Android World, and 91.9/95.7 on Live Code Bench.
All Facts (3)
In Google's Android World benchmark, Artemis reported a success rate of 99%, covering more than 20 apps and over 100 multi-step tasks.
50%UnverifiedQwen3.8 Flash Next scored 84.5 on the Android World benchmark and 91.9/95.7 on Live Code Bench (both are official figures)
50%UnverifiedQwen3.8 Flash Next scores 62.5 on SWE-Bench Pro, 73.9 on Cowork Bench, 84.5 on Android World, and 91.9/95.7 on Live Code Bench.
50%