S1MB
A public leaderboard for evaluating decision engines or models, comprising 152 models.
Timeline (last 90 days)
S1MB uses the Borda count method, ranking multiple specialized benchmarks separately and then converting them into scores to average, avoiding a single task dominating the final result.
Darwin-27B-ZTC-v5 took first place on the S1MB Japanese track with a Borda score of 84.57, leading second-place Perplexity (80.86) by 3.71 points.
Darwin ZTC is also first place on the S1MB English track (160 models), with a score of 90.80.
S1MB (System One Mosaic Benchmark) is a benchmark specifically for evaluating decision models, which output judgments directly rather than generating text.
The operator of the S1MB leaderboard added a Japanese track, japanese-v1, containing 27 Japanese benchmarks.
VIDRAFT's judgment engine model Darwin-27B-ZTC-v5 ranked first among 152 models on the public benchmark S1MB, and the company says its performance exceeds the models of Perplexity, Cloudflare, and Meta.
On the public S1MB leaderboard, Darwin-27B-ZTC-v5 ranks first among 152 models.
All Facts (7)
S1MB uses the Borda count method, ranking multiple specialized benchmarks separately and then converting them into scores to average, avoiding a single task dominating the final result.
50%UnverifiedS1MB (System One Mosaic Benchmark) is a benchmark specifically for evaluating decision models, which output judgments directly rather than generating text.
50%UnverifiedDarwin-27B-ZTC-v5 took first place on the S1MB Japanese track with a Borda score of 84.57, leading second-place Perplexity (80.86) by 3.71 points.
50%UnverifiedDarwin ZTC is also first place on the S1MB English track (160 models), with a score of 90.80.
50%UnverifiedVIDRAFT's judgment engine model Darwin-27B-ZTC-v5 ranked first among 152 models on the public benchmark S1MB, and the company says its performance exceeds the models of Perplexity, Cloudflare, and Meta.
50%UnverifiedOn the public S1MB leaderboard, Darwin-27B-ZTC-v5 ranks first among 152 models.
50%UnverifiedThe operator of the S1MB leaderboard added a Japanese track, japanese-v1, containing 27 Japanese benchmarks.
50%