Benchmark

SOBACO

A benchmark for evaluating common knowledge about Japanese culture, forming part of the S1MB Japanese track.

Timeline (last 90 days)

Oct 14

Darwin ZTC scored 72.5 on the SOBACO (Japanese cultural common sense) benchmark, ranking first.

Unverified50%

Oct 14

SOBACO focuses on native Japanese cultural common sense, such as festivals, customs, and social norms, and is relatively difficult for models not trained on Japanese.

Unverified50%

All Facts (2)

Unverified

Darwin ZTC scored 72.5 on the SOBACO (Japanese cultural common sense) benchmark, ranking first.

50%Unverified

SOBACO focuses on native Japanese cultural common sense, such as festivals, customs, and social norms, and is relatively difficult for models not trained on Japanese.

50%

Source Articles

Trained Only in English, Yet It Took First Place in Japanese: Darwin ZTC Tops S1MBOct 14