AI摩卡
A third-party AI model evaluation organization that publishes evaluation results for open-source models along with reproducible evaluation processes.
Timeline (last 90 days)
The third-party evaluation organization AI Mocha gave Qianwen 3-27B a score of 34 in a comprehensive test of math, code, and research abilities, while the champion of a year earlier, GPT-4o, scored only 23.
AI Mocha publicly released Qianwen 3-27B's full model weights, evaluation code, and research methods, so anyone can reproduce the results on their own hardware.
All Facts (2)
The third-party evaluation organization AI Mocha gave Qianwen 3-27B a score of 34 in a comprehensive test of math, code, and research abilities, while the champion of a year earlier, GPT-4o, scored only 23.
50%UnverifiedAI Mocha publicly released Qianwen 3-27B's full model weights, evaluation code, and research methods, so anyone can reproduce the results on their own hardware.
50%