OpenAI employees publicly accuse Grok3's Benchmark test results of being misleading

GoldenOctober2024
GROK-2,47%
XAI20,52%

Jinshi Data News on February 23rd, recently, an employee of OpenAI publicly accused XAI, a company owned by Elon Musk, of releasing misleading Benchmark test results for its latest AI model, Grok3. In response, Igor Babushkin, co-founder of XAI, insisted that the company did nothing wrong. XAI’s charts show that both versions of Grok3 - Grok3 Reasoning Beta and Grok3 mini Reasoning - outperformed OpenAI’s current strongest available model, o3-mini-high, on AIME 2025. However, OpenAI employees quickly pointed out on the X platform that XAI’s charts did not include the AIME 2025 score of o3-mini-high under the ‘cons@64’ condition. Babushkin argued on the X platform that OpenAI had also released similar misleading Benchmark test charts in the past, although these charts were used to compare the performance of their own models.

View Original
Disclaimer: The information on this page may come from third parties and does not represent the views or opinions of Gate. The content displayed on this page is for reference only and does not constitute any financial, investment, or legal advice. Gate does not guarantee the accuracy or completeness of the information and shall not be liable for any losses arising from the use of this information. Virtual asset investments carry high risks and are subject to significant price volatility. You may lose all of your invested principal. Please fully understand the relevant risks and make prudent decisions based on your own financial situation and risk tolerance. For details, please refer to Disclaimer.
Comment
0/400
Birakenewekovip
· 2025-02-23 03:48
Bull Run 🐂
Reply0
Renatinho25vip
· 2025-02-23 02:47
Invest 🚀
View OriginalReply0