In February when Grok 3 was first on every chatbot arena metric – that was just a bit after deepseek r1, and o3, and the space has evolved a lot since then.
However, checking wikipedia it actually seems like they juiced the metrics by using unfair comparisons and letting Grok try the problems 64 times and returning the best answer in their comparisons.
Have a source on that claim?
In February when Grok 3 was first on every chatbot arena metric – that was just a bit after deepseek r1, and o3, and the space has evolved a lot since then.
However, checking wikipedia it actually seems like they juiced the metrics by using unfair comparisons and letting Grok try the problems 64 times and returning the best answer in their comparisons.
https://en.wikipedia.org/wiki/Grok_(chatbot)#Grok-3
You’ll find that Elon’s companies do this a lot…