 | |
Type of site | Chatbot, artificial intelligence |
|---|---|
| Country of origin | United States |
| Owner | LMSYS Org |
| Founder(s) |
|
| URL | lmarena |
| Commercial | No |
| Registration | None |
| Launched | May 3, 2023 |
Chatbot Arena is a chatbot website for comparing and measuring performance of large language models based on human preference. Users enter prompts for two anonymous models to respond to and vote on the model that gave the better response, in which the model's identities are revealed. Users can also choose models to test themselves. [1] [2]
Chatbot Arena is popular within the artificial intelligence industry, with major companies supplying their large language models, such as GPT-4o, o1, Gemini, [3] and Claude, [4] and using their subsequent rankings to promote them. Notably, Chinese company DeepSeek tested its prototype models in the Chatbot Arena months before its R1 model gained attention in Western media. [5] The website has even been used for preview releases of upcoming models. However, Chatbot Arena's methodology for measuring large language model performance has been questioned as insufficient. [6] [7]
