The open LLM leaderboard is completed, retired, dead, ‘ascended to a higher plane’. And in its shadow we have an amazing range of leaderboards built and maintained by the community. 
text
The open LLM leaderboard is completed, retired, dead, ‘ascended to a higher plane’. And in its shadow we have an amazing range of leaderboards built and maintained by the community. 
new_line
new_line
In this post, I just want to list some of those great leaderboards that you should bookmark for staying up to date:
text
In this post, I just want to list some of those great leaderboards that you should bookmark for staying up to date:
new_line
new_line
- Chatbot Arena LLM Leaderboard is the first port of call for checking out the best model. It’s not the fastest because humans will need to use the models to get scores, but it’s worth the wait. 
text
- Chatbot Arena LLM Leaderboard is the first port of call for checking out the best model. It’s not the fastest because humans will need to use the models to get scores, but it’s worth the wait. 
https://huggingface.co/spaces/lmarena-ai/chatbot-arena-leaderboard
https://huggingface.co/spaces/lmarena-ai/chatbot-arena-leaderboard
link
new_line
new_line
- OpenVLM Leaderboard is great for getting scores on vision language models 
text
- OpenVLM Leaderboard is great for getting scores on vision language models 
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
opencompass/open_vlm_leaderboard
space
resource
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
new_line
new_line
- Ai2 are doing a great job on RewardBench and I hope they keep it up because reward models are the unsexy workhorse of the field. 
text
- Ai2 are doing a great job on RewardBench and I hope they keep it up because reward models are the unsexy workhorse of the field. 
https://huggingface.co/spaces/allenai/reward-bench
allenai/reward-bench
space
resource
https://huggingface.co/spaces/allenai/reward-bench
new_line
new_line
- The GAIA leaderboard is great for evaluating agent applications. 
text
- The GAIA leaderboard is great for evaluating agent applications. 
https://huggingface.co/spaces/gaia-benchmark/leaderboard
gaia-benchmark/leaderboard
space
resource
https://huggingface.co/spaces/gaia-benchmark/leaderboard
new_line
new_line
🤩 This seems like such a sustainable way of building for the long term, where rather than leaning on a single company to evaluate all LLMs, we share the load. 
text
🤩 This seems like such a sustainable way of building for the long term, where rather than leaning on a single company to evaluate all LLMs, we share the load. 
The open LLM leaderboard is completed, retired, dead, ‘ascended to a higher plane’. And in its shadow we have an amazing range of leaderboards built and maintained by the community. 

In this post, I just want to list some of those great leaderboards that you should bookmark for staying up to date:

- Chatbot Arena LLM Leaderboard is the first port of call for checking out the best model. It’s not the fastest because humans will need to use the models to get scores, but it’s worth the wait. https://huggingface.co/spaces/lmarena-ai/chatbot-arena-leaderboard

- OpenVLM Leaderboard is great for getting scores on vision language models https://huggingface.co/spaces/opencompass/open_vlm_leaderboard

- Ai2 are doing a great job on RewardBench and I hope they keep it up because reward models are the unsexy workhorse of the field. https://huggingface.co/spaces/allenai/reward-bench

- The GAIA leaderboard is great for evaluating agent applications. https://huggingface.co/spaces/gaia-benchmark/leaderboard

🤩 This seems like such a sustainable way of building for the long term, where rather than leaning on a single company to evaluate all LLMs, we share the load. 
🤗
dsadd4 John6666 AtAndDev robb-0 dantezxcd
🚀
Cecil-Merrell
644852cc1d52a633c8f3b266
/avatars/74981d376562cb5e30b7aaefcbf0ec83.svg
Ash C
ashercn97
user
65d883893a52cd9bcd8ab7cf
https://cdn-avatars.huggingface.co/v1/production/uploads/65d883893a52cd9bcd8ab7cf/tRsCJlHNZo1D02kBTmfy9.jpeg
leroy Samuel Dyer
LeroyDyer
user