@FinancialSupport
mention
FinancialSupport
 and I  just released a new version of the Italian LLMs leaderboard 
text
 and I  just released a new version of the Italian LLMs leaderboard 
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
link
text
new_line
  using the super useful  
text
  using the super useful  
https://www.gravatar.com/avatar/575ff0df07f1802085a666db8898ae73?d=retro&size=100
https://huggingface.co/demo-leaderboard
demo-leaderboard
org
resource
https://huggingface.co/demo-leaderboard
 template from 
text
 template from 
@clefourrier
mention
clefourrier
. 
text
. 
new_line
We’ve evaluated over 50 models (base, merged, fine-tuned, etc.) from:
text
We’ve evaluated over 50 models (base, merged, fine-tuned, etc.) from:
new_line
- Major companies like Meta, Mistral, Google ... 
text
- Major companies like Meta, Mistral, Google ... 
new_line
- University groups such as  
text
- University groups such as  
https://cdn-avatars.huggingface.co/v1/production/uploads/618d248d19d7d2a706004ba5/fWH1AzZr0oIgj7mhC3YIG.png
https://huggingface.co/sapienzanlp
sapienzanlp
org
resource
https://huggingface.co/sapienzanlp
 or 
text
 or 
https://cdn-avatars.huggingface.co/v1/production/uploads/642c2ca6c3694d2b74565282/N2I_a_MB8JK0Z6odpAYF8.png
https://huggingface.co/swap-uniba
swap-uniba
org
resource
https://huggingface.co/swap-uniba
new_line
- Italian Companies like  
text
- Italian Companies like  
https://huggingface.co/MoxoffSpA
MoxoffSpA
userOrOrg
resource
https://huggingface.co/MoxoffSpA
 , 
text
 , 
https://cdn-avatars.huggingface.co/v1/production/uploads/64bfc8b0ae53ad9c7018abdc/rk3Y2giUZV1GZFsNRBAAe.png
https://huggingface.co/FairMind
FairMind
org
resource
https://huggingface.co/FairMind
  or 
text
  or 
https://cdn-avatars.huggingface.co/v1/production/uploads/5f4e175579c1ba4c353d136f/fOEyf9GNgnKhhE69hX-vK.png
https://huggingface.co/raicrits
raicrits
org
resource
https://huggingface.co/raicrits
text
new_line
- Various communities and individuals 
text
- Various communities and individuals 
new_line
All models were tested on #Italian benchmarks #mmlu #arc-c #hellaswag, which we contributed to the opensource lm-evaluation-harness library from 
text
All models were tested on #Italian benchmarks #mmlu #arc-c #hellaswag, which we contributed to the opensource lm-evaluation-harness library from 
https://cdn-avatars.huggingface.co/v1/production/uploads/1614054059123-603481bb60e3dd96631c9095.png
https://huggingface.co/EleutherAI
EleutherAI
org
resource
https://huggingface.co/EleutherAI
. 
text
. 
new_line
Plus, you can now submit your model for automatic evaluation, thanks to  to  
text
Plus, you can now submit your model for automatic evaluation, thanks to  to  
https://cdn-avatars.huggingface.co/v1/production/uploads/64466feec41681efdb9cee5f/NjDB5B62M1Kv4ey7u4aKa.png
https://huggingface.co/seeweb
seeweb
org
resource
https://huggingface.co/seeweb
  sponsored computation.
text
  sponsored computation.
new_line
Curious about the top Italian models? Check out the leaderboard and submit your model!
text
Curious about the top Italian models? Check out the leaderboard and submit your model!
new_line
new_line
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard
link
new_line
new_line
@FinancialSupport and I  just released a new version of the Italian LLMs leaderboard https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard 
  using the super useful  https://huggingface.co/demo-leaderboard template from @clefourrier. 
We’ve evaluated over 50 models (base, merged, fine-tuned, etc.) from:
- Major companies like Meta, Mistral, Google ... 
- University groups such as  https://huggingface.co/sapienzanlp or https://huggingface.co/swap-uniba
- Italian Companies like  https://huggingface.co/MoxoffSpA , https://huggingface.co/FairMind  or https://huggingface.co/raicrits 
- Various communities and individuals 
All models were tested on #Italian benchmarks #mmlu #arc-c #hellaswag, which we contributed to the opensource lm-evaluation-harness library from https://huggingface.co/EleutherAI. 
Plus, you can now submit your model for automatic evaluation, thanks to  to  https://huggingface.co/seeweb  sponsored computation.
Curious about the top Italian models? Check out the leaderboard and submit your model!

https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard


❤️
PereLluis13 clefourrier dillfrescott giux78 DeepMount00
🚀
victor giux78