We just released a new MoE model (meraGPT/mera-mix-4x7B) that is half as large as Mixtral-8x7B while still been competitive with it across different benchmarks. mera-mix-4x7B achieves 76.37 on the open LLM eval.
text
We just released a new MoE model (meraGPT/mera-mix-4x7B) that is half as large as Mixtral-8x7B while still been competitive with it across different benchmarks. mera-mix-4x7B achieves 76.37 on the open LLM eval.
new_line
new_line
You can check mera-mix-4x7B out on HF here - 
text
You can check mera-mix-4x7B out on HF here - 
https://huggingface.co/meraGPT/mera-mix-4x7B
meraGPT/mera-mix-4x7B
model
resource
https://huggingface.co/meraGPT/mera-mix-4x7B
We just released a new MoE model (meraGPT/mera-mix-4x7B) that is half as large as Mixtral-8x7B while still been competitive with it across different benchmarks. mera-mix-4x7B achieves 76.37 on the open LLM eval.

You can check mera-mix-4x7B out on HF here - https://huggingface.co/meraGPT/mera-mix-4x7B
🔥
codelion osanseviero victor sosoai