Bohf-12B-MoE-3A / README.md
theprint's picture
Create README.md
d4f2dc6 verified
metadata
license: llama3.2
language:
  - en
base_model:
  - dphn/Dolphin3.0-Llama3.2-3B
  - HenryShan/Llama-3.2-3B-GSM8K-CoT
  - theprint/Llama-3.2-3B-VanRossum
  - ConicCat/Litbench-Creative-Writing-RM-3B
pipeline_tag: text-generation
tags:
  - moe

BoHF (Best of Hugging Face)

This is a highly experimental mixture of experts model, containing 4 expert models. The individual expert models are based on Llama 3.2 3B fine tunes that represent some of the most popular models of this kind.

Expert Source Models

Big shout out to the makers of these original models, now serving as experts in BoHF!