nkthebass/tinybrainbot-61m-a10m-v4.1-moe-base
Text Generation • 64.2M • Updated • 79
TinyBrainBot v4.1
Mixture-of-experts models: many experts per layer, only a few active per token.
Mixture-of-experts models: many experts per layer, only a few active per token.