Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

speculative-decoding

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,129

Base only

Active filters: speculative-decoding

mlx-community/gemma-4-26B-A4B-it-qat-assistant-mxfp8

Text Generation • 0.1B • Updated Jun 5 • 506 • 1

mlx-community/gemma-4-31B-it-qat-assistant-4bit

Text Generation • 73.4M • Updated Jun 5 • 580

mlx-community/gemma-4-31B-it-qat-assistant-5bit

Text Generation • 88M • Updated Jun 5 • 48

mlx-community/gemma-4-31B-it-qat-assistant-6bit

Text Generation • 0.1B • Updated Jun 5 • 113

mlx-community/gemma-4-31B-it-qat-assistant-8bit

Text Generation • 0.1B • Updated Jun 5 • 274

mlx-community/gemma-4-31B-it-qat-assistant-bf16

Text Generation • 0.5B • Updated Jun 5 • 790 • 1

mlx-community/gemma-4-31B-it-qat-assistant-mxfp4

Text Generation • 88M • Updated Jun 5 • 136

mlx-community/gemma-4-31B-it-qat-assistant-nvfp4

Text Generation • 0.1B • Updated Jun 5 • 77

mlx-community/gemma-4-31B-it-qat-assistant-mxfp8

Text Generation • 0.1B • Updated Jun 5 • 558 • 1

cortexist/gemma-4-12B-it-assistant-MTP-GGUF

Text Generation • 0.4B • Updated Jun 5 • 683 • 2

vladimir94/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4-GGUF

Text Generation • 35B • Updated Jun 6 • 5k

mradermacher/OYM-Qimi-122B-A10B-K2.6-GGUF

125B • Updated Jun 6 • 313

patrickbdevaney/qwen-3.6-35b-a3b-dflash-jetson-agx-thor

Text Generation • Updated Jun 7

mradermacher/OYM-Qimi-122B-A10B-K2.6-i1-GGUF

125B • Updated 19 days ago • 1.84k • 5

NeoRoth/gemma-4-e4b-it-assistant-mlx

78.8M • Updated Jun 6 • 28

NeoRoth/gemma-4-26b-a4b-it-assistant-mlx

0.4B • Updated Jun 6 • 65

NeoRoth/gemma-4-31b-it-assistant-mlx

0.5B • Updated Jun 6 • 48

Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 6 • 4.93k • 36

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Speed

Text Generation • 6B • Updated Jun 7 • 1.23k • 1

boxwrench/gemma-4-qat-mtp-assistant-heads

0.4B • Updated Jun 6 • 464 • 4

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance

Text Generation • 8B • Updated Jun 7 • 1.26k • 6

Youssofal/Qwen3.5-9B-MTPLX-Optimized-Speed

Text Generation • 9B • Updated Jun 11 • 1.74k • 3

Youssofal/Qwen3.5-9B-MTPLX-Optimized-Speed-FP16

Text Generation • 9B • Updated Jun 7 • 439 • 1

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Speed-FP16

Text Generation • 6B • Updated Jun 7 • 442

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance-FP16

Text Generation • 8B • Updated Jun 7 • 312 • 1

nerkyor/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill

Text Generation • 35B • Updated 24 days ago • 33.3k • 8

kunhunjon/gemma-4-12B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 7 • 277 • 1

ManiacLabs/DeepSeek-V4-Flash-EAGLE3.1

Text Generation • Updated Jun 7 • 158 • 6

sakamakismile/Huihui-gemma-4-12B-it-abliterated-NVFP4A16

Image-Text-to-Text • 7B • Updated Jun 7 • 1.72k • 2

superbonyx/gemma-4-26B-A4B-it-qat-assistant-MTP-Q8_0.gguf

Text Generation • 0.4B • Updated Jun 8 • 478 • 1