Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

speculative-decoding

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,095

Base only

Active filters: speculative-decoding

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Speed-FP16

Text Generation • 6B • Updated Jun 7 • 456

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance-FP16

Text Generation • 8B • Updated Jun 7 • 326 • 1

nerkyor/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill

Text Generation • 35B • Updated 21 days ago • 33.3k • 8

kunhunjon/gemma-4-12B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 7 • 291 • 1

plunderstruck/Qwen3.6-27B-MTP-ROCmFP4-GGUF

0.5B • Updated 29 days ago • 2.05k • 26

ManiacLabs/DeepSeek-V4-Flash-EAGLE3.1

Text Generation • Updated Jun 7 • 187 • 6

sakamakismile/Huihui-gemma-4-12B-it-abliterated-NVFP4A16

Image-Text-to-Text • 7B • Updated Jun 7 • 1.99k • 2

superbonyx/gemma-4-26B-A4B-it-qat-assistant-MTP-Q8_0.gguf

Text Generation • 0.4B • Updated Jun 8 • 559 • 1

kunhunjon/gemma-4-26B-A4B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 8 • 18.1k

plunderstruck/Qwen3.6-35B-A3B-MTP-ROCmFP4-GGUF

0.4B • Updated 29 days ago • 2.16k • 10

ysong21/gemma-4-12B-it-qat-assistant-MTP-Q4_0-GGUF

Text Generation • 0.4B • Updated Jun 8 • 896

asherszhang/MiniMax-M2.7-EAGLE3-draft-vocab200k

1B • Updated Jun 8 • 80

asherszhang/MiniMax-M2.7-EAGLE3-draft-vocab32k

1.0B • Updated Jun 8 • 144

inference-optimization/Qwen3-8B-from-Qwen3-8B_regen-speculators.eagle3-qwen3arch-ckpt1

1B • Updated Jun 10 • 25.1k

Janvitos/gemma-4-26B-A4B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 8 • 1.04k • 3

Janvitos/gemma-4-31B-it-qat-assistant-MTP-Q8_0-GGUF

0.5B • Updated Jun 8 • 477 • 4

Vegss/Qwopus3.6-35B-A3B-v1-MTP-GGUF

Image-Text-to-Text • 0.4B • Updated Jun 8 • 291

Kh0rd/gemma-4-12B-it-qat-assistant-q8_0-gguf

Text Generation • 0.4B • Updated Jun 8 • 96

Pulsate1680/gemma-4-mtp-q8_0-gguf

Text Generation • 0.4B • Updated Jun 9 • 101

cascade-tech/gemma-4-E4B-it-qat-q4_0-unquantized-assistant-gguf

78M • Updated Jun 9 • 788 • 1

amaranus/Gemma-4-E4B-it-qat-assistant-MTP-Q8_0-GGUF

78M • Updated Jun 13 • 628 • 2

saital/qwen4b-adaptfm-7p8x-vllm

RedHatAI/Qwen3-8B-speculator.peagle

2B • Updated Jun 9 • 69

eadx/Qwopus3.6-27B-v2-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated Jun 10 • 320

challychoi/Lara-TRT-EDGE-LLM-Qwen3.5-9B-INT4

SEBK4C/gemma-4-12b-it-qat-q4_0-llamafile

Text Generation • Updated 13 days ago • 272

dataopsnick/adapt-diff-qwen-0.8b

Text Generation • 0.8B • Updated 21 days ago • 60

naveenrajk/Qwen3.5-4B-DFlash-W8A16

Text Generation • 0.5B • Updated Jun 10 • 23

meshllm/GLM-4.7-Flash-MTP-GGUF

Text Generation • 31B • Updated 19 days ago • 888

LordAce9/Gemma-4-31B-it-QAT-MX46A_S-GGUF

Text Generation • 31B • Updated Jun 11 • 188