Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,159

Base only

Active filters: speculative-decoding

Anbeeld/Qwen3.5-9B-DFlash-GGUF

Feature Extraction • 1B • Updated 7 days ago • 3.63k • 4

developerjeremylive/Qwopus3.5-9B-Coder-MTP-GGUF-etheroi

Text Generation • 9B • Updated May 27 • 209

tnhnyzc/Step-3.5-Flash-MTP-GGUF

Text Generation • 2B • Updated Jun 3 • 138

0xSero/DeepSeek-V4-Flash-180B

Text Generation • 102B • Updated May 30 • 12.2k • 33

mlx-community/DeepSeek-V4-Flash-MTP-bf16

Text Generation • 1B • Updated Jun 1 • 2.13k • 1

Moonlight556/Kimi-Linear-48B-A3B-DFlash-240k

Feature Extraction • 0.5B • Updated May 27 • 14

Huang2020/Qwen3-4B-Domino-b16

Text Generation • 0.6B • Updated 1 day ago • 3.04k • 5

Huang2020/Qwen3-8B-Domino-b16

Text Generation • 1B • Updated 1 day ago • 454 • 1

prithivMLmods/Qwen3.5-4B-MTP-GGUF

Image-Text-to-Text • 4B • Updated Jun 1 • 1.67k • 3

prithivMLmods/Qwen3.6-27B-MTP-GGUF

Image-Text-to-Text • 27B • Updated Jun 4 • 2.14k • 3

qwe123wjb/BudgetDraft-checkpoints

Updated May 28 • 1

prithivMLmods/Qwen3.6-35B-A3B-MTP-GGUF

Image-Text-to-Text • 36B • Updated Jun 1 • 866 • 3

vadery/Qwen3.5-27B-W8A8

Image-Text-to-Text • 28B • Updated May 29 • 47

mradermacher/Qwopus3.5-4B-Coder-GGUF

4B • Updated May 29 • 793 • 3

BalajiAI/qwen2.5-0.5b.dflash

mradermacher/Qwopus3.5-4B-Coder-i1-GGUF

4B • Updated May 29 • 313 • 1

poolside-laguna-hackathon/lean-laguna

Text Generation • Updated May 30 • 1

Hikari07jp/Step-3.7-Flash-MTP-draft

Text Generation • 3B • Updated May 29 • 141 • 6

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-MTP-runtime

Text Generation • 36B • Updated May 31 • 183 • 2

robbatt/Qwen3.6-40B-Deckard-NVFP4

27B • Updated Jun 4 • 401 • 1

s-batman/Qwopus3.6-27B-v2-NVFP4-MTP-GGUF

Text Generation • 0.5B • Updated May 30 • 229 • 2

Lambent/Arsenic-Shahrazad-12B-v4.4.1-mtp

Text Generation • 12B • Updated Jun 13 • 9

developerjeremylive/Qwopus3.6-27B-v2-MTP-GGUF-etheroi

Image-Text-to-Text • 0.5B • Updated May 31 • 162

mradermacher/Arsenic-Shahrazad-12B-v4.4.1-mtp-GGUF

12B • Updated Jun 2 • 150

mlx-community/Qwen3.5-4B-MTP-bf16

Text Generation • 0.1B • Updated Jun 1 • 179 • 1

mlx-community/Qwen3.5-9B-MTP-bf16

Text Generation • 0.2B • Updated Jun 1 • 298 • 1

mlx-community/Qwen3.5-9B-MTP-4bit

Text Generation • 38M • Updated Jun 1 • 1.03k • 2

mlx-community/Qwen3.5-9B-MTP-5bit

Text Generation • 45.6M • Updated Jun 1 • 285 • 1

mlx-community/Qwen3.6-27B-MTP-bf16

Text Generation • 0.4B • Updated Jun 1 • 1.39k • 2

mlx-community/Qwen3.6-27B-MTP-5bit

Text Generation • 79.7M • Updated Jun 1 • 723 • 1