Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

162

Full-text search

Active filters: llm-compressor

vistralis/Qwen3-8B-INT8

Text Generation • 8B • Updated 15 days ago • 17

Sophia-AI/Qwen3-4B-Instruct-2507-AWQ-W4A16

Text Generation • 1B • Updated 10 days ago • 312

ludovicoYIN/MiniMax-M2-BF16-W4A16

Text Generation • 34B • Updated 9 days ago • 15

ekurtic/granite-4.0-h-small-FP8-block

Text Generation • 32B • Updated 8 days ago • 16

ekurtic/granite-4.0-h-small-FP8-dynamic

Text Generation • 32B • Updated 8 days ago • 15

kaitchup/Nanbeige4.1-3B-MXFP4

2B • Updated 6 days ago • 25

kaitchup/Nanbeige4.1-3B-NVFP4

3B • Updated 5 days ago • 36

kaitchup/Nanbeige4.1-3B-FP8-Dynamic

4B • Updated 5 days ago • 223

JongYeop/Qwen2.5-VL-3B-Instruct-FP8-W8A8-LM-Only

Image-Text-to-Text • 4B • Updated about 11 hours ago

JongYeop/Qwen2.5-VL-3B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 3B • Updated about 11 hours ago

JongYeop/Qwen2.5-VL-7B-Instruct-FP8-W8A8-LM-Only

Image-Text-to-Text • 8B • Updated about 6 hours ago

JongYeop/Qwen2.5-VL-7B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated about 6 hours ago