Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

161

Base only

Active filters: metal

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated about 12 hours ago • 201k • • 683

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated about 12 hours ago • 1.05M • 400

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated 3 days ago • 17.1k • 117

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 3 days ago • 14.6k • 101

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 19k • 751

antirez/deepseek-v4-gguf

Text Generation • 20B • Updated 1 day ago • 3.61M • 329

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 614k • 99

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 9.53k • 79

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 9.98k • 52

rbinrs/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 14 • 1.17k • 2

mlboydaisuke/Qwen3.6-35B-A3B-CoreAI

Text Generation • Updated 15 days ago • 340 • 4

mlboydaisuke/LFM2.5-8B-A1B-CoreAI

Text Generation • Updated 15 days ago • 648 • 1

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit

Image-Text-to-Text • 8B • Updated 20 days ago • 2.89k • 3

peppi314/Bonsai-27B-dSpark-MLX-4bit

Text Generation • 0.3B • Updated 3 days ago • 725 • 1

HarroweD/HarrlogosXL

Text-to-Image • Updated Jan 14, 2024 • 331 • • 15

RalFinger/chrome-style-sdxl-lora

Text-to-Image • Updated Nov 22, 2023 • 25 • • 1

e-n-v-y/envy-metallic-xl-01

Text-to-Image • Updated Nov 24, 2023 • 4 • • 2

UnionStreet/vision-1-mini

Text Classification • 8B • Updated Jan 16, 2025 • 8 • 1

halley-ai/gpt-oss-20b-MLX-4bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 137 • 3

halley-ai/gpt-oss-20b-MLX-6bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 52 • 1

halley-ai/gpt-oss-20b-MLX-5bit-gs32

Text Generation • 21B • Updated Sep 8, 2025 • 39 • 1

halley-ai/gpt-oss-120b-MLX-8bit-gs32

Text Generation • 117B • Updated Sep 8, 2025 • 40 • 1

halley-ai/gpt-oss-120b-MLX-bf16

Text Generation • 117B • Updated Sep 8, 2025 • 225 • 3

halley-ai/gpt-oss-120b-MLX-6bit-gs64

Text Generation • 117B • Updated Sep 8, 2025 • 75 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-4bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 29 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-5bit-gs32

Text Generation • 80B • Updated Sep 19, 2025 • 23 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 17 • 1

JeffersonNunn/metal-flash-attention-bridge

Updated Oct 23, 2025

JeffersonNunn/deepseek-ocr-metal

Updated Oct 23, 2025 • 4

Dogacel/DeepSeek-OCR-Metal-MPS

Image-Text-to-Text • 3B • Updated Dec 24, 2025 • 73 • 13