Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

3,259

Base only

Active filters: 2-bit

fyb1214/Ternary-Bonsai-2-4B-ninfer

Text Generation • Updated 9 days ago • 63 • 1

lxe/DeepSeek-V4.1-Flash-1017-dsx-2bit

Text Generation • 552B • Updated 3 days ago • 7.2k • 4

diegogranziol/whisper-large-v3-turbo-bpdq-2bit-qat

Automatic Speech Recognition • Updated 7 days ago • 18 • 1

Genrius-AI/Llama-3.1-8B-Pingala8-2bit

Text Generation • 3B • Updated about 11 hours ago • 505 • 1

brandonmusic/DeepSeek-V4.1-Flash-1017-TrellisMX-K2-Mix-5GB

Text Generation • 115B • Updated 6 days ago • 55 • 1

araysuter/Ornith-1.5-122B-MLX-mixed-2bit-down3

Text Generation • 123B • Updated 5 days ago • 336 • 1

wrldsuksgo2mars/Kimi-K3-EXL3-K2-Core-K6

366B • Updated 4 days ago • 26 • 1

tablinum/Lite-Beam-1.0-501B-A23B-IQS_XXS

Text Generation • 501B • Updated about 3 hours ago • 883 • 1

chimpanzeetaxidriver/flint-oQ2e-fp16

Text Generation • 40B • Updated 1 day ago • 240 • 1

Bestbug/Swift-Bonsai-2-PQ2_0-MTP-Q8_0

Text Generation • 27B • Updated about 15 hours ago • 1

OsaurusAI/Nanbeige4.3-33B-JANG_2D

Text Generation • 33B • Updated about 3 hours ago • 1

Ayushnangia/bloom3B-2bit-gptq

Text Generation • Updated Aug 28, 2023 • 28

kaitchup/Llama-2-7b-gptq-2bit

Text Generation • 7B • Updated Sep 11, 2023 • 22 • 1

nesty/sg-bart-large-4096-gptq-2bit

Updated Sep 21, 2023 • 13

Arylwen/instruct-palmyra-20b-gptq-2

Text Generation • Updated Oct 5, 2023 • 15

lebe1/opt-125m-2bit

Text Generation • 0.1B • Updated Nov 21, 2023 • 19

Sujan42024/dlite-v2-1_5b-2bitQuantization

Text Generation • 2B • Updated Nov 28, 2023 • 19

kaitchup/Mistral-7B-v0.1-gptq-2bit

Text Generation • 7B • Updated Jan 19, 2024 • 23

kaitchup/Llama-2-13b-hf-gptq-2bit

Text Generation • 13B • Updated Jan 19, 2024 • 18

kaitchup/Llama-2-7b-hf-gptq-2bit

Text Generation • 7B • Updated Jan 20, 2024 • 58

MaziyarPanahi/phi-2-GGUF

Text Generation • 3B • Updated Jan 26, 2024 • 271 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 735 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 757 • 4

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • 7B • Updated Jan 30, 2024 • 1.63k • 5

MaziyarPanahi/NeuralPipe-7B-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 367 • 3

MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 559 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 1.08k • 2

MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 448 • 2

MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 545 • 1

MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 583 • 1