Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

13,698

Base only

Active filters: dpo

NU-World-Model-Embodied-AI/phyworld

Video-to-Video • Updated Aug 7 • 25

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 29 • 1.55k • 92

mradermacher/Qwen2.5-Coder-1.5B-Unsensored-DPO-GGUF

2B • Updated Feb 4 • 1.3k • 3

CEIA-RL/energy-exp1-dpo-offline

Text Generation • 4B • Updated May 31 • 204 • 8

ewin-reg/MiniCPM-V-4.7-1B-Agentic-FwS

Image-Text-to-Text • 2B • Updated 1 day ago • 193 • 2

mradermacher/tinybrainbot-360m-a75m-v5-instruct-GGUF

0.4B • Updated 5 days ago • 231 • 2

Phase-Technologies/Densy-330M-Chat

Text Generation • 0.5B • Updated 4 days ago • 65 • 2

wxzhang/dpo-selective-redteaming

Text Generation • 7B • Updated May 19, 2024 • 139 • 6

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 15.7k • • 298

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated Apr 9 • 206

danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF

Text Generation • 9B • Updated Apr 1 • 3.06k • 20

BugTraceAI/BugTraceAI-Apex-G4-26B-Q4

25B • Updated May 11 • 1.37k • 100

c4tdr0ut/grok-oss-Apollyon-24B

Text Generation • 24B • Updated Jul 9 • 2.32k • • 13

c4tdr0ut/grok-oss-Apollyon-8B

Text Generation • 8B • Updated Jul 9 • 5.61k • • 14

Atharva31/indicslm-from-scratch

Text Generation • Updated 27 days ago • 322 • 1

Riyan200324200324/Qwen3-Next-80B-A3B-Instruct-Decensored-i1-GGUF

80B • Updated 22 days ago • 1.62k • 1

KeyFicller/tiny-llm-pipeline-29m

Text Generation • Updated 5 days ago • 1

wesjos/Qwen3.5-4B-StreetTalk-GGUF

Text Generation • 4B • Updated 8 days ago • 217 • 1

zaydsyed/TactLM-Instruction-DPO-Qwen2.5-0.5B

Text Generation • 0.5B • Updated 4 days ago • 39 • 1

zaydsyed/TactLM-Instruction-DPO-GRPO-Qwen2.5-0.5B

Text Generation • 0.5B • Updated 4 days ago • 44 • 1

hokseng789/Qwen3-0.6B-French-DPO

Text Generation • 0.6B • Updated 7 days ago • 42 • 1

nkthebass/tinybrainbot-360m-a75m-v5-instruct

Text Generation • 0.4B • Updated 6 days ago • 144 • 1

aaronr43210/MiniSEAL

Text Generation • Updated 5 days ago • 1

hossain0909/keural-dpo-5500

Text Generation • 15B • Updated about 20 hours ago • 1

hossain0909/keural-dpo2-final

Text Generation • 15B • Updated about 20 hours ago • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 177 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 29 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 14

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 95 • 3