Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

894

Base only

Active filters: ppo, trl

mxcui/sumgrad-imdb-ppo-prop0.2-alpha1.3-seed42-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 39

mxcui/vanilla-imdb-ppo-prop0.4-alpha1.0-seed43-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 27

mxcui/vanilla-imdb-ppo-prop0.3-alpha1.0-seed43-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 31

mxcui/maxmin-imdb-ppo-prop0.3-alpha1.0-seed43-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 36

mxcui/pcgrad-imdb-ppo-prop0.3-alpha1.0-seed43-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 36

mxcui/maxmin-imdb-ppo-prop0.4-alpha1.0-seed43-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 55

mxcui/pcgrad-imdb-ppo-prop0.4-alpha1.0-seed43-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 32

mxcui/vanilla-imdb-ppo-prop0.2-alpha1.0-seed42-mean_kl0.1-Qwen-Qwen3-4B-Base

Text Generation • 4B • Updated Jul 12 • 14

mxcui/pcgrad-imdb-ppo-prop0.2-alpha1.0-seed42-mean_kl0.1-Qwen-Qwen3-4B-Base

Text Generation • 4B • Updated Jul 12 • 24

mxcui/maxmin-imdb-ppo-prop0.2-alpha1.0-seed42-mean_kl0.1-Qwen-Qwen3-4B-Base

Text Generation • 4B • Updated Jul 12 • 16 • 1

mxcui/maxmin-imdb-ppo-prop0.3-alpha1.0-seed44-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 11 • 37

mxcui/vanilla-deconflict-win1_400-imdb-ppo-prop0.2-alpha0.7-seed42-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 12 • 15

mxcui/vanilla-deconflict-win400_800-imdb-ppo-prop0.2-alpha0.7-seed42-mean_kl0.1-gpt2

Text Generation • 0.1B • Updated Jul 12 • 13

mxcui/maxmin-imdb-ppo-prop0.2-alpha1.0-seed42-mean_kl0.1-EleutherAI-pythia-160m

Text Generation • 0.2B • Updated Jul 12 • 19

mxcui/vanilla-imdb-ppo-prop0.2-alpha1.0-seed42-mean_kl0.1-EleutherAI-pythia-160m

Text Generation • 0.2B • Updated Jul 12 • 23

mxcui/pcgrad-imdb-ppo-prop0.2-alpha1.0-seed42-mean_kl0.1-EleutherAI-pythia-160m

Text Generation • 0.2B • Updated Jul 12 • 19

mxcui/vanilla-imdb-ppo-prop0.2-alpha1.0-seed42-mean_kl0.05-EleutherAI-pythia-160m-lr1.4e-5

Text Generation • 0.2B • Updated Jul 12 • 25

mxcui/pcgrad-imdb-ppo-prop0.2-alpha1.0-seed42-mean_kl0.05-EleutherAI-pythia-160m-lr1.4e-5

Text Generation • 0.2B • Updated Jul 12 • 17

mxcui/maxmin-imdb-ppo-prop0.2-alpha1.0-seed42-mean_kl0.05-EleutherAI-pythia-160m-lr1.4e-5

Text Generation • 0.2B • Updated Jul 12 • 18

mxcui/vanilla-imdb-ppo-prop0.2-alpha1.0-seed42-kl0.15-EleutherAI-pythia-160m-lr7e-6

Text Generation • 0.2B • Updated Jul 12 • 24

sarimahsan101/qwen2.5-0.5b-detox-ppo

Text Generation • 0.5B • Updated Jul 15 • 53

ram-lexsi/aligntune-testrun-PPO

ram-lexsi/agenttune-testrun-PPO

Updated 27 days ago

lxxexxbxx/gemma3-4b-ko-rlaif-ppo

Text Generation • Updated 18 days ago • 22