New TRL + OpenEnv example! 💥
text
New TRL + OpenEnv example! 💥
new_line
new_line
Fine tune an LLM for playing Sudoku using an RL env via OpenEnv
text
Fine tune an LLM for playing Sudoku using an RL env via OpenEnv
new_line
new_line
Includes a script that runs on 1 or multiple GPUs with vLLM, plus a Colab-ready notebook.
text
Includes a script that runs on 1 or multiple GPUs with vLLM, plus a Colab-ready notebook.
new_line
new_line
Enjoy!
text
Enjoy!
new_line
new_line
Notebook: 
text
Notebook: 
https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/openenv_sudoku_grpo.ipynb
https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/openenv_sudoku_grpo.ipynb
link
new_line
new_line
Script: 
text
Script: 
https://github.com/huggingface/trl/blob/main/examples/scripts/openenv/sudoku.py
https://github.com/huggingface/trl/blob/main/examples/scripts/openenv/sudoku.py
link
New TRL + OpenEnv example! 💥

Fine tune an LLM for playing Sudoku using an RL env via OpenEnv

Includes a script that runs on 1 or multiple GPUs with vLLM, plus a Colab-ready notebook.

Enjoy!

Notebook: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/openenv_sudoku_grpo.ipynb

Script: https://github.com/huggingface/trl/blob/main/examples/scripts/openenv/sudoku.py
🔥
juanjucm qgallouedec carbene101 OzTianlu John6666 hitchhiker3010
6797938a9c245187cc9efc30
https://cdn-avatars.huggingface.co/v1/production/uploads/6797938a9c245187cc9efc30/njq11GKUf8ub1EmkUa3zW.jpeg
Zixi "Oz" Li
OzTianlu
user