Online training methods (e.g., GRPO) require real-time generation, a compute- and memory-heavy bottleneck.
text
Online training methods (e.g., GRPO) require real-time generation, a compute- and memory-heavy bottleneck.
new_line
new_line
TRL has built-in vLLM support and in this new recipe, we show how to leverage it for efficient online training. Run on Colab ⚡, scale to multi-GPU/multi-node!
text
TRL has built-in vLLM support and in this new recipe, we show how to leverage it for efficient online training. Run on Colab ⚡, scale to multi-GPU/multi-node!
new_line
new_line
🧑‍🍳 recipe: 
text
🧑‍🍳 recipe: 
https://huggingface.co/learn/cookbook/grpo_vllm_online_training
https://huggingface.co/learn/cookbook/grpo_vllm_online_training
link
Online training methods (e.g., GRPO) require real-time generation, a compute- and memory-heavy bottleneck.

TRL has built-in vLLM support and in this new recipe, we show how to leverage it for efficient online training. Run on Colab ⚡, scale to multi-GPU/multi-node!

🧑‍🍳 recipe: https://huggingface.co/learn/cookbook/grpo_vllm_online_training
🔥
adamm-hf SelmaNajih001 raphaelmansuy John6666 albertvillanova
683ef46c2695302d716db7b9
/avatars/77c6a5905729d9a0e67b367ddf0adf36.svg
Selma Najih
SelmaNajih001
user