torchrl

📢 Introducing TorchRL Data Hub, the most comprehensive single-format data repository for offline RL. With its unified format, swapping or merging datasets is a breeze. It includes: OpenX Embodiment, Roboset, Minari, (V-)D4RL, GenDGRL, AtariDQN, OpenML. #datasets" target="_blank" rel="nofollow noopener">pytorch.org/rl/reference/d…

RNs: github.com/pytorch/rl/rel… Doc: docs.pytorch.org/rl/stable/refe…

📚 What's included in 0.9: ->Unified wrappers for Hugging Face and vLLM models ->Complete GRPO implementation with multi-GPU support ->Specialized objectives: GRPO and SFT loss functions optimized for LLMs ->Comprehensive docs and tutorials

🚀 TorchRL 0.9 is here and it's LLM ready! This major release brings comprehensive LLM fine-tuning capabilities to our RL ecosystem. We're enabling LLM post-training with your favorite RL tools like replay buffers and data collectors. 🧵 Thread below 👇

Check it out here github.com/pytorch/rl/rel…

Just released TorchRL 0.8.0, which now incorporates async envs and simplifies extending collectors weight update strategies

Diff: github.com/pytorch/rl/com…

torchrl 🤝 gymnasium happy ever after With the help of the @FaramaFound team, we managed to make TorchRL compatible with gymnasium v1.1 onward!

Collegues in Europe are running this poll about #NeurIPS2025 participation. If in Europe, highly recommended to participate.

Hi imitation learning friends, I am excited to introduce CleanIL (github.com/ran-weii/clean…), a repo of high quality single-file implementations of imitation learning and inverse RL algos inspired by CleanRL and built on @torchrl1.

We're looking for brave OSS contributors to help us scale this up! We need: - an asyncio api - ray support - support for transformed async environments Please reach out if you're willing to help!

If anyone is interested in Async environments in torchrl, we just landed that feature in the lib!

A few months ago we quietly open-sourced a @PyTorch video decoding library called torchcodec -- small, nimble, fast. The @LeRobotHF folks had some nice things to say about it.

@deependu__ We’re very much alive! No need to worry

Check out the release notes here: github.com/pytorch/rl/rel…

TorchRL 0.7.0 is out! We brought in torch.compile and with it some considerable speedups!

Meantime