-
Notifications
You must be signed in to change notification settings - Fork 260
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Examples] Adding a tensordict and TorchRL version of the PyTorch example #2010
base: main
Are you sure you want to change the base?
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2010
Note: Links to docs will display an error until the docs builds have been completed. This comment was automatically generated by Dr. CI and updates every 15 minutes. |
Hi @whatdhack! Thank you for your pull request and welcome to our community. Action RequiredIn order to merge any pull request (code, docs, etc.), we require contributors to sign our Contributor License Agreement, and we don't seem to have one on file for you. ProcessIn order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA. Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with If you have received this in error or have any questions, please contact us at [email protected]. Thanks! |
Thank you for signing our Contributor License Agreement. We can now accept your code for this (and any) Meta Open Source project. Thanks! |
@vmoens , FYI this PR is for working code, not documentation. |
Sure, I agree it's not plain "doc". Examples are part of the doc in some sense. We use them to show how to use the lib, but they're not core features. |
Since this was a tutorial on |
@vmoens , I can create a PR there too if you think that has a good likelihood of going through . |
cc @svekars do you think adapting the reinforce_q_learning is advisable? My understanding is that @whatdhack wishes something lightweight, not heavily focuses on torchrl but more on how to leverage the few low-level tools we have to reduce the boilerplate in the tutorial |
A simple DQN example would be beneficial to someone getting started, given that DQN's are probably the very first DL RL one gets introduced to. |
I think the way to go here would be to make a PR in PyTorch tutorials instead, does that sound alright to you? |
Description
Adding a torchdict and torch rl version of the PyTorch example reinforcement_q_learning.py
Motivation and Context
Adds a simpler DQN example
Types of changes
What types of changes does your code introduce? Remove all that do not apply:
Checklist
Go over all the following points, and put an
x
in all the boxes that apply.If you are unsure about any of these, don't hesitate to ask. We are here to help!