Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up humanoid's training in MJX notebook #1465

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

goncalog
Copy link

@goncalog goncalog commented Mar 2, 2024

Summary

This change can result in:

  • 1.4x speed up in the humanoid's training in the MJX notebook
  • 14% better average reward per episode at the end of the training (improvement is only 7% if ignoring the worst run with each batch_size)

Example runs

Original - batch_size=1024
original

New - batch_size=512
new

Experiment results

Ran the tutorial notebook 5 times with each batch_size on Colab with a T4 GPU runtime, and this reduced the training time from 18min to 13min with better reward per episode:
results

Copy link

google-cla bot commented Mar 2, 2024

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

@btaba
Copy link
Collaborator

btaba commented Mar 11, 2024

Thanks for the contribution! Can you please sign the CLA? https://github.com/google-deepmind/mujoco/pull/1465/checks?check_run_id=22203814795

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants