Add compiled optimizer + lr scheduler tutorial

[mlazos]

Adding a tutorial demonstrating how to compose the LRScheduler with a compiled optimizer

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/tutorials/2874

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 56c0b83 with merge base f66b5b2 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[svekars]

Some editorial suggestions. Thank you!

[williamwen42]

Will you have a .py version up for next release?

[mlazos]

Will you have a .py version up for next release?

I want to, but last time we did this we had a strange issue in the docs CI due to a previous test modifying the decomps and causing it to fail, so I went with RST both with this and the previous compiled optimizer tutorial.

[mlazos]

Will you have a .py version up for next release?

I want to, but last time we did this we had a strange issue in the docs CI due to a previous test modifying the decomps and causing it to fail, so I went with RST both with this and the previous compiled optimizer tutorial.

Talked to svetlana offline, this should be possible

[janeyx99]

Looks like the build isn't passing, but contentwise this LGTM