New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support converting HF reward models to .nemo #115

Open

odelalleau opened this issue Feb 27, 2024 · 1 comment

Collaborator

odelalleau commented Feb 27, 2024

Is your feature request related to a problem? Please describe.

Converting a HF reward model to .nemo doesn't seem to work right now. See discussion in #109 for details.

Describe the solution you'd like

We should have a script to convert HF reward models to .nemo.

pratikkumar018 commented Feb 29, 2024

Hi Olivier,
Thanks for this. Also we would like to have a backward script which can convert .nemo RM to HF.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment