-
Notifications
You must be signed in to change notification settings - Fork 249
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Having issues on Running Llama-3-70B #962
Comments
Unfortunately this feature is not in our stable package release. Can you install the nightly build and see if it fixes the issue? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi,
I am trying to run fine-tuning Llama-3-70B-Instruct on Sagemaker Notebook with
p4de.24xlarge
instance. I am not sure whats wrong, but it seems like package cannot seetorchtune.models.llama3.lora_llama3_70b
module.The command I am running is:
I installed the torchtune using pip and here are my torch versions:
Since Sagemaker environments are handled by Conda, I am also using a Conda environment in my setup. The error I get:
The text was updated successfully, but these errors were encountered: