-
Notifications
You must be signed in to change notification settings - Fork 71
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Request for Finetuning module #41
Comments
you would have to program an input and a data handler to input documents. if you look into langchain that will get you on the right track. issue with most ai's is they can only handle chunks of the data at a time s you have to split all data in to chunks that the ai can process. a multipage book would require a lot of chunks so you need something that can handle the chuncks and remember what chuck order is etc. hope that help. |
Hi, How can I finetune this model to work on specific data? Like for example only a single text book?
The text was updated successfully, but these errors were encountered: