Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request for Finetuning module #41

Open
RebeccaMbula opened this issue Sep 20, 2023 · 1 comment
Open

Request for Finetuning module #41

RebeccaMbula opened this issue Sep 20, 2023 · 1 comment

Comments

@RebeccaMbula
Copy link

Hi, How can I finetune this model to work on specific data? Like for example only a single text book?

@Braunfeltd
Copy link

Braunfeltd commented Sep 20, 2023

you would have to program an input and a data handler to input documents. if you look into langchain that will get you on the right track. issue with most ai's is they can only handle chunks of the data at a time s you have to split all data in to chunks that the ai can process. a multipage book would require a lot of chunks so you need something that can handle the chuncks and remember what chuck order is etc. hope that help.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants