Needs smaller context

[cgill-21076]

While I like the idea of this tool, it has proven to not be very practical for larger projects due to the 4096 character limitation of the OpenAI API. It would be awesome if only the diffs were sent instead of entire files. I realize this will reduce the effectiveness of reviews. However, it would make it useful for applications that have larger files. Perhaps this could be a flag?

[johnlk]

@cgill-21076 thanks for the issue. Upon reviewing the code, it seems the full file is passed if the files_to_ignore param is not set, else it passes along git diffs file by file.

A quick and dirty fix would be to set the files_to_ignore param to "README.md".

Another option would be to use the long context model which accepts up to 16k tokens. gpt_model_name: "gpt-3.5-turbo-16k".

I'll have to think more about a flag, because I would have to refactor the case where a full file flag is on and files_to_ignore is also set 🤔

Let me know if you have other thoughts 😄

[cgill-21076]

@johnlk thank you for the suggestions!

So I tried setting the files_to_ignore parameter, and it still sent the entire file contents and not just the diff. It did, as expected, not send README.md, but sent everything else.

I also tried using the 16k context model and that does give a little more room to work, but is still not real practical for projects of any consequence.

Thank you.