Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improvement for the issue : Not working with LLM #396 #397

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Improvement for the issue : Not working with LLM #396 #397

wants to merge 1 commit into from
+1 −0

Commits on Apr 8, 2024

  1. Explicitly informing the model not include uneccessary reponses sections 

    in its output. This is done because some models like llama2 provide
sections such as "Explanation:" or "Justification:" after the JSON
response.
This is not a surefire fix though. The model (llama2) will still
includes explanation and justification sections at times despite this
explicit instruction in the prompt
    @brPreetham
    brPreetham committed Apr 8, 2024
    1 Configuration menu
    Copy the full SHA
    ea40769 View commit details
    Browse the repository at this point in the history