Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow Debug Logging of Logits #614

Open
lapp0 opened this issue Feb 5, 2024 · 0 comments · May be fixed by #616
Open

Allow Debug Logging of Logits #614

lapp0 opened this issue Feb 5, 2024 · 0 comments · May be fixed by #616
Labels
enhancement

Comments

@lapp0
Copy link
Contributor

lapp0 commented Feb 5, 2024 •
edited

What behavior of the library made you think about the improvement?

If the model generates bad results we currently have no idea why. E.g.

How would you like it to behave?

For each generation step, we should have an optional debug log of

    1. The softmaxed logits and decoded representation of the top N tokens
    1. The softmaxed logits of all special tokens (namely EOS)
@lapp0 lapp0 linked a pull request Feb 6, 2024 that will close this issue
Open
3 tasks
@lapp0 lapp0 mentioned this issue Feb 17, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Log Logits lapp0/outlines
1 participant
@lapp0