-
Notifications
You must be signed in to change notification settings - Fork 811
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[bug] Berkeley Function-Calling Leaderboard: <Issue> #411
Comments
Hi @lucenzhong , |
@HuanzhiMao |
Later this week or early next week! Sorry for the long wait. We are currently busy with the paper deadline :/ |
Describe the bug
I think there is a problem with the golden number of parallel function calls.
For example, on line 27 of data/gorilla_openfunctions_v1_test_parallel_function.json,
The golden answer called the function 4 times.
Since the case_number parameter can be array, maybe 2 times is okay for this situation. My result is as follows.
The number of function calls is not unique because the argument is a list. This situation is common in parallel function calls.
The text was updated successfully, but these errors were encountered: