-
Notifications
You must be signed in to change notification settings - Fork 2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TRT8 -> TRT10, severe performance degradation. #3853
Labels
triaged
Issue has been triaged by maintainers
Comments
Why not use |
TRT is integrated into a self-developed framework, with its own set of benchmark tests and verification processes. This issue is solely due to the upgrade to TRT10. |
Could you please provide a reproduce? @Mr-Nineteen |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Verified model: Search and recommendation model.
Inference time for TRT8 model:
It is this
setInputShape
API that causes the increase in time consumption. If there are nearly a thousand inputs, the time consumption increases by tens of milliseconds.The text was updated successfully, but these errors were encountered: