Skip to content

Issues: triton-inference-server/server

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

410 Open 3,080 Closed
410 Open 3,080 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Questions about input and output shape in model configuration when batch size is 1
#7227 opened May 16, 2024 by jackylu0124
Question to huggingface model using triton
#7226 opened May 15, 2024 by geraldstanje
model analyser stucks investigating The developement team is investigating this issue
#7223 opened May 15, 2024 by riyajatar37003
1
Unable to use pytoch library with libtorch backend when using triton inference server In-Process python API help wanted Extra attention is needed question Further information is requested
#7222 opened May 15, 2024 by sivanantha321
@nnshah1
1
TensorRT 8.6.3.1 package in Python PyPy for Triton Nvidia Inference Server version > 24.01
#7221 opened May 15, 2024 by aptmess
2
Calling index search inside Triton python backend
#7220 opened May 15, 2024 by riyaj8888
1
repeated answer:When I use vllm with Qwen-7b-chat the generated text is x lnot end until the maength, with the repeated answer
#7215 opened May 14, 2024 by ChengShuting
1
Inference in Triton ensemble model is much slower than single model in Triton investigating The developement team is investigating this issue
#7214 opened May 14, 2024 by AWallyAllah
2
How to enable nsys when starting a Triton server using Python API question Further information is requested
#7209 opened May 11, 2024 by jerry605
1
Query Regarding Custom Metrics For Python Backend question Further information is requested
#7204 opened May 10, 2024 by AniForU
1
Perf_analyzer reported metrics for decoupled model question Further information is requested
#7203 opened May 10, 2024 by ZhanqiuHu
2
Triton Server OpenVINO backend not working with Tensorflow saved models bug Something isn't working
#7200 opened May 9, 2024 by atobiszei
5
triton infer server docker image not working on Jetson Orin NX 16 GB JP 5.1.1
#7199 opened May 9, 2024 by allan-navarro
2
Metrics Port Not Opening with Triton Inference Server's In-Process Python API
#7197 opened May 8, 2024 by yucai
1
GRPC infer returns null in outputs contents
#7191 opened May 7, 2024 by aohorodnyk
2
Memory leak with multiple GPU and BLS.
#7190 opened May 7, 2024 by kbegiedza
1
Unexpected reshaping of output
#7189 opened May 7, 2024 by lemousehunter
1
How to specify the TensorRT version in Triton Server for inference? question Further information is requested
#7188 opened May 7, 2024 by Gcstk
2
grpc request performance issue
#7187 opened May 7, 2024 by Yuyaying-winnie
1
Cannot use model-analyzer on ONNX classification model with dynamic input question Further information is requested
#7184 opened May 6, 2024 by siretru
4
Dynamically Limit Endpoint Access enhancement New feature or request
#7183 opened May 5, 2024 by amoosebitmymom
2
Is onnxruntime-genai supported? question Further information is requested
#7182 opened May 4, 2024 by jackylu0124
2
ORT-TRT backend uses too much CPU memory
#7180 opened May 2, 2024 by ShuaiShao93
1
Unable to use triton client with shared memory in C++ (Jetpack 6 device) module: platforms Issues related to platforms, hardware, and support matrix
#7177 opened May 1, 2024 by ganeshmojow
3
Manually update model repository index
#7173 opened Apr 30, 2024 by vilkkiE
@nnshah1
5
ProTip! Add no:assignee to see everything that’s not assigned.