Pull requests: triton-inference-server/client

30 Open 634 Closed

Author

Filter by author

author:

Filter by this user

Label

Filter by label

Milestones

Filter by milestone

Reviews

Filter by reviews

No reviews Review required Approved review Changes requested

Assignee

Filter by who’s assigned

Assigned to nobody

assignee:

Filter by this user

Sort

Sort by

Newest Oldest Most commented Least commented Recently updated Least recently updated Best match

Most reactions

👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Arbitrary Json extra input

#683 opened May 31, 2024 by IzzyPutterman Loading…

1

Refactor the Statistics data source

#681 opened May 31, 2024 by debermudez Loading…

26

Improve async request rate for OpenAI HTTP client

#680 opened May 29, 2024 by dyastremsky Loading…

17

Add dummy client

#679 opened May 29, 2024 by Tabrizian Loading…

1

Unit tests for artifacts produced by GenAI-Perf

#677 opened May 29, 2024 by lkomali Loading…

22

triton generate support

#675 opened May 24, 2024 by nnshah1 • Draft

5

Fast PA teardown

#674 opened May 24, 2024 by tgerdesnv Loading…

1

fix is_contiguous_logic issue in dlpack

#668 opened May 20, 2024 by wjddn279 Loading…

1

Ci updates

#665 opened May 17, 2024 by nvda-mesharma Loading…

Draft: WIP: Tokens to TRTLLM backend

#650 opened May 13, 2024 by IzzyPutterman • Draft

3

Update scaling from ns to ms

#639 opened May 9, 2024 by debermudez Loading…

7

Fixing memory leakage when using dlpack

#631 opened May 5, 2024 by ParshikovMM Loading…

3

return response metadata to associate it with request

#613 opened Apr 26, 2024 by sydnash Loading…

PA should check whether user-supplied inputs exist in the model

#612 opened Apr 25, 2024 by dyastremsky Loading…

4

[Windows] Support CPU shared memory (Client/Frontend)

#551 opened Mar 27, 2024 by fpetrini15 Loading…

20

Bugfix: get_response(as_json=True) now returns output

#477 opened Feb 28, 2024 by malcolmgreaves Loading…

Remove periodic concurrency feature

#464 opened Feb 1, 2024 by matthewkotila • Draft

3

Add gRPC stream client example for java

#441 opened Nov 28, 2023 by zhansg Loading…

Fixing compression imports in python aio client

#430 opened Nov 1, 2023 by thatsvishalhere Loading…

fix: Add missing import to aio support

#428 opened Oct 30, 2023 by AIvashov Loading…

1

add text bytes support

#426 opened Oct 26, 2023 by xxjwxc Loading…

1

Replace flatten with ravel to avoid unnecessary time cost of data copy

#376 opened Aug 2, 2023 by jokerz0624 Loading…

4

Close client in order to prevent file handle leak

#317 opened May 10, 2023 by michaelwechner Loading…

2

add inferRequest capability to python clinet

#269 opened Mar 16, 2023 by andompesta Loading…

Add support for unix sockets

#247 opened Feb 16, 2023 by debermudez • Draft