Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
345 Open 1,248 Closed
345 Open 1,248 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Question] How to debug custom handlers? triaged_wait Waiting for the Reporter's resp
#711 opened Oct 2, 2020 by veronikayurchuk
@HamidShojanazeri
4 👍 13
Torchserve M1 support detailed plan dependencies Pull requests that update a dependency file enhancement New feature or request good first issue Good for newcomers m1
#2555 opened Aug 30, 2023 by msaroufim
5 of 10 tasks
4 👍 12
Torchserve docker fails to run on existing mar file bug Something isn't working triaged_wait Waiting for the Reporter's resp
#1010 opened Mar 12, 2021 by ayushch3 v0.4.0
@maaquib
15 👍 10
[RFC]: Torchserve Large Model Inference enhancement New feature or request
#1579 opened Apr 20, 2022 by HamidShojanazeri
2 👍 8
[RFC]: decorator based model serving enhancement New feature or request
#1458 opened Feb 23, 2022 by msaroufim v0.6.0
@msaroufim
3 👍 6
Prediction request timeout including time spent in queue enhancement New feature or request
#1322 opened Nov 15, 2021 by nateagr
2 👍 5
worker restart and logs “epollEventLoopGroup-3-10 org.pytorch.serve.http.HttpRequestHandler” bug Something isn't working help wanted Extra attention is needed
#756 opened Oct 28, 2020 by TalkUHulk
@harshbafna
13 👍 4
Accelerated preprocessing enhancement New feature or request help wanted Extra attention is needed
#1546 opened Apr 1, 2022 by msaroufim
3 tasks
1 👍 3
Metrics API doesn't report all three default metrics in case of GRPC bug Something isn't working
#1467 opened Feb 25, 2022 by thies1006 v0.6.0
@lxning
2 👍 3
Efficient and Consistent Batching enhancement New feature or request perf Performance issue preprocessing
#1797 opened Aug 15, 2022 by msaroufim
@msaroufim
2 👍 3
Persistent Handler for Streaming Data enhancement New feature or request
#1127 opened Jun 16, 2021 by edmuthiah
10 👍 3
Keep root dir for extra files when generating .mar file in model-archiver/model_packaging_utils.py enhancement New feature or request p2 low priority
#1689 opened Jun 15, 2022 by csJoax
1
👍 3
Implementation of Python Virtual Environment Support in TorchServe
#2826 opened Dec 1, 2023 by farhan888
3 👍 3
Debugging standalone handlers code-quality documentation Improvements or additions to documentation
#1538 opened Mar 29, 2022 by msaroufim v0.6.0
1
@msaroufim
👍 3
Support GPU/CPU selection per model enhancement New feature or request
#1056 opened May 9, 2021 by cceyda
1 👍 2
Arguments validation in the prediction model enhancement New feature or request
#1142 opened Jun 25, 2021 by andrey-chernykh
1
1 👍 2
Add support for passing parameters in json input enhancement New feature or request
#1405 opened Jan 26, 2022 by Pringled
1 👍 2
[RFC] Sequence Batching for Stateful Inference
#2743 opened Oct 26, 2023 by lxning
@lxning
11 👍 2
Auto recovery failed again bug Something isn't working debugging p0 high priority triaged Issue has been reviewed and triaged
#2423 opened Jun 23, 2023 by moono
@lxning
14 👍 2
Torchserve support mac M1 chip dependencies Pull requests that update a dependency file docker enhancement New feature or request m1 p2 low priority
#1678 opened Jun 9, 2022 by lxning
3 👍 2
[RFC]: Metrics Refactoring benchmark enhancement New feature or request
#1492 opened Mar 7, 2022 by lxning
4 tasks done
v0.6.0
2
@lxning
12 👍 2
Enabling HTTP caching of inference results enhancement New feature or request help wanted Extra attention is needed
#1527 opened Mar 23, 2022 by danthe3rd
@msaroufim
2 👍 2
How to identify "full" torchserve instances on Google Kubernetes Engine kubernetes triaged Issue has been reviewed and triaged
#2412 opened Jun 13, 2023 by tsteffek
@namannandan
1 👍 2
Metrics API returns empty response until TS process serves a prediction enhancement New feature or request help wanted Extra attention is needed
#732 opened Oct 16, 2020 by jeremiahschung
5 👍 2
Multi-GPU inference support enhancement New feature or request
#1356 opened Dec 7, 2021 by AliJahan
1 👍 2
ProTip! Exclude everything labeled bug with -label:bug.