Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
347 Open 1,245 Closed
347 Open 1,245 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

ImportError: cannot import name 'packaging' from 'pkg_resources'
#3176 opened Jun 5, 2024 by Sieltek updated Jun 12, 2024
1
Running segment_anything_fast example locally triaged Issue has been reviewed and triaged
#3186 opened Jun 11, 2024 by yousofaly updated Jun 11, 2024
1
TorchServe linux aarch64 plan dependencies Pull requests that update a dependency file enhancement New feature or request
#3072 opened Apr 3, 2024 by agunapal updated Jun 11, 2024
1 of 4 tasks
@agunapal
Metrics API returns empty response until TS process serves a prediction enhancement New feature or request help wanted Extra attention is needed
#732 opened Oct 16, 2020 by jeremiahschung updated Jun 10, 2024
5
TorchServe crashes in production with `WorkerThread - IllegalStateException error'
#3087 opened Apr 15, 2024 by MaelitoP updated Jun 9, 2024
6
Follow up on token authentication PR comments
#3185 opened Jun 7, 2024 by mreso updated Jun 7, 2024 v0.12.0
@udaij12
[RFC] Token Authorization by default
#3184 opened Jun 7, 2024 by udaij12 updated Jun 7, 2024
"Model mode control" for gRPC
#3180 opened Jun 6, 2024 by udaij12 updated Jun 6, 2024
"Token Authorization" for gRPC
#3181 opened Jun 6, 2024 by udaij12 updated Jun 6, 2024
NotImplementedError: Cannot copy out of meta tensor; no data! + Models not generating output text
#3167 opened May 31, 2024 by bjorquera1 updated Jun 5, 2024
The service crashes if the model takes a long time to respond grpc
#3168 opened May 31, 2024 by yurkoff-mv updated Jun 3, 2024
Two-way authentication/Mutual SSL in gRPC enhancement New feature or request
#3172 opened Jun 3, 2024 by MohamedAliRashad updated Jun 3, 2024
Enable pytest test_torch_compile.py: test_serve_inference pytest
#3174 opened Jun 3, 2024 by agunapal updated Jun 3, 2024 v0.12.0
@agunapal
Enable pytest test_example_torch_compile.py:test_example_torch_compile.py pytest
#3173 opened Jun 3, 2024 by agunapal updated Jun 3, 2024 v0.12.0
@agunapal
[RFC]: Deprecation notice for TorchText installation in TorchServe deprecation
#3066 opened Apr 2, 2024 by agunapal updated Jun 3, 2024
1
Make torchserve-kfs docker image multiplatform enhancement New feature or request kfserving
#3161 opened May 25, 2024 by DanielTemesgen updated May 29, 2024
1
Standardize PyTorch 2.x features config in model-config.yaml enhancement New feature or request
#3164 opened May 29, 2024 by agunapal updated May 29, 2024 v0.12.0
TorchServe inference stream response support enhancement New feature or request
#2234 opened Apr 16, 2023 by lxning updated May 25, 2024
2 tasks
v0.8.0
@lxning
1
install dependency via conda enhancement New feature or request p0 high priority
#3156 opened May 22, 2024 by lxning updated May 23, 2024 v0.12.0
@namannandan
Enable token authentication as default enhancement New feature or request p0 high priority security
#3157 opened May 23, 2024 by lxning updated May 23, 2024 v0.12.0
@udaij12
Torchserve 0.4.0 has a dependency on Torch bug Something isn't working urgent
#1296 opened Oct 27, 2021 by lgarciaCoveo updated May 22, 2024
7
model archiver example very long 1 liner
#3154 opened May 22, 2024 by GeeCastro updated May 22, 2024
1
Limit resource in docker compose and worker in model triaged Issue has been reviewed and triaged
#3150 opened May 21, 2024 by ToanLyHoa updated May 22, 2024
@agunapal
2
Continuous Batching does not work with newest transformer issue
#3148 opened May 21, 2024 by udaij12 updated May 21, 2024
@mreso @lxning
CUDA out of Memory with low Memory Utilization (CUDA error: device-side assert triggered)
#3114 opened Apr 25, 2024 by emilwallner updated May 16, 2024
5
ProTip! What’s not been updated in a month: updated:<2024-05-12.