Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
345 Open 1,248 Closed
345 Open 1,248 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Enable pytest test_torch_compile.py: test_serve_inference pytest
#3174 by agunapal was closed Jun 12, 2024 v0.12.0
@agunapal
1
Enable pytest test_example_torch_compile.py:test_example_torch_compile.py pytest
#3173 by agunapal was closed Jun 12, 2024 v0.12.0
@agunapal
1
Standardize PyTorch 2.x features config in model-config.yaml enhancement New feature or request
#3164 by agunapal was closed Jun 12, 2024 v0.12.0
1
Support "model-control-mode" in configuration enhancement New feature or request p0 high priority security
#3158 by lxning was closed Jun 11, 2024 v0.12.0
@udaij12
1
Duplicate base_neuronx_continuous_batching_handler.py bug Something isn't working
#3136 by mreso was closed May 13, 2024 v0.11.0
@lxning
1
Exchange Llama2 against Llama3 in HF_accelerate example
#3107 by mreso was closed Apr 25, 2024
@mreso
Docker regression failure: test_handler_traceback_logging.py
#3106 by agunapal was closed Apr 25, 2024
1
@namannandan
How to pass parameters from preprocessing to postprocessing when using micro-batch operations triaged Issue has been reviewed and triaged
#3103 by pengxin233 was closed Apr 29, 2024
@agunapal
4
Update LLM/llama2 to Llama3
#3099 by mreso was closed Jun 1, 2024
@mreso
1
Whether the pre- and post-processing operations of batch processing are parallel triaged Issue has been reviewed and triaged
#3096 by pengxin233 was closed Apr 23, 2024
@agunapal
1
Server crashes in production with `WorkerThread - IllegalStateException error'
#3091 by MaelitoP was closed Apr 17, 2024
1
Unable to use build_image.sh to build the cu102 version of the image triaged Issue has been reviewed and triaged
#3089 by pengxin233 was closed Apr 23, 2024
@agunapal
2
How to modify torchserve’s Python runtime from 3.8.0 to 3.10 triaged Issue has been reviewed and triaged
#3086 by pengxin233 was closed Apr 23, 2024
@agunapal
1
improve security doc for model security check documentation Improvements or additions to documentation security
#3065 by lxning was closed Apr 17, 2024 v0.11.0
1
@namannandan
Building frontend from source in docker docker triaged Issue has been reviewed and triaged
#3054 by harshita-meena was closed Apr 4, 2024 v0.11.0
Conda nightlies not getting uploaded for the last 6 days internal Issues found internally triaged Issue has been reviewed and triaged
#3053 by agunapal was closed Mar 29, 2024
1
Nightly upload to pypi failed internal Issues found internally triaged Issue has been reviewed and triaged
#3052 by agunapal was closed Mar 28, 2024
1
Can torchserve return image data? triaged Issue has been reviewed and triaged
#3051 by pengxin233 was closed Apr 2, 2024
1
Kserve nightly CPU tests failure internal Issues found internally triaged Issue has been reviewed and triaged
#3044 by namannandan was closed Apr 12, 2024
1
Update describe model management API to show all model configuration options enhancement New feature or request
#3037 by namannandan was closed May 9, 2024 v0.11.0
1
@namannandan
Reduce or remove worker retries for specific failures bug Something isn't working triaged Issue has been reviewed and triaged
#3034 by harshita-meena was closed Mar 22, 2024
1
@namannandan
6
PyTorch serve with custom translators returning Unknown exception debugging sagemaker triaged Issue has been reviewed and triaged
#3032 by samruds was closed Apr 1, 2024 v0.11.0
@namannandan
4
Real-time Object Detection triaged Issue has been reviewed and triaged
#3030 by hungtrieu07 was closed Apr 10, 2024
7
torchserve output customization triaged Issue has been reviewed and triaged
#3025 by advaitraut was closed Mar 14, 2024
3
very high QueueTime
#3008 by PushpakBhoge512 was closed Mar 9, 2024
ProTip! Add no:assignee to see everything that’s not assigned.