Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
34 Open 174 Closed
34 Open 174 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Continuous Batching does not work with newest transformer issue
#3148 opened May 21, 2024 by udaij12
@mreso @lxning
Update large_models/inferentia2/llama2 to Llama3
#3100 opened Apr 22, 2024 by mreso
@lxning
Warning in regression test: test_gRPC_inference_api.py internal Issues found internally
#2940 opened Feb 11, 2024 by agunapal
@lxning
example of integrating deepspeed fastgen into TorchServe example future
#2780 opened Nov 9, 2023 by lxning v1.0.0
@lxning
[RFC] Sequence Batching for Stateful Inference
#2743 opened Oct 26, 2023 by lxning
@lxning
11
Auto recovery failed again bug Something isn't working debugging p0 high priority triaged Issue has been reviewed and triaged
#2423 opened Jun 23, 2023 by moono
@lxning
14
Docker build from local branches docker
#2376 opened May 31, 2023 by HamidShojanazeri
@lxning
Worker PID is not available yet bug Something isn't working large-model triaged Issue has been reviewed and triaged
#2368 opened May 29, 2023 by viratbiz
@HamidShojanazeri @lxning
4
batchSize and maxBatchDelay configurations are not respected even if set in ts_config file bug Something isn't working p0 high priority
#2365 opened May 26, 2023 by fangpings
@lxning
2
enable option for ping endpoint list all unhealthy models enhancement New feature or request
#2338 opened May 11, 2023 by lxning
@lxning
return 503 for inference request if there are no available workers enhancement New feature or request
#2333 opened May 10, 2023 by lxning v0.8.1
@lxning
Allow different queue sizes for different models enhancement New feature or request
#2322 opened May 4, 2023 by lopuhin
@lxning
3
TorchServe inference stream response support enhancement New feature or request
#2234 opened Apr 16, 2023 by lxning
2 tasks
v0.8.0
@lxning
1
http stream response via HTTP 1.1 chunked encoding enhancement New feature or request
#2232 opened Apr 16, 2023 by lxning v0.8.0
@lxning
upgrade default ping endpoint enhancement New feature or request
#2231 opened Apr 14, 2023 by lxning v0.8.0
@lxning
1
Inconsistent behavior with with Benchmark AB runs benchmark
#2126 opened Feb 13, 2023 by agunapal
@lxning
move gpu nightly benchmark to g5 instance benchmark
#2090 opened Jan 25, 2023 by lxning v0.7.1
@lxning
migrate regression test from aws to github workflow ci
#2079 opened Jan 18, 2023 by lxning v0.7.1
@lxning
example is out of date, running end to end results in model not found: alexnet invalid This doesn't seem right
#2018 opened Dec 1, 2022 by rbavery
@lxning
4
Missing mandatory parameter --model-store documentation Improvements or additions to documentation question Further information is requested
#2016 opened Dec 1, 2022 by david-waterworth v0.7.0
@lxning
8
can not load model with a batch size of more than 1 triaged Issue has been reviewed and triaged
#1955 opened Nov 7, 2022 by mitrasafari v0.7.0
@lxning
1
load initial handlers in parallel enhancement New feature or request future java Pull requests that update Java code optimization p1 mid priority perf Performance issue
#1928 opened Oct 27, 2022 by hgong-snap
@lxning
5
/models returns empty list of models when models is specified invalid This doesn't seem right support
#1779 opened Aug 3, 2022 by ghost
@lxning
6
Register Workflows at Server Start enhancement New feature or request p2 low priority triaged Issue has been reviewed and triaged workflowx Issues related to workflow / ensemble models
#1755 opened Jul 22, 2022 by imjohsep
@maaquib @lxning
4
cpp backend milestone1 - java frontend c++ enhancement New feature or request p0 high priority
#1651 opened May 23, 2022 by lxning v0.6.1
@lxning
ProTip! Mix and match filters to narrow down what you’re looking for.