5 Pull requests merged by 3 people

• torch compile config standardization update

  #3166 merged Jun 11, 2024

• Adding model-control-mode

  #3165 merged Jun 11, 2024

• Fixing torch compile benchmark

  #3179 merged Jun 7, 2024

• Make a copy of the torchtext utils to remove dependency

  #3076 merged Jun 6, 2024

• Fix Inf2 benchmark

  #3177 merged Jun 5, 2024

5 Pull requests opened by 3 people

• Replace pkg_resources.packaging with packaging module

  #3178 opened Jun 5, 2024

• Add support for hpu_backend and Resnet50 compile example

  #3182 opened Jun 7, 2024

• Security documentation update

  #3183 opened Jun 7, 2024

• Replace pkg_resources.packaging

  #3187 opened Jun 11, 2024

• Updating night CIs to account for model control

  #3188 opened Jun 12, 2024

1 Issue closed by 1 person

• Support "model-control-mode" in configuration

  #3158 closed Jun 11, 2024

5 Issues opened by 3 people

• Running segment_anything_fast example locally

  #3186 opened Jun 11, 2024

• Follow up on token authentication PR comments

  #3185 opened Jun 7, 2024

• [RFC] Token Authorization by default

  #3184 opened Jun 7, 2024

• "Token Authorization" for gRPC

  #3181 opened Jun 6, 2024

• "Model mode control" for gRPC

  #3180 opened Jun 6, 2024

10 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Enable Token Authorization by default

  #3163 commented on Jun 12, 2024 • 37 new comments

• TorchServe crashes in production with `WorkerThread - IllegalStateException error'

  #3087 commented on Jun 9, 2024 • 1 new comment

• Metrics API returns empty response until TS process serves a prediction

  #732 commented on Jun 10, 2024 • 1 new comment

• ImportError: cannot import name 'packaging' from 'pkg_resources'

  #3176 commented on Jun 12, 2024 • 1 new comment

• TorchServe linux aarch64 plan

  #3072 commented on Jun 11, 2024 • 0 new comments

• Bump mypy from 1.3.0 to 1.10.0

  #3126 commented on Jun 5, 2024 • 0 new comments

• Bump transformers from 4.36.2 to 4.38.0 in /examples/large_models/inferentia2/llama2

  #3129 commented on Jun 5, 2024 • 0 new comments

• Torchserve support for Intel GPUs

  #3132 commented on Jun 6, 2024 • 0 new comments

• [WIP] Feature/async worker comm

  #3146 commented on Jun 11, 2024 • 0 new comments

• Make torchserve-kfs docker image multiplatform

  #3162 commented on Jun 8, 2024 • 0 new comments