Commits

Commits on Sep 16, 2024

[serve] Additional metadata and context (#47652 )
zcin
committedSep 16, 2024

Commits on Sep 12, 2024

[serve] reorganize replica scheduler classes (#47615 )
zcin
committedSep 12, 2024
[serve] skip failure test on windows (#47630 )
zcin
committedSep 12, 2024
[serve] Faster detection of dead replicas (#47237 )
zcin
committedSep 12, 2024

Commits on Sep 6, 2024

[serve] separate test deployment version into unit and non-unit tests (#47539 )
zcin
committedSep 6, 2024

Commits on Sep 5, 2024

[serve] remove outdated microbenchmark release test (#47502 )
zcin
committedSep 5, 2024

Commits on Sep 4, 2024

[serve] add streaming to microbenchmarks (#47466 )
zcin
committedSep 4, 2024

Commits on Sep 3, 2024

Add support for 'container' and 'env_vars' in runtime_env (#42121 )
zcin
committedSep 3, 2024

Commits on Aug 31, 2024

[serve] Fix broken microbenchmarks (#47430 )
zcin
committedAug 31, 2024

Commits on Aug 29, 2024

[serve] redeploy in between each microbenchmark (#47404 )
zcin
committedAug 29, 2024

Commits on Aug 21, 2024

[serve] Fix outdated autoscaling docs (#47257 )
zcin
committedAug 21, 2024
[serve] wrap lines in advanced autoscaling guide (#47252 )
zcin
committedAug 21, 2024
[serve] remove support for nested DeploymentResponses (#47209 )
zcin
committedAug 21, 2024

Commits on Aug 20, 2024

[serve] mark proxy as unready when its routers are aware of zero replicas (#47002 )
zcin
committedAug 20, 2024

Commits on Aug 14, 2024

Commits on Aug 13, 2024

[serve] split test_proxy.py into unit and e2e tests (#47112 )
zcin
committedAug 13, 2024
[serve] move test_proxy_router to unit test (#47033 )
zcin
committedAug 13, 2024
[serve] eagerly create router for handles held by proxy (#47031 )
zcin
committedAug 13, 2024

Commits on Aug 12, 2024

[serve] appropriately handle actor died and actor unavailable in all cases (#47008 )
zcin
committedAug 12, 2024

Commits on Aug 5, 2024

[serve] Deprecate passing DeploymentResponse to handle (#46806 )
zcin
committedAug 5, 2024
[serve] deflake test autoscaling policy (#46910 )
zcin
committedAug 5, 2024

Commits on Jul 29, 2024

[serve] add cmdline options to control which microbenchmarks to run (#46798 )
zcin
committedJul 29, 2024

Commits on Jul 16, 2024

[serve] remove target_num_ongoing_requests_per_replica (#46392 )
zcin
committedJul 16, 2024
[serve] Update docs on max ongoing requests default change (#46414 )
zcin
committedJul 16, 2024
[serve] remove max_concurrent_queries (#46427 )
zcin
committedJul 16, 2024
[serve] configure logging for build app task (#46347 )
zcin
committedJul 16, 2024

Commits on Jun 26, 2024

[serve] change default for max and target ongoing requests (#45943 )
zcin
committedJun 26, 2024

Commits on Jun 20, 2024

Commits on Jun 13, 2024

[runtime-env] automatically infer worker path when starting worker in container (#42304 )
zcin
committedJun 13, 2024

Commits on Jun 6, 2024

[Core] Allow runtime env config with image_uri and container (#45765 )
zcin
committedJun 6, 2024

Commits on May 30, 2024

add oss tag to container tests (#45629 )
zcin
committedMay 30, 2024