Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Serve] Add Multiplex metrics into dashboard #37722

Merged
merged 16 commits into from
Aug 4, 2023
Merged

[Serve] Add Multiplex metrics into dashboard #37722

Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
b63182f
[Serve][WIP] Add multiplexed metrics into dashboard
sihanwang41 Jul 24, 2023
afd8dba
Fix
sihanwang41 Jul 24, 2023
34e7298
Update
sihanwang41 Jul 24, 2023
7cba9f7
Update
sihanwang41 Jul 24, 2023
ffbbe3f
Fix
sihanwang41 Jul 28, 2023
97933b9
Update
sihanwang41 Jul 28, 2023
6ba887e
Update
sihanwang41 Jul 28, 2023
9076035
Update
sihanwang41 Jul 28, 2023
7ae93e3
Update
sihanwang41 Jul 28, 2023
b799480
Update
sihanwang41 Jul 28, 2023
49f62ba
Update
sihanwang41 Jul 30, 2023
b92e819
Update
sihanwang41 Jul 30, 2023
ff21be6
Update
sihanwang41 Jul 30, 2023
2b5402f
Update
sihanwang41 Jul 30, 2023
372a00a
Update doc
sihanwang41 Aug 2, 2023
fdd9d91
Update titles
sihanwang41 Aug 3, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update 
Signed-off-by: Sihan Wang <[email protected]>
  • Loading branch information
@sihanwang41
sihanwang41 committed Jul 28, 2023
commit 7cba9f79a891e827653d69c5d24531740a89a1e0
4 changes: 2 additions & 2 deletions dashboard/modules/metrics/dashboards/serve_deployment_dashboard_panels.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -216,7 +216,7 @@
unit="ms",
targets=[
Target(
expr='histogram_quantile(0.99, sum(rate(serve_multiplexed_model_load_latency_ms_bucket{{{global_filters}}}[5m])) by (deployment, replica, le))',
expr="histogram_quantile(0.99, sum(rate(serve_multiplexed_model_load_latency_ms_bucket{{{global_filters}}}[5m])) by (deployment, replica, le))",
legend="{{replica}}",
),
],
Expand All @@ -231,7 +231,7 @@
unit="ms",
targets=[
Target(
expr='histogram_quantile(0.99, sum(rate(serve_multiplexed_model_unload_latency_ms_bucket{{{global_filters}}}[5m])) by (deployment, replica, le))',
expr="histogram_quantile(0.99, sum(rate(serve_multiplexed_model_unload_latency_ms_bucket{{{global_filters}}}[5m])) by (deployment, replica, le))",
legend="{{replica}}",
),
],
Expand Down