Total Metric aggregation type provides wrong metric value

[PowerSurj]

I noticed that when I use Total metric aggregation type lookups with aggregation intervals of 4 and 5 minutes the resulting metric differs from the Azure Monitor value by multiple times.
However, I get correct metric values (within expected average range) when using aggregation interval of 3 minutes.

Average type aggregation metrics don't seem to be affected by this.

Using Scraper v2.6.0

Config example:

metricDefaults:
  aggregation:
    interval: 00:04:00
  scraping:
    schedule: "* * * * *"
metrics:
  - name: azure_front_door_request_count_per_http_status_group
    description: "The number of client requests served by the HTTP/S proxy per HttpStatusGroup dimension"
    resourceType: FrontDoor
    azureMetricConfiguration:
      metricName: RequestCount
      aggregation:
        type: Total
      dimension:
        name: HttpStatusGroup
    resourceDiscoveryGroups:
      - name: FrontDoor

Azure Monitor stats

Prometheus scraped metrics from the Scraper agent (filter for httpstatusgroup="2XX" label)

Am I missing some basic setting to get metrics right?

[tomkerkhove]

Odd. Do you have the same with aggregation of 5 or above?

[PowerSurj]

tested with 4, 5, 6 minutes, all differ.

[tomkerkhove]

All differ from the Azure Monitor chart you mean? I presume, just to make sure, that you've changed the aggregation in the chart then as well?

[PowerSurj]

correct, resulting values differ from values in Azure Monitor.

Azure Monitor Chart for FrontDoor RequestCount metric only displays a single aggregation of Sum type when viewed through Azure Portal.
I think that Sum is a displayName of type since default aggregation type is Total, based on official doc https://docs.microsoft.com/en-us/azure/azure-monitor/essentials/metrics-supported#microsoftnetworkfrontdoors

I tried using Sum type in Promitor and API was throwing error of incorrect aggregation type.
I checked this for other resource type, like APIM, Storage Accounts. They get exact same issue with Total type.

[tomkerkhove]

Strange, would you mind opening a bug report for this please with a repro?

[PowerSurj]

ok, will do!

[tomkerkhove]

#1935