Failed to scrape resource collection 'Application-insight-landscape' - resource discovery group

[mgLearningAccount2]

I have made a simple configuration setup with Prometheus -- Promitor -- Azure AppInsight , these config are done locally without any assist from kubernetes.

Setup Details:

docker run command:
docker run -d -p 8999:80 --name promitor-agent-scraper --env AUTH_APPKEY=xxxxxx-xxxx-xxxx-xxxxxx --volume c:/promitor/metrics-declaration.yaml:/config/metrics-declaration.yaml --volume c:/promitor/runtime.yaml:/config/runtime.yaml ghcr.io/tomkerkhove/promitor-agent-scraper:2.6.0

Currently my Promitor docker is running successfully and their localhost/metric endpoint are available Prometheus target. But, I am facing few issues between Promitor and azure configuration.

1. how to expose an appinsight data metric to metric-declaration.yml? I have updated the metric.yml file with azure appinsight resources is this the resource group we have to refer? and does the metric only available when data is present?

And in the AzureMetricConfiguration should I be using namespace or the metric value from AppInSight.

2. The another issue I was facing is the "resource discovery group", based on doc Promitor discovery agent query the data from azure resource graph. Even thought these config are mentioned as optional, I am getting error on this when the container is running. Is this to be ignored or if left will it affect data scrapping.

4. In runtime.yaml configuring the Authentication part for mode & indentityId (where these value are taken from exactly), is this required and under which condition to be included?
   error when running the container
   

[tomkerkhove]

1. how to expose an appinsight data metric to metric-declaration.yml? I have updated the metric.yml file with azure appinsight resources is this the resource group we have to refer? and does the metric only available when data is present?

Sorry, I'm not sure I get your question here?

2. The another issue I was facing is the "resource discovery group", based on doc Promitor discovery agent query the data from azure resource graph. Even thought these config are mentioned as optional, I am getting error on this when the container is running. Is this to be ignored or if left will it affect data scrapping.

The URI that you have configured is not reachable and should be the DNS name of your container. Make sure you are running an instance of the resource discovery agent as well and that the scraper is able to access it.

4. In runtime.yaml configuring the Authentication part for mode & indentityId (where these value are taken from exactly), is this required and under which condition to be included?

Yes this is required to authenticate with Microsoft Azure. It should be an Azure AD application for which you'll need the application ID & secret.

[tomkerkhove]

I think that's all clearly covered in the documentation, no? I'm happy to help but that question is a bit broad; can you be more concrete please?

This should give you an indication: https://docs.promitor.io/v2.7/walkthroughs/scrape-promitor-with-prometheus-on-azure-kubernetes-service/#introduction

It's aimed at Kubernetes but the general setup of creating identity and such is correct though.

[mgLearningAccount2]

I have made few changes to the metric declaration file and facing following issues. These configuration are done locally without any use of AKS( as I don't have any access for them and trying see if the data flow can be achieved without any need for Kubernetes).

Auth mode: service provide (for the App registration) are given with read access on the AppInsight resource only. My Promitor localhost where picked up by Prometheus target the problem is around the Azure and promitor part
version: 2.7.0

Issue 1:

Issue 2:

[tomkerkhove]

Can you post your full configuration and logs please?

[mgLearningAccount2]

@tomkerkhove thanks for the reply. I was able to run it now, the issue was the Authentication type I was using. Even though I am getting some data over the Prometheus, there are few fail info

config file for metric:

[tomkerkhove]

This is related to #2089

[mgLearningAccount2]

Thanks @tomkerkhove closing this discussion and will follow up on the #2089 issue for updates.

Marking #2066 (reply in thread) as Answered