feat(infra): add Application observability dashboards in grafana via prometheus metrics

[lsampras]

Add application observability dashboard to present the metrics emitted by application

• no of API requests
• Success rate for payments
• p99,95 Latency for API calls

[aayushdhiman01]

I would like to work on this issue.

[lsampras]

Hey @aayushdhiman01 thanks for your interest,

Since this issue needs a fair bit of context about the metrics generated by application as well, I'd recommend starting with some of the other related issues to familiarize with the repo,

You can start with either of these, since they have documented metrics and dashboards available on the internet

• feat(infra): add a dashboard to monitor loki #5100
• feat(infra): add a dashboard to monitor grafana #5101
• feat(infra): add a dashboard to monitor clickhouse #5102