Configure Otel Agent to monitor external MySQL and Redis metrics via Terraform in Google

[amanpruthi]

To enhance our monitoring capabilities by configuring the OpenTelemetry (Otel) agent running on our clusters to collect key performance metrics (CPU, memory usage) from external MySQL, Redis and any other key infrastructure aspects. The setup should be executed using Terraform to ensure all permissions and configurations are correctly provisioned. The end goal is to integrate this data into Datadog for centralized monitoring in dedicated cloud.

Requirements

The Otel agent must be able to access metrics from external MySQL and Redis databases.
Use Terraform to provision necessary Kubernetes resources and permissions.
Confirm the ability of Otel to collect and relay accurate metrics.
Make sure the otel metrics are tag correctly with attriubes from the k8s cluster
Acceptance Criteria

The Otel agent must successfully collect and display MySQL and Redis CPU and memory usage metrics from external sources.
All configurations must be managed via Terraform with proper versioning and module usage.

[amanpruthi]

There is 2 Prs linked with this issue :

wandb/helm-charts#141 >> stackdriver subchart support
#126 >> otel with stackdriver support