Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remora not sending metrics if one of the endpoints down #70

Open
arnoldyahad opened this issue May 20, 2019 · 0 comments
Open

Remora not sending metrics if one of the endpoints down #70

arnoldyahad opened this issue May 20, 2019 · 0 comments

Comments

@arnoldyahad
Copy link

we have multiple endpoints to our kafka cluster

version: "2"
services:

  remora-kafka:
    image: remora:latest
    environment:
      KAFKA_ENDPOINT: "kafka1.our_domain:9092,kafka2.our_domain:9092,kafka3.our_domain:9092,kafka4.our_domain:9092"
      DATADOG_ON: "true"
      SERVER_PORT: "9019"
      TO_REGISTRY: "true"
      DATADOG_AGENT_HOST: "localhost"
      DATADOG_REMOVE_TAGS_FROM_METRIC_NAME: "true"
    ports:
      - 9019:9019
    restart: always
    network_mode: "host"

when one of the endpoint brokers failed ( shut down because of any reason )
instead of working against one of the other brokers it just starting to send only its failure in the logs

2019-05-20 08:31:49,513 - [DEBUG] - [remora-kafka-consumer-dispatcher-83] kafka.admin.AdminClient - Request FIND_COORDINATOR failed against node kafka2.our_domain:9092 (id: -4 rack: null)
org.apache.kafka.common.errors.DisconnectException: null
2019-05-20 08:31:49,515 - [DEBUG] - [remora-kafka-consumer-dispatcher-85] kafka.admin.AdminClient - Request FIND_COORDINATOR failed against node kafka2.our_domain:9092 (id: -5 rack: null)
org.apache.kafka.common.errors.DisconnectException: null
2019-05-20 08:31:49,515 - [DEBUG] - [remora-kafka-consumer-dispatcher-85] kafka.admin.AdminClient - Request FIND_COORDINATOR failed against node kafka2.our_domain:9092 (id: -4 rack: null)

any way to make it work with the other working brokers?

thanks a lot,
Arnold

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant