0

集群 A 使用 JAAS 身份验证，集群 B 使用 Kerberos，尝试使用 connect mirrormaker 或 mirrormaker2 在集群 A 和 B 之间同步主题。进程成功启动并给出以下错误：

[2021-11-22 21:23:29,914] ERROR Stopping due to error (org.apache.kafka.connect.mirror.MirrorMaker:313)
org.apache.kafka.connect.errors.ConnectException: Failed to connect to and describe Kafka cluster. Check worker's broker connection and security properties.
    at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:70)
    at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:51)
    at org.apache.kafka.connect.mirror.MirrorMaker.addHerder(MirrorMaker.java:236)
    at java.lang.Iterable.forEach(Iterable.java:75)
    at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:137)
    at org.apache.kafka.connect.mirror.MirrorMaker.<init>(MirrorMaker.java:149)
    at org.apache.kafka.connect.mirror.MirrorMaker.main(MirrorMaker.java:300)
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1637616209420, tries=1, nextAllowedTryMs=1637616209752) timed out at 1637616209652 after 1 attempt(s)
    at org.apache.kafka.common.internals.KafkaFutureImpl.wrapAndThrow(KafkaFutureImpl.java:45)
    at org.apache.kafka.common.internals.KafkaFutureImpl.access$000(KafkaFutureImpl.java:32)
    at org.apache.kafka.common.internals.KafkaFutureImpl$SingleWaiter.await(KafkaFutureImpl.java:89)
    at org.apache.kafka.common.internals.KafkaFutureImpl.get(KafkaFutureImpl.java:260)
    at org.apache.kafka.connect.util.ConnectUtils.lookupKafkaClusterId(ConnectUtils.java:64)
    ... 6 more
Caused by: org.apache.kafka.common.errors.TimeoutException: Call(callName=listNodes, deadlineMs=1637616209420, tries=1, nextAllowedTryMs=1637616209752) timed out at 1637616209652 after 1 attempt(s)
Caused by: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listNodes

集群正在运行 K8s，mirrormaker 部署在集群 A 中的单独 kafka 客户端 pod 上。尝试使用 producer.properties 中的以下设置

  • security.protocol=SASL_SSL
  • sasl.mechanism=GSSAPI
  • sasl.kerberos.service.name=kafka

有什么配置建议吗？

4

0 回答 0