0

我正在使用https://github.com/zendesk/racecar(它在后台使用https://github.com/appsignal/rdkafka-ruby ,这是https://github.com/edenhill/librdkafka/的 Ruby 包装器) 消费一个 Kafka 流,我时不时收到这个错误Local: Unknown partition (unknown_partition)

"/app/vendor/bundle/ruby/2.6.0/gems/rdkafka-0.8.1/lib/rdkafka/consumer.rb:339:in `store_offset'", 
"/app/vendor/bundle/ruby/2.6.0/gems/racecar-2.3.0/lib/racecar/consumer_set.rb:51:in `store_offset'"

调用时似乎会引发此错误rd_kafka_offset_store,对store offset of a message to be used in the next commit of this consumer.

检查日志config.log_level = "debug"看起来像上面的错误总是在前面:

rdkafka: [thrd:sasl_ssl://a1-abc-d1er1.eu-east-2.aws.confluent.cloud:9092/2]: sasl_ssl://a1-abc-d1er1.eu-east-2.aws.confluent.cloud:9092/2: Disconnected (after 3600185ms in state UP)

(try 1/10): Error for topic subscription #<struct Racecar::Consumer::Subscription topic="my.topic", start_from_beginning=true, max_bytes_per_partition=1048576, additional_config={}>: Local: Broker transport failure (transport)

第一次在这里使用 Kafka,我不知道可能是什么。

4

0 回答 0