我正在使用https://github.com/zendesk/racecar(它在后台使用https://github.com/appsignal/rdkafka-ruby ,这是https://github.com/edenhill/librdkafka/的 Ruby 包装器) 消费一个 Kafka 流,我时不时收到这个错误Local: Unknown partition (unknown_partition)
"/app/vendor/bundle/ruby/2.6.0/gems/rdkafka-0.8.1/lib/rdkafka/consumer.rb:339:in `store_offset'",
"/app/vendor/bundle/ruby/2.6.0/gems/racecar-2.3.0/lib/racecar/consumer_set.rb:51:in `store_offset'"
调用时似乎会引发此错误rd_kafka_offset_store
,对store offset of a message to be used in the next commit of this consumer
.
检查日志config.log_level = "debug"
看起来像上面的错误总是在前面:
rdkafka: [thrd:sasl_ssl://a1-abc-d1er1.eu-east-2.aws.confluent.cloud:9092/2]: sasl_ssl://a1-abc-d1er1.eu-east-2.aws.confluent.cloud:9092/2: Disconnected (after 3600185ms in state UP)
(try 1/10): Error for topic subscription #<struct Racecar::Consumer::Subscription topic="my.topic", start_from_beginning=true, max_bytes_per_partition=1048576, additional_config={}>: Local: Broker transport failure (transport)
第一次在这里使用 Kafka,我不知道可能是什么。