报错
You should retry committing the latest consumed offsets.
Caused by: org.apache.kafka.common.errors.CoordinatorNotAvailableException: The coordinator is not available.
但是任务还在正常跑.
开源bug
FLINK-28060 Kafka Commit on checkpointing fails repeatedly after a broker restart - ASF JIRA
导致的现象
任务还在跑 认识消费kafka的偏移量没有随着checkpoint提交到kafka broker. 会导致如果监控任务监控kafka broker存储的偏移量,那么就会任务你的任务一致没有消费.
解决
重启任务
升级到flink 1.16.x