kafka验证消息时报错

问题

bash 复制代码

./kafka-console-consumer.sh --bootstrap-server 192.168.1.190:9092 --consumer.config /usr/local/kafka/config/sasl-consumer.properties --topic COMMAND_RESP --from-beginning --group KAFKA_CONSUMER_GROUP_ID

bash 复制代码

[root@drone-upms bin]# ./kafka-console-consumer.sh --bootstrap-server 192.168.1.190:9092 --consumer.config /usr/local/kafka/config/sasl-consumer.properties --topic COMMAND_RESP --from-beginning --group KAFKA_CONSUMER_GROUP_ID
[2025-11-17 13:46:23,640] WARN [Consumer clientId=console-consumer, groupId=KAFKA_CONSUMER_GROUP_ID] Error while fetching metadata with correlation id 2 : {COMMAND_RESP=TOPIC_AUTHORIZATION_FAILED} (org.apache.kafka.clients.NetworkClient)
[2025-11-17 13:46:23,641] ERROR [Consumer clientId=console-consumer, groupId=KAFKA_CONSUMER_GROUP_ID] Topic authorization failed for topics [COMMAND_RESP] (org.apache.kafka.clients.Metadata)
[2025-11-17 13:46:23,642] ERROR Error processing message, terminating consumer process:  (kafka.tools.ConsoleConsumer$)
org.apache.kafka.common.errors.TopicAuthorizationException: Not authorized to access topics: [COMMAND_RESP]
Processed a total of 0 messages

解决

查看元数据，发现topic不存在

bash 复制代码

[root@drone-upms bin]# ./kafka-topics.sh --bootstrap-server 192.168.1.190:9092 \
>   --command-config /usr/local/kafka/config/sasl-admin.properties \
>   --describe --topic COMMAND_RESP
Error while executing topic command : Topic 'COMMAND_RESP' does not exist as expected
[2025-11-17 14:02:17,904] ERROR java.lang.IllegalArgumentException: Topic 'COMMAND_RESP' does not exist as expected
	at kafka.admin.TopicCommand$.kafka$admin$TopicCommand$$ensureTopicExists(TopicCommand.scala:401)
	at kafka.admin.TopicCommand$TopicService.describeTopic(TopicCommand.scala:313)
	at kafka.admin.TopicCommand$.main(TopicCommand.scala:61)
	at kafka.admin.TopicCommand.main(TopicCommand.scala)
 (kafka.admin.TopicCommand$)

重建主题（若ZooKeeper中缺失）

强制删除残留的ACL并重新创建主题：

复制代码

(我这里只创建主题就行了，其它情况可能要删除ACL)

bash 复制代码

# 删除所有残留的ACL（谨慎操作！）
./kafka-acls.sh --bootstrap-server 192.168.1.190:9092 \
  --command-config /usr/local/kafka/config/sasl-admin.properties \
  --remove --allow-principal User:* --topic COMMAND_RESP --all

# 重新创建主题（确保副本数和分区数合理）
./kafka-topics.sh --bootstrap-server 192.168.1.190:9092 \
  --command-config /usr/local/kafka/config/sasl-admin.properties \
  --create --topic COMMAND_RESP \
  --partitions 1 --replication-factor 1

修复ZooKeeper元数据（若节点存在但损坏）

bash 复制代码

# 删除损坏的节点
rmr /brokers/topics/COMMAND_RESP

# 重新创建主题（触发ZooKeeper元数据同步）
./kafka-topics.sh --bootstrap-server 192.168.1.190:9092 \
  --command-config /usr/local/kafka/config/sasl-admin.properties \
  --create --topic COMMAND_RESP \
  --partitions 1 --replication-factor 1