clickhouse Checksum doesn‘t match: 问题修复

  1. 问题描述

SQL 错误 40 07000: Code: 40. DB::Exception: Checksum doesn't match: corrupted data. Reference: 50e8c1efa78de2881b725d44b04be1fe. Actual: 161c99eb681ec36b83540ecdd65ad8c9. Size of compressed block: 32846. The mismatch is caused by single bit flip in data block at byte 10059, bit 6. This is most likely due to hardware failure. If you receive broken data over network and the error does not repeat every time, this can be caused by bad RAM on network interface controller or bad controller itself or bad RAM on network switches or bad CPU on network switches (look at the logs on related network switches; note that TCP checksums don't help) or bad RAM on host (look at dmesg or kern.log for enormous amount of EDAC errors, ECC-related reports, Machine Check Exceptions, mcelog; note that ECC memory can fail if the number of errors is huge) or bad CPU on host. If you read data from disk, this can be caused by disk bit rot. This exception protects ClickHouse from data corruption due to hardware failures.: (while reading column id): (while reading from part /data/clickhouse/store/979/9795066e-6ea5-4550-8361-6c35d8ed9dca/7-20230727_1282473_1283947_9/ from mark 2232 with max_rows_to_read = 33022): While executing MergeTreeThread. (CHECKSUM_DOESNT_MATCH) (version 23.3.1.2823 (official build))

, server ClickHouseNode uri={socket_timeout=300000,use_server_time_zone=false,use_time_zone=false}@-1484630932

2.问题解决

https://github.com/marliotto/clickhouse-bitflip

使用clickhouse-bitflip修复损坏的clickhouse数据,将代码下载下来,进行build,然后修复出问题的文件。 像上面的报错,需要修复的文件是

/data/clickhouse/store/979/9795066e-6ea5-4550-8361-6c35d8ed9dca/7-20230727_1282473_1283947_9/id.bin

修复命令

./clickhouse-bitflip /data/clickhouse/store/979/9795066e-6ea5-4550-8361-6c35d8ed9dca/7-20230727_1282473_1283947_9/id.bin

相关推荐
深蓝电商API16 小时前
亿级数据的存储选型:MongoDB/ES/ClickHouse横评
爬虫·clickhouse·mongodb·elasticsearch
流烟默3 天前
ClickHouse Part 机制与写入优化实践指南
大数据·运维·clickhouse
Sayai9 天前
ClickHouse WITH FILL 实战:监控大屏时间序列补零,附多粒度指标表与物化视图级联设计
大数据·运维·数据仓库·clickhouse·物化视图
l1t13 天前
DeepSeek总结的clickhouse的二进制文件自解压机制
clickhouse
l1t14 天前
DeepSeek总结的pg_clickhouse 与 chdb 更新:编码、嵌套与类型
数据库·clickhouse·postgresql
拔剑纵狂歌16 天前
ClickHouse system.query_log 字段详解与排障实践
后端·clickhouse·1024程序员节
SelectDB技术团队16 天前
Apache Doris 高性能 Open Lake Variant 读写技术解析(含对比数据)
数据结构·数据库·clickhouse·日志·apache doris·selectdb·湖仓架构升级
SelectDB技术团队17 天前
ClickHouse 存日志的能力边界:并发、检索与 trace 回放的实测对照
数据结构·数据库·clickhouse·日志分析·apache doris·日志存储
SelectDB技术团队17 天前
Agent Trace 数据底座建设:宽表建模、全文检索与成本聚合的配置与验证步骤
大数据·python·clickhouse·elk·elasticsearch·全文检索·复杂查询
此时不提桶,更待何时17 天前
05-03-B-ClickHouse与OLAP面试与生产事故实战
clickhouse·面试·nosql