clickhouse Checksum doesn‘t match: 问题修复

  1. 问题描述

SQL 错误 40 07000: Code: 40. DB::Exception: Checksum doesn't match: corrupted data. Reference: 50e8c1efa78de2881b725d44b04be1fe. Actual: 161c99eb681ec36b83540ecdd65ad8c9. Size of compressed block: 32846. The mismatch is caused by single bit flip in data block at byte 10059, bit 6. This is most likely due to hardware failure. If you receive broken data over network and the error does not repeat every time, this can be caused by bad RAM on network interface controller or bad controller itself or bad RAM on network switches or bad CPU on network switches (look at the logs on related network switches; note that TCP checksums don't help) or bad RAM on host (look at dmesg or kern.log for enormous amount of EDAC errors, ECC-related reports, Machine Check Exceptions, mcelog; note that ECC memory can fail if the number of errors is huge) or bad CPU on host. If you read data from disk, this can be caused by disk bit rot. This exception protects ClickHouse from data corruption due to hardware failures.: (while reading column id): (while reading from part /data/clickhouse/store/979/9795066e-6ea5-4550-8361-6c35d8ed9dca/7-20230727_1282473_1283947_9/ from mark 2232 with max_rows_to_read = 33022): While executing MergeTreeThread. (CHECKSUM_DOESNT_MATCH) (version 23.3.1.2823 (official build))

, server ClickHouseNode uri={socket_timeout=300000,use_server_time_zone=false,use_time_zone=false}@-1484630932

2.问题解决

https://github.com/marliotto/clickhouse-bitflip

使用clickhouse-bitflip修复损坏的clickhouse数据,将代码下载下来,进行build,然后修复出问题的文件。 像上面的报错,需要修复的文件是

/data/clickhouse/store/979/9795066e-6ea5-4550-8361-6c35d8ed9dca/7-20230727_1282473_1283947_9/id.bin

修复命令

./clickhouse-bitflip /data/clickhouse/store/979/9795066e-6ea5-4550-8361-6c35d8ed9dca/7-20230727_1282473_1283947_9/id.bin

相关推荐
SelectDB技术团队1 天前
从 ClickHouse 迁移到 Doris:SQL 兼容、同步与验证清单
数据库·人工智能·sql·clickhouse·apache doris·selectdb·湖仓架构升级
java_logo3 天前
Docker 部署 ClickHouse Server:轻松搭建列式 OLAP 分析数据库平台
数据库·clickhouse·docker·私有化部署·olap·列式数据库·轩辕镜像
西风未眠7 天前
ClickHouse数据库引擎引起的数据丢失
数据库·clickhouse·故障
李兆龙的博客9 天前
从一到无穷大 #86:ClickHouse 收购 RunReveal——可观测性竞争进入宏观调控阶段
clickhouse
Gain_chance13 天前
大数据毕业设计实战|Data Insight Platform:用 FastAPI + ClickHouse 打造低门槛全链路数据洞察平台
大数据·数据库·clickhouse·毕业设计·fastapi
迷迭香yy16 天前
A股数据本地存储方案对比JSON、SQLite、ClickHouse、DuckDB怎么选 IG50免费开源股票数据API接口
clickhouse·sqlite·json
leisoo809717 天前
本地股票数据深度对比ClickHouse与Parquet存储方案 IG50免费开源股票数据API接口
clickhouse·开源
A.说学逗唱的Coke19 天前
【数据库专题】ClickHouse 深度实战:从列式存储原理到 PB 级海量日志与可观测性分析
数据库·clickhouse·硬件架构
吉甫作诵25 天前
阿里云 ECS 安装 ClickHouse:密码配置、目录迁移与基础调优
大数据·clickhouse
NineData25 天前
NineData Oracle 到 ClickHouse 数据迁移完整流程:结构复制、全量装载、增量同步
数据库·clickhouse·oracle·数据迁移·ninedata·增量同步·数据迁移工具