探索ClickHouse——同时支持导入导出功能的文件格式

breaksoftware2023-10-03 17:54

在《探索ClickHouse------安装和测试》中，我们使用clickhouse直接从文件中读取数据。clickhouse支持多种格式文件的导入导出，本节我们对此进行分类介绍。

按常见格式区分

JSON

原始的JSON格式只支持导入，不支持导入。同时支持导入和导出的是其他几种类型：

JSONEachRow

yaml 复制代码 
{"uuid_string":"{D22473F5-3802-7B40-E053-6C04A8C0A630}","price_string":"230000","time":"2021-06-09 00:00","postcode":"CO13 0PQ","a":"D","b":"N","c":"F","addr1":"4","addr2":"","street":"BELLAMY CLOSE","locality":"KIRBY CROSS","town":"FRINTON-ON-SEA","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3803-7B40-E053-6C04A8C0A630}","price_string":"700000","time":"2021-06-25 00:00","postcode":"IG10 4BS","a":"T","b":"N","c":"F","addr1":"70","addr2":"","street":"SMARTS LANE","locality":"","town":"LOUGHTON","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3804-7B40-E053-6C04A8C0A630}","price_string":"625000","time":"2021-06-28 00:00","postcode":"EN9 1LH","a":"S","b":"N","c":"F","addr1":"7","addr2":"","street":"THE COBBINS","locality":"","town":"WALTHAM ABBEY","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3805-7B40-E053-6C04A8C0A630}","price_string":"360000","time":"2021-02-17 00:00","postcode":"SS9 3AU","a":"S","b":"N","c":"F","addr1":"117","addr2":"","street":"FLEMMING AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3806-7B40-E053-6C04A8C0A630}","price_string":"345000","time":"2021-06-25 00:00","postcode":"SS15 6BG","a":"S","b":"N","c":"F","addr1":"2","addr2":"","street":"BROADWATER GREEN","locality":"LAINDON","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3807-7B40-E053-6C04A8C0A630}","price_string":"220000","time":"2021-08-20 00:00","postcode":"CO7 0HE","a":"S","b":"N","c":"F","addr1":"133","addr2":"","street":"CHAPEL ROAD","locality":"BRIGHTLINGSEA","town":"COLCHESTER","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3808-7B40-E053-6C04A8C0A630}","price_string":"362000","time":"2021-06-29 00:00","postcode":"SS15 4AX","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"CROUCH STREET","locality":"","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3809-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-25 00:00","postcode":"CM9 6EP","a":"T","b":"N","c":"F","addr1":"58","addr2":"","street":"ORCHARD ROAD","locality":"","town":"MALDON","district":"MALDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380A-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-17 00:00","postcode":"SS4 3AR","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"ALLERTON CLOSE","locality":"","town":"ROCHFORD","district":"ROCHFORD","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380B-7B40-E053-6C04A8C0A630}","price_string":"535000","time":"2021-10-22 00:00","postcode":"SS9 1PZ","a":"T","b":"N","c":"F","addr1":"113","addr2":"","street":"LEIGHTON AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}

JSONStringsEachRow

yaml 复制代码 
{"uuid_string":"{D22473F5-3802-7B40-E053-6C04A8C0A630}","price_string":"230000","time":"2021-06-09 00:00","postcode":"CO13 0PQ","a":"D","b":"N","c":"F","addr1":"4","addr2":"","street":"BELLAMY CLOSE","locality":"KIRBY CROSS","town":"FRINTON-ON-SEA","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3803-7B40-E053-6C04A8C0A630}","price_string":"700000","time":"2021-06-25 00:00","postcode":"IG10 4BS","a":"T","b":"N","c":"F","addr1":"70","addr2":"","street":"SMARTS LANE","locality":"","town":"LOUGHTON","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3804-7B40-E053-6C04A8C0A630}","price_string":"625000","time":"2021-06-28 00:00","postcode":"EN9 1LH","a":"S","b":"N","c":"F","addr1":"7","addr2":"","street":"THE COBBINS","locality":"","town":"WALTHAM ABBEY","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3805-7B40-E053-6C04A8C0A630}","price_string":"360000","time":"2021-02-17 00:00","postcode":"SS9 3AU","a":"S","b":"N","c":"F","addr1":"117","addr2":"","street":"FLEMMING AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3806-7B40-E053-6C04A8C0A630}","price_string":"345000","time":"2021-06-25 00:00","postcode":"SS15 6BG","a":"S","b":"N","c":"F","addr1":"2","addr2":"","street":"BROADWATER GREEN","locality":"LAINDON","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3807-7B40-E053-6C04A8C0A630}","price_string":"220000","time":"2021-08-20 00:00","postcode":"CO7 0HE","a":"S","b":"N","c":"F","addr1":"133","addr2":"","street":"CHAPEL ROAD","locality":"BRIGHTLINGSEA","town":"COLCHESTER","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3808-7B40-E053-6C04A8C0A630}","price_string":"362000","time":"2021-06-29 00:00","postcode":"SS15 4AX","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"CROUCH STREET","locality":"","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3809-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-25 00:00","postcode":"CM9 6EP","a":"T","b":"N","c":"F","addr1":"58","addr2":"","street":"ORCHARD ROAD","locality":"","town":"MALDON","district":"MALDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380A-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-17 00:00","postcode":"SS4 3AR","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"ALLERTON CLOSE","locality":"","town":"ROCHFORD","district":"ROCHFORD","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380B-7B40-E053-6C04A8C0A630}","price_string":"535000","time":"2021-10-22 00:00","postcode":"SS9 1PZ","a":"T","b":"N","c":"F","addr1":"113","addr2":"","street":"LEIGHTON AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}

JSONCompactEachRow

yaml 复制代码 
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

JSONCompactStringsEachRow

yaml 复制代码 
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

按分隔符

TabSeparated

yaml 复制代码 
{D22473F5-3802-7B40-E053-6C04A8C0A630}  230000  2021-06-09 00:00        CO13 0PQ        D       N       F       4               BELLAMY CLOSE   KIRBY CROSS     FRINTON-ON-SEA  TENDRING        ESSEX   A       A
{D22473F5-3803-7B40-E053-6C04A8C0A630}  700000  2021-06-25 00:00        IG10 4BS        T       N       F       70              SMARTS LANE             LOUGHTON        EPPING FOREST   ESSEX   A       A
{D22473F5-3804-7B40-E053-6C04A8C0A630}  625000  2021-06-28 00:00        EN9 1LH S       N       F       7               THE COBBINS             WALTHAM ABBEY   EPPING FOREST   ESSEX   A       A
{D22473F5-3805-7B40-E053-6C04A8C0A630}  360000  2021-02-17 00:00        SS9 3AU S       N       F       117             FLEMMING AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A
{D22473F5-3806-7B40-E053-6C04A8C0A630}  345000  2021-06-25 00:00        SS15 6BG        S       N       F       2               BROADWATER GREEN        LAINDON BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3807-7B40-E053-6C04A8C0A630}  220000  2021-08-20 00:00        CO7 0HE S       N       F       133             CHAPEL ROAD     BRIGHTLINGSEA   COLCHESTER      TENDRING        ESSEX   A       A
{D22473F5-3808-7B40-E053-6C04A8C0A630}  362000  2021-06-29 00:00        SS15 4AX        T       N       F       32              CROUCH STREET           BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3809-7B40-E053-6C04A8C0A630}  300000  2021-06-25 00:00        CM9 6EP T       N       F       58              ORCHARD ROAD            MALDON  MALDON  ESSEX   A       A
{D22473F5-380A-7B40-E053-6C04A8C0A630}  300000  2021-06-17 00:00        SS4 3AR T       N       F       32              ALLERTON CLOSE          ROCHFORD        ROCHFORD        ESSEX   A       A
{D22473F5-380B-7B40-E053-6C04A8C0A630}  535000  2021-10-22 00:00        SS9 1PZ T       N       F       113             LEIGHTON AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A

CSV

yaml 复制代码 
"{D22473F5-3802-7B40-E053-6C04A8C0A630}","230000","2021-06-09 00:00","CO13 0PQ","D","N","F","4","","BELLAMY CLOSE","KIRBY CROSS","FRINTON-ON-SEA","TENDRING","ESSEX","A","A"
"{D22473F5-3803-7B40-E053-6C04A8C0A630}","700000","2021-06-25 00:00","IG10 4BS","T","N","F","70","","SMARTS LANE","","LOUGHTON","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3804-7B40-E053-6C04A8C0A630}","625000","2021-06-28 00:00","EN9 1LH","S","N","F","7","","THE COBBINS","","WALTHAM ABBEY","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3805-7B40-E053-6C04A8C0A630}","360000","2021-02-17 00:00","SS9 3AU","S","N","F","117","","FLEMMING AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"
"{D22473F5-3806-7B40-E053-6C04A8C0A630}","345000","2021-06-25 00:00","SS15 6BG","S","N","F","2","","BROADWATER GREEN","LAINDON","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3807-7B40-E053-6C04A8C0A630}","220000","2021-08-20 00:00","CO7 0HE","S","N","F","133","","CHAPEL ROAD","BRIGHTLINGSEA","COLCHESTER","TENDRING","ESSEX","A","A"
"{D22473F5-3808-7B40-E053-6C04A8C0A630}","362000","2021-06-29 00:00","SS15 4AX","T","N","F","32","","CROUCH STREET","","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3809-7B40-E053-6C04A8C0A630}","300000","2021-06-25 00:00","CM9 6EP","T","N","F","58","","ORCHARD ROAD","","MALDON","MALDON","ESSEX","A","A"
"{D22473F5-380A-7B40-E053-6C04A8C0A630}","300000","2021-06-17 00:00","SS4 3AR","T","N","F","32","","ALLERTON CLOSE","","ROCHFORD","ROCHFORD","ESSEX","A","A"
"{D22473F5-380B-7B40-E053-6C04A8C0A630}","535000","2021-10-22 00:00","SS9 1PZ","T","N","F","113","","LEIGHTON AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"

Values

('{D22473F5-3802-7B40-E053-6C04A8C0A630}','230000','2021-06-09 00:00','CO13 0PQ','D','N','F','4','','BELLAMY CLOSE','KIRBY CROSS','FRINTON-ON-SEA','TENDRING','ESSEX','A','A'),('{D22473F5-3803-7B40-E053-6C04A8C0A630}','700000','2021-06-25 00:00','IG10 4BS','T','N','F','70','','SMARTS LANE','','LOUGHTON','EPPING FOREST','ESSEX','A','A'),('{D22473F5-3804-7B40-E053-6C04A8C0A630}','625000','2021-06-28 00:00','EN9 1LH','S','N','F','7','','THE COBBINS','','WALTHAM ABBEY','EPPING FOREST','ESSEX','A','A'),('{D22473F5-3805-7B40-E053-6C04A8C0A630}','360000','2021-02-17 00:00','SS9 3AU','S','N','F','117','','FLEMMING AVENUE','','LEIGH-ON-SEA','SOUTHEND-ON-SEA','SOUTHEND-ON-SEA','A','A'),('{D22473F5-3806-7B40-E053-6C04A8C0A630}','345000','2021-06-25 00:00','SS15 6BG','S','N','F','2','','BROADWATER GREEN','LAINDON','BASILDON','BASILDON','ESSEX','A','A'),('{D22473F5-3807-7B40-E053-6C04A8C0A630}','220000','2021-08-20 00:00','CO7 0HE','S','N','F','133','','CHAPEL ROAD','BRIGHTLINGSEA','COLCHESTER','TENDRING','ESSEX','A','A'),('{D22473F5-3808-7B40-E053-6C04A8C0A630}','362000','2021-06-29 00:00','SS15 4AX','T','N','F','32','','CROUCH STREET','','BASILDON','BASILDON','ESSEX','A','A'),('{D22473F5-3809-7B40-E053-6C04A8C0A630}','300000','2021-06-25 00:00','CM9 6EP','T','N','F','58','','ORCHARD ROAD','','MALDON','MALDON','ESSEX','A','A'),('{D22473F5-380A-7B40-E053-6C04A8C0A630}','300000','2021-06-17 00:00','SS4 3AR','T','N','F','32','','ALLERTON CLOSE','','ROCHFORD','ROCHFORD','ESSEX','A','A'),('{D22473F5-380B-7B40-E053-6C04A8C0A630}','535000','2021-10-22 00:00','SS9 1PZ','T','N','F','113','','LEIGHTON AVENUE','','LEIGH-ON-SEA','SOUTHEND-ON-SEA','SOUTHEND-ON-SEA','A','A')

按携带更多信息

只携带字段名

TabSeparatedWithNames

yaml 复制代码 
uuid_string     price_string    time    postcode        a       b       c       addr1   addr2   street  locality        town    district        county  d       e
{D22473F5-3802-7B40-E053-6C04A8C0A630}  230000  2021-06-09 00:00        CO13 0PQ        D       N       F       4               BELLAMY CLOSE   KIRBY CROSS     FRINTON-ON-SEA  TENDRING        ESSEX   A       A
{D22473F5-3803-7B40-E053-6C04A8C0A630}  700000  2021-06-25 00:00        IG10 4BS        T       N       F       70              SMARTS LANE             LOUGHTON        EPPING FOREST   ESSEX   A       A
{D22473F5-3804-7B40-E053-6C04A8C0A630}  625000  2021-06-28 00:00        EN9 1LH S       N       F       7               THE COBBINS             WALTHAM ABBEY   EPPING FOREST   ESSEX   A       A
{D22473F5-3805-7B40-E053-6C04A8C0A630}  360000  2021-02-17 00:00        SS9 3AU S       N       F       117             FLEMMING AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A
{D22473F5-3806-7B40-E053-6C04A8C0A630}  345000  2021-06-25 00:00        SS15 6BG        S       N       F       2               BROADWATER GREEN        LAINDON BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3807-7B40-E053-6C04A8C0A630}  220000  2021-08-20 00:00        CO7 0HE S       N       F       133             CHAPEL ROAD     BRIGHTLINGSEA   COLCHESTER      TENDRING        ESSEX   A       A
{D22473F5-3808-7B40-E053-6C04A8C0A630}  362000  2021-06-29 00:00        SS15 4AX        T       N       F       32              CROUCH STREET           BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3809-7B40-E053-6C04A8C0A630}  300000  2021-06-25 00:00        CM9 6EP T       N       F       58              ORCHARD ROAD            MALDON  MALDON  ESSEX   A       A
{D22473F5-380A-7B40-E053-6C04A8C0A630}  300000  2021-06-17 00:00        SS4 3AR T       N       F       32              ALLERTON CLOSE          ROCHFORD        ROCHFORD        ESSEX   A       A
{D22473F5-380B-7B40-E053-6C04A8C0A630}  535000  2021-10-22 00:00        SS9 1PZ T       N       F       113             LEIGHTON AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A

CSVWithNames

yaml 复制代码 
"uuid_string","price_string","time","postcode","a","b","c","addr1","addr2","street","locality","town","district","county","d","e"
"{D22473F5-3802-7B40-E053-6C04A8C0A630}","230000","2021-06-09 00:00","CO13 0PQ","D","N","F","4","","BELLAMY CLOSE","KIRBY CROSS","FRINTON-ON-SEA","TENDRING","ESSEX","A","A"
"{D22473F5-3803-7B40-E053-6C04A8C0A630}","700000","2021-06-25 00:00","IG10 4BS","T","N","F","70","","SMARTS LANE","","LOUGHTON","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3804-7B40-E053-6C04A8C0A630}","625000","2021-06-28 00:00","EN9 1LH","S","N","F","7","","THE COBBINS","","WALTHAM ABBEY","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3805-7B40-E053-6C04A8C0A630}","360000","2021-02-17 00:00","SS9 3AU","S","N","F","117","","FLEMMING AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"
"{D22473F5-3806-7B40-E053-6C04A8C0A630}","345000","2021-06-25 00:00","SS15 6BG","S","N","F","2","","BROADWATER GREEN","LAINDON","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3807-7B40-E053-6C04A8C0A630}","220000","2021-08-20 00:00","CO7 0HE","S","N","F","133","","CHAPEL ROAD","BRIGHTLINGSEA","COLCHESTER","TENDRING","ESSEX","A","A"
"{D22473F5-3808-7B40-E053-6C04A8C0A630}","362000","2021-06-29 00:00","SS15 4AX","T","N","F","32","","CROUCH STREET","","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3809-7B40-E053-6C04A8C0A630}","300000","2021-06-25 00:00","CM9 6EP","T","N","F","58","","ORCHARD ROAD","","MALDON","MALDON","ESSEX","A","A"
"{D22473F5-380A-7B40-E053-6C04A8C0A630}","300000","2021-06-17 00:00","SS4 3AR","T","N","F","32","","ALLERTON CLOSE","","ROCHFORD","ROCHFORD","ESSEX","A","A"
"{D22473F5-380B-7B40-E053-6C04A8C0A630}","535000","2021-10-22 00:00","SS9 1PZ","T","N","F","113","","LEIGHTON AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"

携带字段名和类型

TabSeparatedWithNamesAndTypes

yaml 复制代码 
uuid_string     price_string    time    postcode        a       b       c       addr1   addr2   street  locality        town    district        county  d       e
String  String  String  String  String  String  String  String  String  String  String  String  String  String  String  String
{D22473F5-3802-7B40-E053-6C04A8C0A630}  230000  2021-06-09 00:00        CO13 0PQ        D       N       F       4               BELLAMY CLOSE   KIRBY CROSS     FRINTON-ON-SEA  TENDRING        ESSEX   A       A
{D22473F5-3803-7B40-E053-6C04A8C0A630}  700000  2021-06-25 00:00        IG10 4BS        T       N       F       70              SMARTS LANE             LOUGHTON        EPPING FOREST   ESSEX   A       A
{D22473F5-3804-7B40-E053-6C04A8C0A630}  625000  2021-06-28 00:00        EN9 1LH S       N       F       7               THE COBBINS             WALTHAM ABBEY   EPPING FOREST   ESSEX   A       A
{D22473F5-3805-7B40-E053-6C04A8C0A630}  360000  2021-02-17 00:00        SS9 3AU S       N       F       117             FLEMMING AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A
{D22473F5-3806-7B40-E053-6C04A8C0A630}  345000  2021-06-25 00:00        SS15 6BG        S       N       F       2               BROADWATER GREEN        LAINDON BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3807-7B40-E053-6C04A8C0A630}  220000  2021-08-20 00:00        CO7 0HE S       N       F       133             CHAPEL ROAD     BRIGHTLINGSEA   COLCHESTER      TENDRING        ESSEX   A       A
{D22473F5-3808-7B40-E053-6C04A8C0A630}  362000  2021-06-29 00:00        SS15 4AX        T       N       F       32              CROUCH STREET           BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3809-7B40-E053-6C04A8C0A630}  300000  2021-06-25 00:00        CM9 6EP T       N       F       58              ORCHARD ROAD            MALDON  MALDON  ESSEX   A       A
{D22473F5-380A-7B40-E053-6C04A8C0A630}  300000  2021-06-17 00:00        SS4 3AR T       N       F       32              ALLERTON CLOSE          ROCHFORD        ROCHFORD        ESSEX   A       A
{D22473F5-380B-7B40-E053-6C04A8C0A630}  535000  2021-10-22 00:00        SS9 1PZ T       N       F       113             LEIGHTON AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A

JSONCompactEachRowWithNamesAndTypes

yaml 复制代码 
["uuid_string", "price_string", "time", "postcode", "a", "b", "c", "addr1", "addr2", "street", "locality", "town", "district", "county", "d", "e"]
["String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String"]
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

JSONCompactStringsEachRowWithNamesAndTypes

yaml 复制代码 
["uuid_string", "price_string", "time", "postcode", "a", "b", "c", "addr1", "addr2", "street", "locality", "town", "district", "county", "d", "e"]
["String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String"]
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

TSKV

yaml 复制代码 
uuid_string={D22473F5-3802-7B40-E053-6C04A8C0A630}      price_string=230000     time=2021-06-09 00:00   postcode=CO13 0PQ       a=D     b=N     c=F     addr1=4 addr2=  street=BELLAMY CLOSE    locality=KIRBY CROSS    town=FRINTON-ON-SEA     district=TENDRING       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3803-7B40-E053-6C04A8C0A630}      price_string=700000     time=2021-06-25 00:00   postcode=IG10 4BS       a=T     b=N     c=F     addr1=70        addr2=  street=SMARTS LANE      locality=       town=LOUGHTON   district=EPPING FOREST  county=ESSEX    d=A     e=A
uuid_string={D22473F5-3804-7B40-E053-6C04A8C0A630}      price_string=625000     time=2021-06-28 00:00   postcode=EN9 1LH        a=S     b=N     c=F     addr1=7 addr2=  street=THE COBBINS      locality=       town=WALTHAM ABBEY      district=EPPING FOREST  county=ESSEX    d=A     e=A
uuid_string={D22473F5-3805-7B40-E053-6C04A8C0A630}      price_string=360000     time=2021-02-17 00:00   postcode=SS9 3AU        a=S     b=N     c=F     addr1=117       addr2=  street=FLEMMING AVENUE  locality=       town=LEIGH-ON-SEA       district=SOUTHEND-ON-SEA        county=SOUTHEND-ON-SEA  d=A     e=A
uuid_string={D22473F5-3806-7B40-E053-6C04A8C0A630}      price_string=345000     time=2021-06-25 00:00   postcode=SS15 6BG       a=S     b=N     c=F     addr1=2 addr2=  street=BROADWATER GREEN locality=LAINDON        town=BASILDON   district=BASILDON       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3807-7B40-E053-6C04A8C0A630}      price_string=220000     time=2021-08-20 00:00   postcode=CO7 0HE        a=S     b=N     c=F     addr1=133       addr2=  street=CHAPEL ROAD      locality=BRIGHTLINGSEA  town=COLCHESTER district=TENDRING       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3808-7B40-E053-6C04A8C0A630}      price_string=362000     time=2021-06-29 00:00   postcode=SS15 4AX       a=T     b=N     c=F     addr1=32        addr2=  street=CROUCH STREET    locality=       town=BASILDON   district=BASILDON       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3809-7B40-E053-6C04A8C0A630}      price_string=300000     time=2021-06-25 00:00   postcode=CM9 6EP        a=T     b=N     c=F     addr1=58        addr2=  street=ORCHARD ROAD     locality=       town=MALDON     district=MALDON county=ESSEX    d=A     e=A
uuid_string={D22473F5-380A-7B40-E053-6C04A8C0A630}      price_string=300000     time=2021-06-17 00:00   postcode=SS4 3AR        a=T     b=N     c=F     addr1=32        addr2=  street=ALLERTON CLOSE   locality=       town=ROCHFORD   district=ROCHFORD       county=ESSEX    d=A     e=A
uuid_string={D22473F5-380B-7B40-E053-6C04A8C0A630}      price_string=535000     time=2021-10-22 00:00   postcode=SS9 1PZ        a=T     b=N     c=F     addr1=113       addr2=  street=LEIGHTON AVENUE  locality=       town=LEIGH-ON-SEA       district=SOUTHEND-ON-SEA        county=SOUTHEND-ON-SEA  d=A     e=A

RowBinaryWithNamesAndTypes

二进制格式，不支持文本查看。

不可读类型

Native

最高性能的格式 。通过二进制格式的块进行写入和读取（即它是基于块的，这和后面介绍的RowBinary系列不同）。它主要用于服务器间交互。

在《探索ClickHouse------使用Projection加速查询》一文中，原始数据是CSV格式，大小约4.6G。导入数据库后约308M。这个数据库的内容导出为Native格式的文件，大小只有约168M。

-rw-rw-r-- 1 fangliang fangliang 176572374 Sep 26 09:19 Native.txt

RowBinary

以二进制格式逐行格式化和解析数据。行和值连续列出，没有分隔符。 这种格式比 Native 格式效率低，因为它是基于行的。

导出这个类型的文件，大概和Native类型的差不多大小。

-rw-rw-r-- 1 fangliang fangliang 176568308 Sep 26 10:12 RowBinary.txt

RowBinaryWithNamesAndTypes

添加头部信息的RowBinary。

其他开源项目类型

Protobuf

Protobuf是一个 Protocol Buffers 格式。此格式需要外部格式描述文件(proto文件)。 该描述文件会进行缓存，以备后续查询。 ClickHouse支持 proto2 和 proto3 语法的proto文件，支持重复/可选/必填字段。

Avro

Apache Avro 是在Apache Hadoop项目中开发的面向行的数据序列化框架。

Parquet

Apache Parquet 是Hadoop生态系统中普遍使用的列式存储格式。

Arrow

Apache Arrow是一种用于内存数据库的格式，共有两种模式，文件与流模式。

ArrowStream

ArrowStream对应的是Arrow的流模式，这种格式适用于内存的流式处理。

ORC

Apache ORC 是Hadoop生态系统中普遍存在的列式存储格式。

其他

Compact和非Compact的区别

非Compact是一条完整符合规则的格式，Compact则是将值变成一个数组保存。以JSONCompactEachRowJSONEachRow为例

yaml 复制代码 
# JSONCompactEachRow
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
yaml 复制代码 
# JSONEachRow
{"uuid_string":"{D22473F5-3802-7B40-E053-6C04A8C0A630}","price_string":"230000","time":"2021-06-09 00:00","postcode":"CO13 0PQ","a":"D","b":"N","c":"F","addr1":"4","addr2":"","street":"BELLAMY CLOSE","locality":"KIRBY CROSS","town":"FRINTON-ON-SEA","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}

String和非String的区别

String会将JSON对象转变为一个字符串。以JSONStringsEachRow和JSONEachRow为例:

yaml 复制代码 
#  JSONCompactEachRow
[42,"hello",[1,"a"]]
yaml 复制代码 
# JSONCompactStringsEachRow
["42","hello","(2,'a')"]

导出命令

上述格式可以通过修改下面的命令导出，其中--format用于指定格式。

bash 复制代码 
clickhouse-client --query "SELECT * FROM file('pp-2021.csv', 'CSV', 'uuid_string String, price_string String, time String, postcode String, a String, b String, c String, addr1 String, addr2 String, street String, locality String, town String, district String, county String, d String, e String') LIMIT 10;" --format JSONCompactEachRow > JSONCompactEachRow.txt

查考资料

相关推荐
Mr_wilson_liu3 分钟前
通过DBeaver22.0.5 连接数据库ck（clickhouse）、pg（postgres）
数据库·clickhouse
波波仔862 天前
clickhouse表存储引擎
clickhouse·表存储引擎
波波仔862 天前
clickhouse存储和分区
clickhouse·排序·分区
波波仔862 天前
clickhouse insert与update区别
clickhouse·insert·update
波波仔862 天前
clickhouse简介
数据库·clickhouse
深色風信子2 天前
ClickHouse 快速入门
clickhouse·列式存储
波波仔862 天前
行存储与列存储的区别
数据库·clickhouse·行存储·列储存
吃喝不愁霸王餐APP开发者2 天前
霸王餐用户行为埋点：Kafka Connect+ClickHouse实时OLAP分析
分布式·clickhouse·kafka
honder试试3 天前
客户端连接Clickhouse连不上解决方案
java·clickhouse
honder试试4 天前
Centos7从0-1安装部署Clickhouse验证与Mysql实时同步
数据库·mysql·clickhouse
热门推荐
01GitHub 镜像站点02UV安装并设置国内源03【AutoGLM部署】本地私有化部署AI手机Agent04【超详细教程】手把手教你从微软官网免费下载Windows 10官方原版ISO镜像（2025最新版）05Linux下V2Ray安装配置指南06Cursor 又偷偷更新，这个功能太实用：Visual Editor for Cursor Browser07Open-AutoGLM Windows 安装部署教程08BongoCat - 跨平台键盘猫动画工具09Windows 11 官方系统安装与重装完整教程（2025年最新版）10安娜的档案(Anna’s Archive) 镜像网站/国内最新可访问入口（持续更新）