探索ClickHouse——同时支持导入导出功能的文件格式

breaksoftware2023-10-03 17:54

在《探索ClickHouse------安装和测试》中，我们使用clickhouse直接从文件中读取数据。clickhouse支持多种格式文件的导入导出，本节我们对此进行分类介绍。

按常见格式区分

JSON

原始的JSON格式只支持导入，不支持导入。同时支持导入和导出的是其他几种类型：

JSONEachRow

yaml 复制代码 
{"uuid_string":"{D22473F5-3802-7B40-E053-6C04A8C0A630}","price_string":"230000","time":"2021-06-09 00:00","postcode":"CO13 0PQ","a":"D","b":"N","c":"F","addr1":"4","addr2":"","street":"BELLAMY CLOSE","locality":"KIRBY CROSS","town":"FRINTON-ON-SEA","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3803-7B40-E053-6C04A8C0A630}","price_string":"700000","time":"2021-06-25 00:00","postcode":"IG10 4BS","a":"T","b":"N","c":"F","addr1":"70","addr2":"","street":"SMARTS LANE","locality":"","town":"LOUGHTON","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3804-7B40-E053-6C04A8C0A630}","price_string":"625000","time":"2021-06-28 00:00","postcode":"EN9 1LH","a":"S","b":"N","c":"F","addr1":"7","addr2":"","street":"THE COBBINS","locality":"","town":"WALTHAM ABBEY","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3805-7B40-E053-6C04A8C0A630}","price_string":"360000","time":"2021-02-17 00:00","postcode":"SS9 3AU","a":"S","b":"N","c":"F","addr1":"117","addr2":"","street":"FLEMMING AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3806-7B40-E053-6C04A8C0A630}","price_string":"345000","time":"2021-06-25 00:00","postcode":"SS15 6BG","a":"S","b":"N","c":"F","addr1":"2","addr2":"","street":"BROADWATER GREEN","locality":"LAINDON","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3807-7B40-E053-6C04A8C0A630}","price_string":"220000","time":"2021-08-20 00:00","postcode":"CO7 0HE","a":"S","b":"N","c":"F","addr1":"133","addr2":"","street":"CHAPEL ROAD","locality":"BRIGHTLINGSEA","town":"COLCHESTER","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3808-7B40-E053-6C04A8C0A630}","price_string":"362000","time":"2021-06-29 00:00","postcode":"SS15 4AX","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"CROUCH STREET","locality":"","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3809-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-25 00:00","postcode":"CM9 6EP","a":"T","b":"N","c":"F","addr1":"58","addr2":"","street":"ORCHARD ROAD","locality":"","town":"MALDON","district":"MALDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380A-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-17 00:00","postcode":"SS4 3AR","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"ALLERTON CLOSE","locality":"","town":"ROCHFORD","district":"ROCHFORD","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380B-7B40-E053-6C04A8C0A630}","price_string":"535000","time":"2021-10-22 00:00","postcode":"SS9 1PZ","a":"T","b":"N","c":"F","addr1":"113","addr2":"","street":"LEIGHTON AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}

JSONStringsEachRow

yaml 复制代码 
{"uuid_string":"{D22473F5-3802-7B40-E053-6C04A8C0A630}","price_string":"230000","time":"2021-06-09 00:00","postcode":"CO13 0PQ","a":"D","b":"N","c":"F","addr1":"4","addr2":"","street":"BELLAMY CLOSE","locality":"KIRBY CROSS","town":"FRINTON-ON-SEA","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3803-7B40-E053-6C04A8C0A630}","price_string":"700000","time":"2021-06-25 00:00","postcode":"IG10 4BS","a":"T","b":"N","c":"F","addr1":"70","addr2":"","street":"SMARTS LANE","locality":"","town":"LOUGHTON","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3804-7B40-E053-6C04A8C0A630}","price_string":"625000","time":"2021-06-28 00:00","postcode":"EN9 1LH","a":"S","b":"N","c":"F","addr1":"7","addr2":"","street":"THE COBBINS","locality":"","town":"WALTHAM ABBEY","district":"EPPING FOREST","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3805-7B40-E053-6C04A8C0A630}","price_string":"360000","time":"2021-02-17 00:00","postcode":"SS9 3AU","a":"S","b":"N","c":"F","addr1":"117","addr2":"","street":"FLEMMING AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3806-7B40-E053-6C04A8C0A630}","price_string":"345000","time":"2021-06-25 00:00","postcode":"SS15 6BG","a":"S","b":"N","c":"F","addr1":"2","addr2":"","street":"BROADWATER GREEN","locality":"LAINDON","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3807-7B40-E053-6C04A8C0A630}","price_string":"220000","time":"2021-08-20 00:00","postcode":"CO7 0HE","a":"S","b":"N","c":"F","addr1":"133","addr2":"","street":"CHAPEL ROAD","locality":"BRIGHTLINGSEA","town":"COLCHESTER","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3808-7B40-E053-6C04A8C0A630}","price_string":"362000","time":"2021-06-29 00:00","postcode":"SS15 4AX","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"CROUCH STREET","locality":"","town":"BASILDON","district":"BASILDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-3809-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-25 00:00","postcode":"CM9 6EP","a":"T","b":"N","c":"F","addr1":"58","addr2":"","street":"ORCHARD ROAD","locality":"","town":"MALDON","district":"MALDON","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380A-7B40-E053-6C04A8C0A630}","price_string":"300000","time":"2021-06-17 00:00","postcode":"SS4 3AR","a":"T","b":"N","c":"F","addr1":"32","addr2":"","street":"ALLERTON CLOSE","locality":"","town":"ROCHFORD","district":"ROCHFORD","county":"ESSEX","d":"A","e":"A"}
{"uuid_string":"{D22473F5-380B-7B40-E053-6C04A8C0A630}","price_string":"535000","time":"2021-10-22 00:00","postcode":"SS9 1PZ","a":"T","b":"N","c":"F","addr1":"113","addr2":"","street":"LEIGHTON AVENUE","locality":"","town":"LEIGH-ON-SEA","district":"SOUTHEND-ON-SEA","county":"SOUTHEND-ON-SEA","d":"A","e":"A"}

JSONCompactEachRow

yaml 复制代码 
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

JSONCompactStringsEachRow

yaml 复制代码 
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

按分隔符

TabSeparated

yaml 复制代码 
{D22473F5-3802-7B40-E053-6C04A8C0A630}  230000  2021-06-09 00:00        CO13 0PQ        D       N       F       4               BELLAMY CLOSE   KIRBY CROSS     FRINTON-ON-SEA  TENDRING        ESSEX   A       A
{D22473F5-3803-7B40-E053-6C04A8C0A630}  700000  2021-06-25 00:00        IG10 4BS        T       N       F       70              SMARTS LANE             LOUGHTON        EPPING FOREST   ESSEX   A       A
{D22473F5-3804-7B40-E053-6C04A8C0A630}  625000  2021-06-28 00:00        EN9 1LH S       N       F       7               THE COBBINS             WALTHAM ABBEY   EPPING FOREST   ESSEX   A       A
{D22473F5-3805-7B40-E053-6C04A8C0A630}  360000  2021-02-17 00:00        SS9 3AU S       N       F       117             FLEMMING AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A
{D22473F5-3806-7B40-E053-6C04A8C0A630}  345000  2021-06-25 00:00        SS15 6BG        S       N       F       2               BROADWATER GREEN        LAINDON BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3807-7B40-E053-6C04A8C0A630}  220000  2021-08-20 00:00        CO7 0HE S       N       F       133             CHAPEL ROAD     BRIGHTLINGSEA   COLCHESTER      TENDRING        ESSEX   A       A
{D22473F5-3808-7B40-E053-6C04A8C0A630}  362000  2021-06-29 00:00        SS15 4AX        T       N       F       32              CROUCH STREET           BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3809-7B40-E053-6C04A8C0A630}  300000  2021-06-25 00:00        CM9 6EP T       N       F       58              ORCHARD ROAD            MALDON  MALDON  ESSEX   A       A
{D22473F5-380A-7B40-E053-6C04A8C0A630}  300000  2021-06-17 00:00        SS4 3AR T       N       F       32              ALLERTON CLOSE          ROCHFORD        ROCHFORD        ESSEX   A       A
{D22473F5-380B-7B40-E053-6C04A8C0A630}  535000  2021-10-22 00:00        SS9 1PZ T       N       F       113             LEIGHTON AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A

CSV

yaml 复制代码 
"{D22473F5-3802-7B40-E053-6C04A8C0A630}","230000","2021-06-09 00:00","CO13 0PQ","D","N","F","4","","BELLAMY CLOSE","KIRBY CROSS","FRINTON-ON-SEA","TENDRING","ESSEX","A","A"
"{D22473F5-3803-7B40-E053-6C04A8C0A630}","700000","2021-06-25 00:00","IG10 4BS","T","N","F","70","","SMARTS LANE","","LOUGHTON","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3804-7B40-E053-6C04A8C0A630}","625000","2021-06-28 00:00","EN9 1LH","S","N","F","7","","THE COBBINS","","WALTHAM ABBEY","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3805-7B40-E053-6C04A8C0A630}","360000","2021-02-17 00:00","SS9 3AU","S","N","F","117","","FLEMMING AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"
"{D22473F5-3806-7B40-E053-6C04A8C0A630}","345000","2021-06-25 00:00","SS15 6BG","S","N","F","2","","BROADWATER GREEN","LAINDON","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3807-7B40-E053-6C04A8C0A630}","220000","2021-08-20 00:00","CO7 0HE","S","N","F","133","","CHAPEL ROAD","BRIGHTLINGSEA","COLCHESTER","TENDRING","ESSEX","A","A"
"{D22473F5-3808-7B40-E053-6C04A8C0A630}","362000","2021-06-29 00:00","SS15 4AX","T","N","F","32","","CROUCH STREET","","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3809-7B40-E053-6C04A8C0A630}","300000","2021-06-25 00:00","CM9 6EP","T","N","F","58","","ORCHARD ROAD","","MALDON","MALDON","ESSEX","A","A"
"{D22473F5-380A-7B40-E053-6C04A8C0A630}","300000","2021-06-17 00:00","SS4 3AR","T","N","F","32","","ALLERTON CLOSE","","ROCHFORD","ROCHFORD","ESSEX","A","A"
"{D22473F5-380B-7B40-E053-6C04A8C0A630}","535000","2021-10-22 00:00","SS9 1PZ","T","N","F","113","","LEIGHTON AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"

Values

('{D22473F5-3802-7B40-E053-6C04A8C0A630}','230000','2021-06-09 00:00','CO13 0PQ','D','N','F','4','','BELLAMY CLOSE','KIRBY CROSS','FRINTON-ON-SEA','TENDRING','ESSEX','A','A'),('{D22473F5-3803-7B40-E053-6C04A8C0A630}','700000','2021-06-25 00:00','IG10 4BS','T','N','F','70','','SMARTS LANE','','LOUGHTON','EPPING FOREST','ESSEX','A','A'),('{D22473F5-3804-7B40-E053-6C04A8C0A630}','625000','2021-06-28 00:00','EN9 1LH','S','N','F','7','','THE COBBINS','','WALTHAM ABBEY','EPPING FOREST','ESSEX','A','A'),('{D22473F5-3805-7B40-E053-6C04A8C0A630}','360000','2021-02-17 00:00','SS9 3AU','S','N','F','117','','FLEMMING AVENUE','','LEIGH-ON-SEA','SOUTHEND-ON-SEA','SOUTHEND-ON-SEA','A','A'),('{D22473F5-3806-7B40-E053-6C04A8C0A630}','345000','2021-06-25 00:00','SS15 6BG','S','N','F','2','','BROADWATER GREEN','LAINDON','BASILDON','BASILDON','ESSEX','A','A'),('{D22473F5-3807-7B40-E053-6C04A8C0A630}','220000','2021-08-20 00:00','CO7 0HE','S','N','F','133','','CHAPEL ROAD','BRIGHTLINGSEA','COLCHESTER','TENDRING','ESSEX','A','A'),('{D22473F5-3808-7B40-E053-6C04A8C0A630}','362000','2021-06-29 00:00','SS15 4AX','T','N','F','32','','CROUCH STREET','','BASILDON','BASILDON','ESSEX','A','A'),('{D22473F5-3809-7B40-E053-6C04A8C0A630}','300000','2021-06-25 00:00','CM9 6EP','T','N','F','58','','ORCHARD ROAD','','MALDON','MALDON','ESSEX','A','A'),('{D22473F5-380A-7B40-E053-6C04A8C0A630}','300000','2021-06-17 00:00','SS4 3AR','T','N','F','32','','ALLERTON CLOSE','','ROCHFORD','ROCHFORD','ESSEX','A','A'),('{D22473F5-380B-7B40-E053-6C04A8C0A630}','535000','2021-10-22 00:00','SS9 1PZ','T','N','F','113','','LEIGHTON AVENUE','','LEIGH-ON-SEA','SOUTHEND-ON-SEA','SOUTHEND-ON-SEA','A','A')

按携带更多信息

只携带字段名

TabSeparatedWithNames

yaml 复制代码 
uuid_string     price_string    time    postcode        a       b       c       addr1   addr2   street  locality        town    district        county  d       e
{D22473F5-3802-7B40-E053-6C04A8C0A630}  230000  2021-06-09 00:00        CO13 0PQ        D       N       F       4               BELLAMY CLOSE   KIRBY CROSS     FRINTON-ON-SEA  TENDRING        ESSEX   A       A
{D22473F5-3803-7B40-E053-6C04A8C0A630}  700000  2021-06-25 00:00        IG10 4BS        T       N       F       70              SMARTS LANE             LOUGHTON        EPPING FOREST   ESSEX   A       A
{D22473F5-3804-7B40-E053-6C04A8C0A630}  625000  2021-06-28 00:00        EN9 1LH S       N       F       7               THE COBBINS             WALTHAM ABBEY   EPPING FOREST   ESSEX   A       A
{D22473F5-3805-7B40-E053-6C04A8C0A630}  360000  2021-02-17 00:00        SS9 3AU S       N       F       117             FLEMMING AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A
{D22473F5-3806-7B40-E053-6C04A8C0A630}  345000  2021-06-25 00:00        SS15 6BG        S       N       F       2               BROADWATER GREEN        LAINDON BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3807-7B40-E053-6C04A8C0A630}  220000  2021-08-20 00:00        CO7 0HE S       N       F       133             CHAPEL ROAD     BRIGHTLINGSEA   COLCHESTER      TENDRING        ESSEX   A       A
{D22473F5-3808-7B40-E053-6C04A8C0A630}  362000  2021-06-29 00:00        SS15 4AX        T       N       F       32              CROUCH STREET           BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3809-7B40-E053-6C04A8C0A630}  300000  2021-06-25 00:00        CM9 6EP T       N       F       58              ORCHARD ROAD            MALDON  MALDON  ESSEX   A       A
{D22473F5-380A-7B40-E053-6C04A8C0A630}  300000  2021-06-17 00:00        SS4 3AR T       N       F       32              ALLERTON CLOSE          ROCHFORD        ROCHFORD        ESSEX   A       A
{D22473F5-380B-7B40-E053-6C04A8C0A630}  535000  2021-10-22 00:00        SS9 1PZ T       N       F       113             LEIGHTON AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A

CSVWithNames

yaml 复制代码 
"uuid_string","price_string","time","postcode","a","b","c","addr1","addr2","street","locality","town","district","county","d","e"
"{D22473F5-3802-7B40-E053-6C04A8C0A630}","230000","2021-06-09 00:00","CO13 0PQ","D","N","F","4","","BELLAMY CLOSE","KIRBY CROSS","FRINTON-ON-SEA","TENDRING","ESSEX","A","A"
"{D22473F5-3803-7B40-E053-6C04A8C0A630}","700000","2021-06-25 00:00","IG10 4BS","T","N","F","70","","SMARTS LANE","","LOUGHTON","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3804-7B40-E053-6C04A8C0A630}","625000","2021-06-28 00:00","EN9 1LH","S","N","F","7","","THE COBBINS","","WALTHAM ABBEY","EPPING FOREST","ESSEX","A","A"
"{D22473F5-3805-7B40-E053-6C04A8C0A630}","360000","2021-02-17 00:00","SS9 3AU","S","N","F","117","","FLEMMING AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"
"{D22473F5-3806-7B40-E053-6C04A8C0A630}","345000","2021-06-25 00:00","SS15 6BG","S","N","F","2","","BROADWATER GREEN","LAINDON","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3807-7B40-E053-6C04A8C0A630}","220000","2021-08-20 00:00","CO7 0HE","S","N","F","133","","CHAPEL ROAD","BRIGHTLINGSEA","COLCHESTER","TENDRING","ESSEX","A","A"
"{D22473F5-3808-7B40-E053-6C04A8C0A630}","362000","2021-06-29 00:00","SS15 4AX","T","N","F","32","","CROUCH STREET","","BASILDON","BASILDON","ESSEX","A","A"
"{D22473F5-3809-7B40-E053-6C04A8C0A630}","300000","2021-06-25 00:00","CM9 6EP","T","N","F","58","","ORCHARD ROAD","","MALDON","MALDON","ESSEX","A","A"
"{D22473F5-380A-7B40-E053-6C04A8C0A630}","300000","2021-06-17 00:00","SS4 3AR","T","N","F","32","","ALLERTON CLOSE","","ROCHFORD","ROCHFORD","ESSEX","A","A"
"{D22473F5-380B-7B40-E053-6C04A8C0A630}","535000","2021-10-22 00:00","SS9 1PZ","T","N","F","113","","LEIGHTON AVENUE","","LEIGH-ON-SEA","SOUTHEND-ON-SEA","SOUTHEND-ON-SEA","A","A"

携带字段名和类型

TabSeparatedWithNamesAndTypes

yaml 复制代码 
uuid_string     price_string    time    postcode        a       b       c       addr1   addr2   street  locality        town    district        county  d       e
String  String  String  String  String  String  String  String  String  String  String  String  String  String  String  String
{D22473F5-3802-7B40-E053-6C04A8C0A630}  230000  2021-06-09 00:00        CO13 0PQ        D       N       F       4               BELLAMY CLOSE   KIRBY CROSS     FRINTON-ON-SEA  TENDRING        ESSEX   A       A
{D22473F5-3803-7B40-E053-6C04A8C0A630}  700000  2021-06-25 00:00        IG10 4BS        T       N       F       70              SMARTS LANE             LOUGHTON        EPPING FOREST   ESSEX   A       A
{D22473F5-3804-7B40-E053-6C04A8C0A630}  625000  2021-06-28 00:00        EN9 1LH S       N       F       7               THE COBBINS             WALTHAM ABBEY   EPPING FOREST   ESSEX   A       A
{D22473F5-3805-7B40-E053-6C04A8C0A630}  360000  2021-02-17 00:00        SS9 3AU S       N       F       117             FLEMMING AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A
{D22473F5-3806-7B40-E053-6C04A8C0A630}  345000  2021-06-25 00:00        SS15 6BG        S       N       F       2               BROADWATER GREEN        LAINDON BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3807-7B40-E053-6C04A8C0A630}  220000  2021-08-20 00:00        CO7 0HE S       N       F       133             CHAPEL ROAD     BRIGHTLINGSEA   COLCHESTER      TENDRING        ESSEX   A       A
{D22473F5-3808-7B40-E053-6C04A8C0A630}  362000  2021-06-29 00:00        SS15 4AX        T       N       F       32              CROUCH STREET           BASILDON        BASILDON        ESSEX   A       A
{D22473F5-3809-7B40-E053-6C04A8C0A630}  300000  2021-06-25 00:00        CM9 6EP T       N       F       58              ORCHARD ROAD            MALDON  MALDON  ESSEX   A       A
{D22473F5-380A-7B40-E053-6C04A8C0A630}  300000  2021-06-17 00:00        SS4 3AR T       N       F       32              ALLERTON CLOSE          ROCHFORD        ROCHFORD        ESSEX   A       A
{D22473F5-380B-7B40-E053-6C04A8C0A630}  535000  2021-10-22 00:00        SS9 1PZ T       N       F       113             LEIGHTON AVENUE         LEIGH-ON-SEA    SOUTHEND-ON-SEA SOUTHEND-ON-SEA A       A

JSONCompactEachRowWithNamesAndTypes

yaml 复制代码 
["uuid_string", "price_string", "time", "postcode", "a", "b", "c", "addr1", "addr2", "street", "locality", "town", "district", "county", "d", "e"]
["String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String"]
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

JSONCompactStringsEachRowWithNamesAndTypes

yaml 复制代码 
["uuid_string", "price_string", "time", "postcode", "a", "b", "c", "addr1", "addr2", "street", "locality", "town", "district", "county", "d", "e"]
["String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String", "String"]
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3803-7B40-E053-6C04A8C0A630}", "700000", "2021-06-25 00:00", "IG10 4BS", "T", "N", "F", "70", "", "SMARTS LANE", "", "LOUGHTON", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3804-7B40-E053-6C04A8C0A630}", "625000", "2021-06-28 00:00", "EN9 1LH", "S", "N", "F", "7", "", "THE COBBINS", "", "WALTHAM ABBEY", "EPPING FOREST", "ESSEX", "A", "A"]
["{D22473F5-3805-7B40-E053-6C04A8C0A630}", "360000", "2021-02-17 00:00", "SS9 3AU", "S", "N", "F", "117", "", "FLEMMING AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]
["{D22473F5-3806-7B40-E053-6C04A8C0A630}", "345000", "2021-06-25 00:00", "SS15 6BG", "S", "N", "F", "2", "", "BROADWATER GREEN", "LAINDON", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3807-7B40-E053-6C04A8C0A630}", "220000", "2021-08-20 00:00", "CO7 0HE", "S", "N", "F", "133", "", "CHAPEL ROAD", "BRIGHTLINGSEA", "COLCHESTER", "TENDRING", "ESSEX", "A", "A"]
["{D22473F5-3808-7B40-E053-6C04A8C0A630}", "362000", "2021-06-29 00:00", "SS15 4AX", "T", "N", "F", "32", "", "CROUCH STREET", "", "BASILDON", "BASILDON", "ESSEX", "A", "A"]
["{D22473F5-3809-7B40-E053-6C04A8C0A630}", "300000", "2021-06-25 00:00", "CM9 6EP", "T", "N", "F", "58", "", "ORCHARD ROAD", "", "MALDON", "MALDON", "ESSEX", "A", "A"]
["{D22473F5-380A-7B40-E053-6C04A8C0A630}", "300000", "2021-06-17 00:00", "SS4 3AR", "T", "N", "F", "32", "", "ALLERTON CLOSE", "", "ROCHFORD", "ROCHFORD", "ESSEX", "A", "A"]
["{D22473F5-380B-7B40-E053-6C04A8C0A630}", "535000", "2021-10-22 00:00", "SS9 1PZ", "T", "N", "F", "113", "", "LEIGHTON AVENUE", "", "LEIGH-ON-SEA", "SOUTHEND-ON-SEA", "SOUTHEND-ON-SEA", "A", "A"]

TSKV

yaml 复制代码 
uuid_string={D22473F5-3802-7B40-E053-6C04A8C0A630}      price_string=230000     time=2021-06-09 00:00   postcode=CO13 0PQ       a=D     b=N     c=F     addr1=4 addr2=  street=BELLAMY CLOSE    locality=KIRBY CROSS    town=FRINTON-ON-SEA     district=TENDRING       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3803-7B40-E053-6C04A8C0A630}      price_string=700000     time=2021-06-25 00:00   postcode=IG10 4BS       a=T     b=N     c=F     addr1=70        addr2=  street=SMARTS LANE      locality=       town=LOUGHTON   district=EPPING FOREST  county=ESSEX    d=A     e=A
uuid_string={D22473F5-3804-7B40-E053-6C04A8C0A630}      price_string=625000     time=2021-06-28 00:00   postcode=EN9 1LH        a=S     b=N     c=F     addr1=7 addr2=  street=THE COBBINS      locality=       town=WALTHAM ABBEY      district=EPPING FOREST  county=ESSEX    d=A     e=A
uuid_string={D22473F5-3805-7B40-E053-6C04A8C0A630}      price_string=360000     time=2021-02-17 00:00   postcode=SS9 3AU        a=S     b=N     c=F     addr1=117       addr2=  street=FLEMMING AVENUE  locality=       town=LEIGH-ON-SEA       district=SOUTHEND-ON-SEA        county=SOUTHEND-ON-SEA  d=A     e=A
uuid_string={D22473F5-3806-7B40-E053-6C04A8C0A630}      price_string=345000     time=2021-06-25 00:00   postcode=SS15 6BG       a=S     b=N     c=F     addr1=2 addr2=  street=BROADWATER GREEN locality=LAINDON        town=BASILDON   district=BASILDON       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3807-7B40-E053-6C04A8C0A630}      price_string=220000     time=2021-08-20 00:00   postcode=CO7 0HE        a=S     b=N     c=F     addr1=133       addr2=  street=CHAPEL ROAD      locality=BRIGHTLINGSEA  town=COLCHESTER district=TENDRING       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3808-7B40-E053-6C04A8C0A630}      price_string=362000     time=2021-06-29 00:00   postcode=SS15 4AX       a=T     b=N     c=F     addr1=32        addr2=  street=CROUCH STREET    locality=       town=BASILDON   district=BASILDON       county=ESSEX    d=A     e=A
uuid_string={D22473F5-3809-7B40-E053-6C04A8C0A630}      price_string=300000     time=2021-06-25 00:00   postcode=CM9 6EP        a=T     b=N     c=F     addr1=58        addr2=  street=ORCHARD ROAD     locality=       town=MALDON     district=MALDON county=ESSEX    d=A     e=A
uuid_string={D22473F5-380A-7B40-E053-6C04A8C0A630}      price_string=300000     time=2021-06-17 00:00   postcode=SS4 3AR        a=T     b=N     c=F     addr1=32        addr2=  street=ALLERTON CLOSE   locality=       town=ROCHFORD   district=ROCHFORD       county=ESSEX    d=A     e=A
uuid_string={D22473F5-380B-7B40-E053-6C04A8C0A630}      price_string=535000     time=2021-10-22 00:00   postcode=SS9 1PZ        a=T     b=N     c=F     addr1=113       addr2=  street=LEIGHTON AVENUE  locality=       town=LEIGH-ON-SEA       district=SOUTHEND-ON-SEA        county=SOUTHEND-ON-SEA  d=A     e=A

RowBinaryWithNamesAndTypes

二进制格式，不支持文本查看。

不可读类型

Native

最高性能的格式 。通过二进制格式的块进行写入和读取（即它是基于块的，这和后面介绍的RowBinary系列不同）。它主要用于服务器间交互。

在《探索ClickHouse------使用Projection加速查询》一文中，原始数据是CSV格式，大小约4.6G。导入数据库后约308M。这个数据库的内容导出为Native格式的文件，大小只有约168M。

-rw-rw-r-- 1 fangliang fangliang 176572374 Sep 26 09:19 Native.txt

RowBinary

以二进制格式逐行格式化和解析数据。行和值连续列出，没有分隔符。 这种格式比 Native 格式效率低，因为它是基于行的。

导出这个类型的文件，大概和Native类型的差不多大小。

-rw-rw-r-- 1 fangliang fangliang 176568308 Sep 26 10:12 RowBinary.txt

RowBinaryWithNamesAndTypes

添加头部信息的RowBinary。

其他开源项目类型

Protobuf

Protobuf是一个 Protocol Buffers 格式。此格式需要外部格式描述文件(proto文件)。 该描述文件会进行缓存，以备后续查询。 ClickHouse支持 proto2 和 proto3 语法的proto文件，支持重复/可选/必填字段。

Avro

Apache Avro 是在Apache Hadoop项目中开发的面向行的数据序列化框架。

Parquet

Apache Parquet 是Hadoop生态系统中普遍使用的列式存储格式。

Arrow

Apache Arrow是一种用于内存数据库的格式，共有两种模式，文件与流模式。

ArrowStream

ArrowStream对应的是Arrow的流模式，这种格式适用于内存的流式处理。

ORC

Apache ORC 是Hadoop生态系统中普遍存在的列式存储格式。

其他

Compact和非Compact的区别

非Compact是一条完整符合规则的格式，Compact则是将值变成一个数组保存。以JSONCompactEachRowJSONEachRow为例

yaml 复制代码 
# JSONCompactEachRow
["{D22473F5-3802-7B40-E053-6C04A8C0A630}", "230000", "2021-06-09 00:00", "CO13 0PQ", "D", "N", "F", "4", "", "BELLAMY CLOSE", "KIRBY CROSS", "FRINTON-ON-SEA", "TENDRING", "ESSEX", "A", "A"]
yaml 复制代码 
# JSONEachRow
{"uuid_string":"{D22473F5-3802-7B40-E053-6C04A8C0A630}","price_string":"230000","time":"2021-06-09 00:00","postcode":"CO13 0PQ","a":"D","b":"N","c":"F","addr1":"4","addr2":"","street":"BELLAMY CLOSE","locality":"KIRBY CROSS","town":"FRINTON-ON-SEA","district":"TENDRING","county":"ESSEX","d":"A","e":"A"}

String和非String的区别

String会将JSON对象转变为一个字符串。以JSONStringsEachRow和JSONEachRow为例:

yaml 复制代码 
#  JSONCompactEachRow
[42,"hello",[1,"a"]]
yaml 复制代码 
# JSONCompactStringsEachRow
["42","hello","(2,'a')"]

导出命令

上述格式可以通过修改下面的命令导出，其中--format用于指定格式。

bash 复制代码 
clickhouse-client --query "SELECT * FROM file('pp-2021.csv', 'CSV', 'uuid_string String, price_string String, time String, postcode String, a String, b String, c String, addr1 String, addr2 String, street String, locality String, town String, district String, county String, d String, e String') LIMIT 10;" --format JSONCompactEachRow > JSONCompactEachRow.txt

查考资料

相关推荐
武子康5 天前
大数据-154 Apache Druid 架构与原理详解 基础架构、架构演进
java·大数据·clickhouse·hdfs·架构·flink·apache
武子康5 天前
大数据-152 Apache Druid 集群模式 配置启动【下篇】 超详细！
java·大数据·clickhouse·flink·apache
AAEllisonPang6 天前
ClickHouse 的 MergeTree 引擎有哪些性能优势？
大数据·数据库·clickhouse
SelectDB技术团队6 天前
快手：从 Clickhouse 到 Apache Doris，实现湖仓分离向湖仓一体架构升级
数据仓库·clickhouse·doris·快手·lakehouse
武子康6 天前
大数据-149 Apache Druid 基本介绍 技术特点 应用场景
大数据·hadoop·clickhouse·hdfs·架构·apache
武子康6 天前
大数据-155 Apache Druid 架构与原理详解 数据存储 索引服务 压缩机制
java·大数据·clickhouse·架构·flink·系统架构·apache
AAEllisonPang6 天前
ClickHouse 引擎的选择
大数据·数据库·clickhouse
云观秋毫6 天前
APO v0.5.0 发布：可视化配置告警规则；优化时间筛选器；支持自建的ClickHouse和VictoriaMetrics
运维·clickhouse
Biturd6 天前
docker-compose 快速部署clickhouse集群
clickhouse·docker·容器
武子康6 天前
大数据-156 Apache Druid 案例实战 Scala Kafka 订单统计
java·大数据·clickhouse·flink·kafka·scala·apache
热门推荐
01【经验分享】Ubuntu22.04安装微信(linux官方版)02安卓系列机型永久去除data分区加密 详细步骤解析032024年高教社杯数学建模国赛C题超详细解题思路分析04CTF网络安全大赛简单的web抓包题目：HEADache05组基轨迹建模 GBTM的介绍与实现（Stata 或 R）06【2024数模国赛赛题思路公开】国赛B题思路丨附可运行代码丨无偿自提07【极空间NAS】使用WebDAV服务 + DDNSTO内网穿透 实现思源笔记的内外网同步08苍穹外卖面试总结09【2024高教社杯全国大学生数学建模竞赛】B题 生产过程中的决策问题——解题思路 代码 论文10pve(Proxmox VE)安装i225v网卡驱动