dataX从orcal数据库抽取数据插入gbase 8a数据库 与 OceanBase数据库

一:dataX从orcal数据库抽取数据插入gbase 8a数据库配置:

复制代码
{
  "job": {
    "setting": {
      "speed": {
        "channel": 4
      },
      "errorLimit": {
        "percentage": 0
      }
    },
    "content": [
      {
        "reader": {
          "name": "oraclereader",
          "parameter": {
            "username": "ddd",
            "password": "123456",
            "column": [
              "*"
            ],
            "connection": [
              {
                "table": [
                  "${STABLE}"
                ],
                "jdbcUrl": [
                  "jdbc:oracle:thin:@1.4.1.7:1521/aaa"
                ],
                "where":"${SSUM} = ${SDATE}"
              }
            ]
          }
        },
        "writer": {
          "name": "rdbmswriter",
          "parameter": {
            "batchSize": 5000,
            "memstoreThreshold": "90",
            "username": "nnn",
            "password": "fdfsdfs",
            "column": [
              "*"
            ],
            "preSql": [
              "delete from ${STABLE} where ${SSUM} = ${SDATE}"
            ],
            "connection": [
              {
                "table": [
                  "${TTABLE}"
                ],
                "jdbcUrl": "jdbc:gbase://16.16.16.4:5258/gb_ku?rewriteBatchedStatements=true"
              }
            ]
          }
        }
      }
    ]
  }
}

二:dataX从orcal数据库抽取数据插入OceanBase数据库配置:

复制代码
{
  "job": {
    "setting": {
      "speed": {
        "channel": 4
      },
      "errorLimit": {
        "percentage": 0
      }
    },
    "content": [
      {
        "reader": {
          "name": "oraclereader",
          "parameter": {
            "username": "yy",
            "password": "yy#yy",
            "column": [
              "*"
            ],
            "connection": [
              {
                "querySql": [
                  "select * from ${STABLE} where ${SSUM} > ${SDATE} "
                ],
                "jdbcUrl": [
                  "jdbc:oracle:thin:@14.64.12.14:1521/fgh"
                ]
              }
            ]
          }
        },
        "writer": {
          "name": "oceanbasev10writer",
          "parameter": {
            "writeMode": "insert",
            "batchSize": 5000,
            "memstoreThreshold": "90",
            "username": "show",
            "password": "fgfg",
            "column": [
              "*"
            ],
            "preSql": [
              "delete from ${STABLE} where ${SSUM} > ${SDATE}"
            ],
            "connection": [
              {
                "table": [
                  "${STABLE}"
                ],
                "jdbcUrl": "jdbc:oceanbase://14.54.161.3:9056/hhh"
              }
            ]
          }
        }
      }
    ]
  }
}
相关推荐
万事大吉CC38 分钟前
【3】深入剖析 Django 之 MTV:路径引用与资源加载机制
数据库·django·sqlite
Hical_W43 分钟前
用 Hical + MySQL 5 分钟搭建 CRUD API(C++20 协程版)
数据库·mysql·c++20
AIMath~1 小时前
agent上下文和模型的上下文区别
数据库
与遨游于天地1 小时前
分布式锁从Redis到Redisson的演进
数据库·redis·分布式
山峰哥2 小时前
SQL性能提升20倍的秘密:这些优化技巧让DBA都惊叹
开发语言·数据库·sql·编辑器·深度优先·宽度优先
HuDie3402 小时前
prompt模版
数据库·prompt
梦想画家2 小时前
PostgreSQL 图计算双雄:Apache AGE 与 pgGraphBLAS 的融合实战指南
数据库·postgresql·图算法
逻辑驱动的ken3 小时前
Java高频面试考点场景题23
java·开发语言·数据库·面试·职场和发展·哈希算法
Francek Chen4 小时前
【大数据存储与管理】实验3:熟悉常用的HBase操作
大数据·数据库·分布式·hbase