dataX从orcal数据库抽取数据插入gbase 8a数据库 与 OceanBase数据库

一:dataX从orcal数据库抽取数据插入gbase 8a数据库配置:

复制代码
{
  "job": {
    "setting": {
      "speed": {
        "channel": 4
      },
      "errorLimit": {
        "percentage": 0
      }
    },
    "content": [
      {
        "reader": {
          "name": "oraclereader",
          "parameter": {
            "username": "ddd",
            "password": "123456",
            "column": [
              "*"
            ],
            "connection": [
              {
                "table": [
                  "${STABLE}"
                ],
                "jdbcUrl": [
                  "jdbc:oracle:thin:@1.4.1.7:1521/aaa"
                ],
                "where":"${SSUM} = ${SDATE}"
              }
            ]
          }
        },
        "writer": {
          "name": "rdbmswriter",
          "parameter": {
            "batchSize": 5000,
            "memstoreThreshold": "90",
            "username": "nnn",
            "password": "fdfsdfs",
            "column": [
              "*"
            ],
            "preSql": [
              "delete from ${STABLE} where ${SSUM} = ${SDATE}"
            ],
            "connection": [
              {
                "table": [
                  "${TTABLE}"
                ],
                "jdbcUrl": "jdbc:gbase://16.16.16.4:5258/gb_ku?rewriteBatchedStatements=true"
              }
            ]
          }
        }
      }
    ]
  }
}

二:dataX从orcal数据库抽取数据插入OceanBase数据库配置:

复制代码
{
  "job": {
    "setting": {
      "speed": {
        "channel": 4
      },
      "errorLimit": {
        "percentage": 0
      }
    },
    "content": [
      {
        "reader": {
          "name": "oraclereader",
          "parameter": {
            "username": "yy",
            "password": "yy#yy",
            "column": [
              "*"
            ],
            "connection": [
              {
                "querySql": [
                  "select * from ${STABLE} where ${SSUM} > ${SDATE} "
                ],
                "jdbcUrl": [
                  "jdbc:oracle:thin:@14.64.12.14:1521/fgh"
                ]
              }
            ]
          }
        },
        "writer": {
          "name": "oceanbasev10writer",
          "parameter": {
            "writeMode": "insert",
            "batchSize": 5000,
            "memstoreThreshold": "90",
            "username": "show",
            "password": "fgfg",
            "column": [
              "*"
            ],
            "preSql": [
              "delete from ${STABLE} where ${SSUM} > ${SDATE}"
            ],
            "connection": [
              {
                "table": [
                  "${STABLE}"
                ],
                "jdbcUrl": "jdbc:oceanbase://14.54.161.3:9056/hhh"
              }
            ]
          }
        }
      }
    ]
  }
}
相关推荐
qq_192779874 分钟前
高级爬虫技巧:处理JavaScript渲染(Selenium)
jvm·数据库·python
u01092727122 分钟前
使用Plotly创建交互式图表
jvm·数据库·python
爱学习的阿磊23 分钟前
Python GUI开发:Tkinter入门教程
jvm·数据库·python
tudficdew1 小时前
实战:用Python分析某电商销售数据
jvm·数据库·python
sjjhd6521 小时前
Python日志记录(Logging)最佳实践
jvm·数据库·python
Configure-Handler2 小时前
buildroot System configuration
java·服务器·数据库
2301_821369612 小时前
用Python生成艺术:分形与算法绘图
jvm·数据库·python
电商API_180079052473 小时前
第三方淘宝商品详情 API 全维度调用指南:从技术对接到生产落地
java·大数据·前端·数据库·人工智能·网络爬虫
2401_832131953 小时前
Python单元测试(unittest)实战指南
jvm·数据库·python
打工的小王4 小时前
redis(四)搭建哨兵模式:一主二从三哨兵
数据库·redis·缓存