dataX从orcal数据库抽取数据插入gbase 8a数据库 与 OceanBase数据库

一:dataX从orcal数据库抽取数据插入gbase 8a数据库配置:

复制代码
{
  "job": {
    "setting": {
      "speed": {
        "channel": 4
      },
      "errorLimit": {
        "percentage": 0
      }
    },
    "content": [
      {
        "reader": {
          "name": "oraclereader",
          "parameter": {
            "username": "ddd",
            "password": "123456",
            "column": [
              "*"
            ],
            "connection": [
              {
                "table": [
                  "${STABLE}"
                ],
                "jdbcUrl": [
                  "jdbc:oracle:thin:@1.4.1.7:1521/aaa"
                ],
                "where":"${SSUM} = ${SDATE}"
              }
            ]
          }
        },
        "writer": {
          "name": "rdbmswriter",
          "parameter": {
            "batchSize": 5000,
            "memstoreThreshold": "90",
            "username": "nnn",
            "password": "fdfsdfs",
            "column": [
              "*"
            ],
            "preSql": [
              "delete from ${STABLE} where ${SSUM} = ${SDATE}"
            ],
            "connection": [
              {
                "table": [
                  "${TTABLE}"
                ],
                "jdbcUrl": "jdbc:gbase://16.16.16.4:5258/gb_ku?rewriteBatchedStatements=true"
              }
            ]
          }
        }
      }
    ]
  }
}

二:dataX从orcal数据库抽取数据插入OceanBase数据库配置:

复制代码
{
  "job": {
    "setting": {
      "speed": {
        "channel": 4
      },
      "errorLimit": {
        "percentage": 0
      }
    },
    "content": [
      {
        "reader": {
          "name": "oraclereader",
          "parameter": {
            "username": "yy",
            "password": "yy#yy",
            "column": [
              "*"
            ],
            "connection": [
              {
                "querySql": [
                  "select * from ${STABLE} where ${SSUM} > ${SDATE} "
                ],
                "jdbcUrl": [
                  "jdbc:oracle:thin:@14.64.12.14:1521/fgh"
                ]
              }
            ]
          }
        },
        "writer": {
          "name": "oceanbasev10writer",
          "parameter": {
            "writeMode": "insert",
            "batchSize": 5000,
            "memstoreThreshold": "90",
            "username": "show",
            "password": "fgfg",
            "column": [
              "*"
            ],
            "preSql": [
              "delete from ${STABLE} where ${SSUM} > ${SDATE}"
            ],
            "connection": [
              {
                "table": [
                  "${STABLE}"
                ],
                "jdbcUrl": "jdbc:oceanbase://14.54.161.3:9056/hhh"
              }
            ]
          }
        }
      }
    ]
  }
}
相关推荐
lunz_fly199215 小时前
Oracle清理:如何安全删除trace, alert和archivelog文件?
oracle
薛定谔的算法16 小时前
phoneGPT:构建专业领域的检索增强型智能问答系统
前端·数据库·后端
Databend17 小时前
Databend 亮相 RustChinaConf 2025,分享基于 Rust 构建商业化数仓平台的探索
数据库
得物技术18 小时前
破解gh-ost变更导致MySQL表膨胀之谜|得物技术
数据库·后端·mysql
Raymond运维1 天前
MariaDB源码编译安装(二)
运维·数据库·mariadb
沢田纲吉1 天前
🗄️ MySQL 表操作全面指南
数据库·后端·mysql
RestCloud2 天前
SQL Server到Hive:批处理ETL性能提升30%的实战经验
数据库·api
RestCloud2 天前
为什么说零代码 ETL 是未来趋势?
数据库·api
ClouGence2 天前
CloudCanal + Paimon + SelectDB 从 0 到 1 构建实时湖仓
数据库
DemonAvenger2 天前
NoSQL与MySQL混合架构设计:从入门到实战的最佳实践
数据库·mysql·性能优化