ICode9

精准搜索请尝试: 精确搜索
首页 > 其他分享> 文章详细

datax模板

2020-07-27 16:33:51  阅读:574  来源: 互联网

标签:index 00 string 192.168 datax type 模板 name


DataX 是一个异构数据源离线同步工具,致力于实现包括关系型数据库(MySQL、Oracle等)、HDFS、Hive、ODPS、HBase、FTP等各种异构数据源之间稳定高效的数据同步功能。

1. mysql2mysql.json

{
  "job": {
    "setting": {
      "speed": {
        "channel": 1
      }
    },
    "content": [{
      "reader": {
        "name": "mysqlreader",
        "parameter": {
          "username": "userfoo",
          "password": "123456",
          "connection": [{
            "querySql": [
              "SELECT id, appid, openid, createDate, updateDate FROM tbfoo WHERE appid = 'wxbac1087630';"
            ],
            "jdbcUrl": [
              "jdbc:mysql://192.168.0.1:3306/dbfoo?characterEncoding=utf8"
            ]
          }]
        }
      },
      "writer": {
        "name": "mysqlwriter",
        "parameter": {
          "writeMode": "insert",
          "username": "userfoo",
          "password": "123456",
          "dateFormat": "YYYY-MM-dd hh:mm:ss",
          "column": [
            "id",
            "appid",
            "openid",
            "createDate",
            "updateDate"
          ],
          "session": [
            "set session sql_mode='ANSI'"
          ],
          "connection": [{
            "jdbcUrl": "jdbc:mysql://192.168.0.2:3306/dbfoo?characterEncoding=utf8",
            "table": [
              "tbfoo"
            ]
          }]
        }
      }
    }]
  }
}

2. mongo2mongo.json

{
    "job": {
        "setting": {
            "speed": {
                "channel": 1
            }
        },
        "content": [{
            "reader": {
                "name": "mongodbreader",
                "parameter": {
                    "address": ["192.168.0.1:27017"],
                    "query": "{logTime:{$gte:'2020-06-15 12:00:00',$lte:'2020-09-17 12:00:00'}}",
                    "userName": "",
                    "userPassword": "",
                    "dbName": "dbfoo",
                    "collectionName": "collfoo",
                    "column": [{
                        "index":0,
                        "name": "_id",
                        "type": "string"
                    }, {
                        "index":1,
                        "name": "mac",
                        "type": "string"
                    }, {
                        "index":2,
                        "name": "logTime",
                        "type": "string"
                    }]
                }
            },
             "writer": {
                    "name": "mongodbwriter", 
                    "parameter": {
                    "address": ["192.168.0.2:27017"],
                    "userName": "",
                    "userPassword": "",
                    "dbName": "dbfoo",
                    "collectionName": "collfoo",
                    "column": [{
                        "index":0,
                        "name": "_id",
                        "type": "string"
                    }, {
                        "index":1,
                        "name": "mac",
                        "type": "string"
                    }, {
                        "index":2,
                        "name": "logTime",
                        "type": "string"
                    }]
                }
             }
        }]
    }

}

 

标签:index,00,string,192.168,datax,type,模板,name
来源: https://www.cnblogs.com/v2ex/p/13386120.html

本站声明: 1. iCode9 技术分享网(下文简称本站)提供的所有内容,仅供技术学习、探讨和分享;
2. 关于本站的所有留言、评论、转载及引用,纯属内容发起人的个人观点,与本站观点和立场无关;
3. 关于本站的所有言论和文字,纯属内容发起人的个人观点,与本站观点和立场无关;
4. 本站文章均是网友提供,不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属;如您发现该文章侵犯了您的权益,可联系我们第一时间进行删除;
5. 本站为非盈利性的个人网站,所有内容不会用来进行牟利,也不会利用任何形式的广告来间接获益,纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。

专注分享技术,共同学习,共同进步。侵权联系[81616952@qq.com]

Copyright (C)ICode9.com, All Rights Reserved.

ICode9版权所有