2022-07-17 02:12:58.714 [main] INFO VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl 2022-07-17 02:12:58.724 [main] INFO Engine - the machine info => osInfo: Oracle Corporation 1.8 25.262-b10 jvmInfo: Linux amd64 3.10.0-957.el7.x86_64 cpu num: 128 totalPhysicalMemory: -0.00G freePhysicalMemory: -0.00G maxFileDescriptorCount: -1 currentOpenFileDescriptorCount: -1 GC Names [PS MarkSweep, PS Scavenge] MEMORY_NAME | allocation_size | init_size PS Eden Space | 256.00MB | 256.00MB Code Cache | 240.00MB | 2.44MB Compressed Class Space | 1,024.00MB | 0.00MB PS Survivor Space | 42.50MB | 42.50MB PS Old Gen | 683.00MB | 683.00MB Metaspace | -0.00MB | 0.00MB 2022-07-17 02:12:58.745 [main] INFO Engine - { "content":[ { "reader":{ "name":"mysqlreader", "parameter":{ "connection":[ { "jdbcUrl":[ "jdbc:mysql://192.168.2.2:3306/gene" ], "querySql":[ "select * from gene.test" ] } ], "password":"*********", "username":"root" } }, "writer":{ "name":"mysqlwriter", "parameter":{ "column":[ "*" ], "connection":[ { "jdbcUrl":"jdbc:mysql://192.168.2.2:3306/gene", "table":[ "test" ] } ], "password":"**********", "session":[], "username":"root", "writeMode":"insert" } } } ], "setting":{ "speed":{ "channel":"2" } } } 2022-07-17 02:12:58.767 [main] WARN Engine - prioriy set to 0, because NumberFormatException, the value is: null 2022-07-17 02:12:58.769 [main] INFO PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0 2022-07-17 02:12:58.769 [main] INFO JobContainer - DataX jobContainer starts job. 2022-07-17 02:12:58.772 [main] INFO JobContainer - Set jobId = 0 2022-07-17 02:12:59.194 [job-0] INFO OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true. 2022-07-17 02:12:59.497 [job-0] INFO OriginalConfPretreatmentUtil - table:[test] all columns:[ GeneName ]. 2022-07-17 02:12:59.498 [job-0] WARN OriginalConfPretreatmentUtil - 您的配置文件中的列配置信息存在风险. 因为您配置的写入数据库表的列为*，当您的表字段个数、类型有变动时，可能影响任务正确性甚至会运行出错。请检查您的配置并作出修改. 2022-07-17 02:12:59.499 [job-0] INFO OriginalConfPretreatmentUtil - Write data [ insert INTO %s (GeneName) VALUES(?) ], which jdbcUrl like:[jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true] 2022-07-17 02:12:59.500 [job-0] INFO JobContainer - jobContainer starts to do prepare ... 2022-07-17 02:12:59.501 [job-0] INFO JobContainer - DataX Reader.Job [mysqlreader] do prepare work . 2022-07-17 02:12:59.502 [job-0] INFO JobContainer - DataX Writer.Job [mysqlwriter] do prepare work . 2022-07-17 02:12:59.503 [job-0] INFO JobContainer - jobContainer starts to do split ... 2022-07-17 02:12:59.503 [job-0] INFO JobContainer - Job set Channel-Number to 2 channels. 2022-07-17 02:12:59.506 [job-0] INFO JobContainer - DataX Reader.Job [mysqlreader] splits to [1] tasks. 2022-07-17 02:12:59.507 [job-0] INFO JobContainer - DataX Writer.Job [mysqlwriter] splits to [1] tasks. 2022-07-17 02:12:59.528 [job-0] INFO JobContainer - jobContainer starts to do schedule ... 2022-07-17 02:12:59.534 [job-0] INFO JobContainer - Scheduler starts [1] taskGroups. 2022-07-17 02:12:59.536 [job-0] INFO JobContainer - Running by standalone Mode. 2022-07-17 02:12:59.545 [taskGroup-0] INFO TaskGroupContainer - taskGroupId=[0] start [1] channels for [1] tasks. 2022-07-17 02:12:59.557 [taskGroup-0] INFO Channel - Channel set byte_speed_limit to -1, No bps activated. 2022-07-17 02:12:59.557 [taskGroup-0] INFO Channel - Channel set record_speed_limit to -1, No tps activated. 2022-07-17 02:12:59.574 [taskGroup-0] INFO TaskGroupContainer - taskGroup[0] taskId[0] attemptCount[1] is started 2022-07-17 02:12:59.582 [0-0-0-reader] INFO CommonRdbmsReader$Task - Begin to read record by Sql: [select * from gene.test ] jdbcUrl:[jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true]. 2022-07-17 02:12:59.615 [0-0-0-reader] INFO CommonRdbmsReader$Task - Finished read record by Sql: [select * from gene.test ] jdbcUrl:[jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true]. 2022-07-17 02:12:59.852 [0-0-0-writer] WARN CommonRdbmsWriter$Task - 回滚此次写入, 采用每次写入一行方式提交. 因为:#23000 2022-07-17 02:12:59.861 [0-0-0-writer] ERROR StdoutPluginCollector - com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: #23000 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_262] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[na:1.8.0_262] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_262] at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_262] at com.mysql.jdbc.Util.handleNewInstance(Util.java:377) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.mysql.jdbc.Util.getInstance(Util.java:360) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:971) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3887) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3823) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2435) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2582) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2530) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1907) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.mysql.jdbc.PreparedStatement.execute(PreparedStatement.java:1199) ~[mysql-connector-java-5.1.34.jar:5.1.34] at com.alibaba.datax.plugin.rdbms.writer.CommonRdbmsWriter$Task.doOneInsert(CommonRdbmsWriter.java:382) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.plugin.rdbms.writer.CommonRdbmsWriter$Task.doBatchInsert(CommonRdbmsWriter.java:362) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.plugin.rdbms.writer.CommonRdbmsWriter$Task.startWriteWithConnection(CommonRdbmsWriter.java:297) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.plugin.rdbms.writer.CommonRdbmsWriter$Task.startWrite(CommonRdbmsWriter.java:319) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.plugin.writer.mysqlwriter.MysqlWriter$Task.startWrite(MysqlWriter.java:78) [mysqlwriter-0.0.1-SNAPSHOT.jar:na] at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56) [datax-core-0.0.1-SNAPSHOT.jar:na] at java.lang.Thread.run(Thread.java:748) [na:1.8.0_262] 2022-07-17 02:12:59.868 [0-0-0-writer] ERROR StdoutPluginCollector - 脏数据: {"exception":"#23000","record":[{"byteSize":5,"index":0,"rawData":"FEB10","type":"STRING"}],"type":"writer"} 2022-07-17 02:12:59.870 [0-0-0-writer] ERROR StdoutPluginCollector - 脏数据: {"exception":"#23000","record":[{"byteSize":5,"index":0,"rawData":"Feb11","type":"STRING"}],"type":"writer"} 2022-07-17 02:12:59.872 [0-0-0-writer] ERROR StdoutPluginCollector - 脏数据: {"exception":"#23000","record":[{"byteSize":4,"index":0,"rawData":"FEB9","type":"STRING"}],"type":"writer"} 2022-07-17 02:12:59.876 [taskGroup-0] INFO TaskGroupContainer - taskGroup[0] taskId[0] is successed, used[304]ms 2022-07-17 02:12:59.877 [taskGroup-0] INFO TaskGroupContainer - taskGroup[0] completed it's tasks. 2022-07-17 02:13:09.558 [job-0] INFO StandAloneJobContainerCommunicator - Total 3 records, 14 bytes | Speed 1B/s, 0 records/s | Error 3 records, 14 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 100.00% 2022-07-17 02:13:09.558 [job-0] INFO AbstractScheduler - Scheduler accomplished all tasks. 2022-07-17 02:13:09.559 [job-0] INFO JobContainer - DataX Writer.Job [mysqlwriter] do post work. 2022-07-17 02:13:09.560 [job-0] INFO JobContainer - DataX Reader.Job [mysqlreader] do post work. 2022-07-17 02:13:09.560 [job-0] INFO JobContainer - DataX jobId [0] completed successfully. 2022-07-17 02:13:09.561 [job-0] INFO HookInvoker - No hook invoked, because base dir not exists or is a file: /root/yili-datax/datax/hook 2022-07-17 02:13:09.564 [job-0] INFO JobContainer - [total cpu info] => averageCpu | maxDeltaCpu | minDeltaCpu -1.00% | -1.00% | -1.00% [total gc info] => NAME | totalGCCount | maxDeltaGCCount | minDeltaGCCount | totalGCTime | maxDeltaGCTime | minDeltaGCTime PS MarkSweep | 0 | 0 | 0 | 0.000s | 0.000s | 0.000s PS Scavenge | 0 | 0 | 0 | 0.000s | 0.000s | 0.000s 2022-07-17 02:13:09.565 [job-0] INFO JobContainer - PerfTrace not enable! 2022-07-17 02:13:09.566 [job-0] INFO StandAloneJobContainerCommunicator - Total 3 records, 14 bytes | Speed 1B/s, 0 records/s | Error 3 records, 14 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 100.00% 2022-07-17 02:13:09.567 [job-0] INFO JobContainer - 任务启动时刻 : 2022-07-17 02:12:58 任务结束时刻 : 2022-07-17 02:13:09 任务总计耗时 : 10s 任务平均流量 : 1B/s 记录写入速度 : 0rec/s 读出记录总数 : 3 读写失败总数 : 3