backend/app/datax/log/2022-07-17/job_mysql2mysql_json-02_09_17.254.log

2022-07-17 02:09:17.546 [main] INFO  VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl
2022-07-17 02:09:17.564 [main] INFO  Engine - the machine info  => 

	osInfo:	Oracle Corporation 1.8 25.262-b10
	jvmInfo:	Linux amd64 3.10.0-957.el7.x86_64
	cpu num:	128

	totalPhysicalMemory:	-0.00G
	freePhysicalMemory:	-0.00G
	maxFileDescriptorCount:	-1
	currentOpenFileDescriptorCount:	-1

	GC Names	[PS MarkSweep, PS Scavenge]

	MEMORY_NAME                    | allocation_size                | init_size                      
	PS Eden Space                  | 256.00MB                       | 256.00MB                       
	Code Cache                     | 240.00MB                       | 2.44MB                         
	Compressed Class Space         | 1,024.00MB                     | 0.00MB                         
	PS Survivor Space              | 42.50MB                        | 42.50MB                        
	PS Old Gen                     | 683.00MB                       | 683.00MB                       
	Metaspace                      | -0.00MB                        | 0.00MB                         


2022-07-17 02:09:17.600 [main] INFO  Engine - 
{
	"content":[
		{
			"reader":{
				"name":"mysqlreader",
				"parameter":{
					"connection":[
						{
							"jdbcUrl":[
								"jdbc:mysql://192.168.2.2:3306/gene"
							],
							"querySql":[
								"select * from gene.test"
							]
						}
					],
					"password":"*********",
					"username":"root"
				}
			},
			"writer":{
				"name":"mysqlwriter",
				"parameter":{
					"column":[
						"*"
					],
					"connection":[
						{
							"jdbcUrl":"jdbc:mysql://192.168.2.2:3306/gene",
							"table":[
								"test"
							]
						}
					],
					"password":"**********",
					"session":[],
					"username":"root",
					"writeMode":"insert"
				}
			}
		}
	],
	"setting":{
		"speed":{
			"channel":"2"
		}
	}
}

2022-07-17 02:09:17.631 [main] WARN  Engine - prioriy set to 0, because NumberFormatException, the value is: null
2022-07-17 02:09:17.634 [main] INFO  PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0
2022-07-17 02:09:17.635 [main] INFO  JobContainer - DataX jobContainer starts job.
2022-07-17 02:09:17.638 [main] INFO  JobContainer - Set jobId = 0
2022-07-17 02:09:18.082 [job-0] INFO  OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true.
2022-07-17 02:09:18.443 [job-0] INFO  OriginalConfPretreatmentUtil - table:[test] all columns:[
GeneName
].
2022-07-17 02:09:18.444 [job-0] WARN  OriginalConfPretreatmentUtil - 您的配置文件中的列配置信息存在风险. 因为您配置的写入数据库表的列为*，当您的表字段个数、类型有变动时，可能影响任务正确性甚至会运行出错。请检查您的配置并作出修改.
2022-07-17 02:09:18.448 [job-0] INFO  OriginalConfPretreatmentUtil - Write data [
insert INTO %s (GeneName) VALUES(?)
], which jdbcUrl like:[jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true]
2022-07-17 02:09:18.451 [job-0] INFO  JobContainer - jobContainer starts to do prepare ...
2022-07-17 02:09:18.452 [job-0] INFO  JobContainer - DataX Reader.Job [mysqlreader] do prepare work .
2022-07-17 02:09:18.453 [job-0] INFO  JobContainer - DataX Writer.Job [mysqlwriter] do prepare work .
2022-07-17 02:09:18.455 [job-0] INFO  JobContainer - jobContainer starts to do split ...
2022-07-17 02:09:18.456 [job-0] INFO  JobContainer - Job set Channel-Number to 2 channels.
2022-07-17 02:09:18.461 [job-0] INFO  JobContainer - DataX Reader.Job [mysqlreader] splits to [1] tasks.
2022-07-17 02:09:18.463 [job-0] INFO  JobContainer - DataX Writer.Job [mysqlwriter] splits to [1] tasks.
2022-07-17 02:09:18.506 [job-0] INFO  JobContainer - jobContainer starts to do schedule ...
2022-07-17 02:09:18.513 [job-0] INFO  JobContainer - Scheduler starts [1] taskGroups.
2022-07-17 02:09:18.517 [job-0] INFO  JobContainer - Running by standalone Mode.
2022-07-17 02:09:18.529 [taskGroup-0] INFO  TaskGroupContainer - taskGroupId=[0] start [1] channels for [1] tasks.
2022-07-17 02:09:18.539 [taskGroup-0] INFO  Channel - Channel set byte_speed_limit to -1, No bps activated.
2022-07-17 02:09:18.539 [taskGroup-0] INFO  Channel - Channel set record_speed_limit to -1, No tps activated.
2022-07-17 02:09:18.555 [taskGroup-0] INFO  TaskGroupContainer - taskGroup[0] taskId[0] attemptCount[1] is started
2022-07-17 02:09:18.561 [0-0-0-reader] INFO  CommonRdbmsReader$Task - Begin to read record by Sql: [select * from gene.test
] jdbcUrl:[jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
2022-07-17 02:09:18.586 [0-0-0-reader] INFO  CommonRdbmsReader$Task - Finished read record by Sql: [select * from gene.test
] jdbcUrl:[jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
2022-07-17 02:09:18.811 [0-0-0-writer] WARN  CommonRdbmsWriter$Task - 回滚此次写入, 采用每次写入一行方式提交. 因为:#23000
2022-07-17 02:09:18.818 [0-0-0-writer] ERROR StdoutPluginCollector - 
com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: #23000
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_262]
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[na:1.8.0_262]
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_262]
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_262]
	at com.mysql.jdbc.Util.handleNewInstance(Util.java:377) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.mysql.jdbc.Util.getInstance(Util.java:360) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:971) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3887) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3823) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2435) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2582) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2530) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1907) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.mysql.jdbc.PreparedStatement.execute(PreparedStatement.java:1199) ~[mysql-connector-java-5.1.34.jar:5.1.34]
	at com.alibaba.datax.plugin.rdbms.writer.CommonRdbmsWriter$Task.doOneInsert(CommonRdbmsWriter.java:382) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
	at com.alibaba.datax.plugin.rdbms.writer.CommonRdbmsWriter$Task.doBatchInsert(CommonRdbmsWriter.java:362) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
	at com.alibaba.datax.plugin.rdbms.writer.CommonRdbmsWriter$Task.startWriteWithConnection(CommonRdbmsWriter.java:297) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
	at com.alibaba.datax.plugin.rdbms.writer.CommonRdbmsWriter$Task.startWrite(CommonRdbmsWriter.java:319) [plugin-rdbms-util-0.0.1-SNAPSHOT.jar:na]
	at com.alibaba.datax.plugin.writer.mysqlwriter.MysqlWriter$Task.startWrite(MysqlWriter.java:78) [mysqlwriter-0.0.1-SNAPSHOT.jar:na]
	at com.alibaba.datax.core.taskgroup.runner.WriterRunner.run(WriterRunner.java:56) [datax-core-0.0.1-SNAPSHOT.jar:na]
	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_262]
2022-07-17 02:09:18.824 [0-0-0-writer] ERROR StdoutPluginCollector - 脏数据: 
{"exception":"#23000","record":[{"byteSize":5,"index":0,"rawData":"FEB10","type":"STRING"}],"type":"writer"}
2022-07-17 02:09:18.826 [0-0-0-writer] ERROR StdoutPluginCollector - 脏数据: 
{"exception":"#23000","record":[{"byteSize":5,"index":0,"rawData":"Feb11","type":"STRING"}],"type":"writer"}
2022-07-17 02:09:18.829 [0-0-0-writer] ERROR StdoutPluginCollector - 脏数据: 
{"exception":"#23000","record":[{"byteSize":4,"index":0,"rawData":"FEB9","type":"STRING"}],"type":"writer"}
2022-07-17 02:09:18.856 [taskGroup-0] INFO  TaskGroupContainer - taskGroup[0] taskId[0] is successed, used[303]ms
2022-07-17 02:09:18.857 [taskGroup-0] INFO  TaskGroupContainer - taskGroup[0] completed it's tasks.
2022-07-17 02:09:28.549 [job-0] INFO  StandAloneJobContainerCommunicator - Total 3 records, 14 bytes | Speed 1B/s, 0 records/s | Error 3 records, 14 bytes |  All Task WaitWriterTime 0.000s |  All Task WaitReaderTime 0.000s | Percentage 100.00%
2022-07-17 02:09:28.549 [job-0] INFO  AbstractScheduler - Scheduler accomplished all tasks.
2022-07-17 02:09:28.550 [job-0] INFO  JobContainer - DataX Writer.Job [mysqlwriter] do post work.
2022-07-17 02:09:28.551 [job-0] INFO  JobContainer - DataX Reader.Job [mysqlreader] do post work.
2022-07-17 02:09:28.551 [job-0] INFO  JobContainer - DataX jobId [0] completed successfully.
2022-07-17 02:09:28.552 [job-0] INFO  HookInvoker - No hook invoked, because base dir not exists or is a file: /root/yili-datax/datax/hook
2022-07-17 02:09:28.555 [job-0] INFO  JobContainer - 
	 [total cpu info] => 
		averageCpu                     | maxDeltaCpu                    | minDeltaCpu                    
		-1.00%                         | -1.00%                         | -1.00%
                        

	 [total gc info] => 
		 NAME                 | totalGCCount       | maxDeltaGCCount    | minDeltaGCCount    | totalGCTime        | maxDeltaGCTime     | minDeltaGCTime     
		 PS MarkSweep         | 0                  | 0                  | 0                  | 0.000s             | 0.000s             | 0.000s             
		 PS Scavenge          | 0                  | 0                  | 0                  | 0.000s             | 0.000s             | 0.000s             

2022-07-17 02:09:28.556 [job-0] INFO  JobContainer - PerfTrace not enable!
2022-07-17 02:09:28.557 [job-0] INFO  StandAloneJobContainerCommunicator - Total 3 records, 14 bytes | Speed 1B/s, 0 records/s | Error 3 records, 14 bytes |  All Task WaitWriterTime 0.000s |  All Task WaitReaderTime 0.000s | Percentage 100.00%
2022-07-17 02:09:28.559 [job-0] INFO  JobContainer - 
任务启动时刻                    : 2022-07-17 02:09:17
任务结束时刻                    : 2022-07-17 02:09:28
任务总计耗时                    :                 10s
任务平均流量                    :                1B/s
记录写入速度                    :              0rec/s
读出记录总数                    :                   3
读写失败总数                    :                   3