| 123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135 |
- 2022-08-07 10:49:46.636 [main] INFO VMInfo - VMInfo# operatingSystem class => com.sun.management.internal.OperatingSystemImpl
- 2022-08-07 10:49:46.641 [main] INFO Engine - the machine info =>
- osInfo: Ubuntu 11 11.0.16+8-post-Ubuntu-0ubuntu120.04
- jvmInfo: Linux amd64 5.13.0-52-generic
- cpu num: 8
- totalPhysicalMemory: -0.00G
- freePhysicalMemory: -0.00G
- maxFileDescriptorCount: -1
- currentOpenFileDescriptorCount: -1
- GC Names [G1 Young Generation, G1 Old Generation]
- MEMORY_NAME | allocation_size | init_size
- CodeHeap 'profiled nmethods' | 117.21MB | 2.44MB
- G1 Old Gen | 1,024.00MB | 970.00MB
- G1 Survivor Space | -0.00MB | 0.00MB
- CodeHeap 'non-profiled nmethods' | 117.22MB | 2.44MB
- Compressed Class Space | 1,024.00MB | 0.00MB
- Metaspace | -0.00MB | 0.00MB
- G1 Eden Space | -0.00MB | 54.00MB
- CodeHeap 'non-nmethods' | 5.57MB | 2.44MB
- 2022-08-07 10:49:46.653 [main] INFO Engine -
- {
- "content":[
- {
- "reader":{
- "name":"mysqlreader",
- "parameter":{
- "connection":[
- {
- "jdbcUrl":[
- "jdbc:mysql://192.168.2.2:3306/gene"
- ],
- "querySql":[
- "select * from gene.test"
- ]
- }
- ],
- "password":"*********",
- "username":"root"
- }
- },
- "writer":{
- "name":"mysqlwriter",
- "parameter":{
- "column":[
- "*"
- ],
- "connection":[
- {
- "jdbcUrl":"jdbc:mysql://192.168.2.2:3306/gene",
- "table":[
- "xxx"
- ]
- }
- ],
- "password":"**********",
- "session":[],
- "username":"root",
- "writeMode":"insert"
- }
- }
- }
- ],
- "setting":{
- "speed":{
- "channel":"2"
- }
- }
- }
- 2022-08-07 10:49:46.664 [main] WARN Engine - prioriy set to 0, because NumberFormatException, the value is: null
- 2022-08-07 10:49:46.666 [main] INFO PerfTrace - PerfTrace traceId=job_-1, isEnable=false, priority=0
- 2022-08-07 10:49:46.666 [main] INFO JobContainer - DataX jobContainer starts job.
- 2022-08-07 10:49:46.668 [main] INFO JobContainer - Set jobId = 0
- 2022-08-07 10:49:46.885 [job-0] INFO OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true.
- 2022-08-07 10:49:47.014 [job-0] INFO OriginalConfPretreatmentUtil - table:[xxx] all columns:[
- GeneName
- ].
- 2022-08-07 10:49:47.015 [job-0] WARN OriginalConfPretreatmentUtil - 您的配置文件中的列配置信息存在风险. 因为您配置的写入数据库表的列为*，当您的表字段个数、类型有变动时，可能影响任务正确性甚至会运行出错。请检查您的配置并作出修改.
- 2022-08-07 10:49:47.015 [job-0] INFO OriginalConfPretreatmentUtil - Write data [
- insert INTO %s (GeneName) VALUES(?)
- ], which jdbcUrl like:[jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true]
- 2022-08-07 10:49:47.016 [job-0] INFO JobContainer - jobContainer starts to do prepare ...
- 2022-08-07 10:49:47.016 [job-0] INFO JobContainer - DataX Reader.Job [mysqlreader] do prepare work .
- 2022-08-07 10:49:47.016 [job-0] INFO JobContainer - DataX Writer.Job [mysqlwriter] do prepare work .
- 2022-08-07 10:49:47.016 [job-0] INFO JobContainer - jobContainer starts to do split ...
- 2022-08-07 10:49:47.017 [job-0] INFO JobContainer - Job set Channel-Number to 2 channels.
- 2022-08-07 10:49:47.019 [job-0] INFO JobContainer - DataX Reader.Job [mysqlreader] splits to [1] tasks.
- 2022-08-07 10:49:47.019 [job-0] INFO JobContainer - DataX Writer.Job [mysqlwriter] splits to [1] tasks.
- 2022-08-07 10:49:47.029 [job-0] INFO JobContainer - jobContainer starts to do schedule ...
- 2022-08-07 10:49:47.031 [job-0] INFO JobContainer - Scheduler starts [1] taskGroups.
- 2022-08-07 10:49:47.032 [job-0] INFO JobContainer - Running by standalone Mode.
- 2022-08-07 10:49:47.036 [taskGroup-0] INFO TaskGroupContainer - taskGroupId=[0] start [1] channels for [1] tasks.
- 2022-08-07 10:49:47.043 [taskGroup-0] INFO Channel - Channel set byte_speed_limit to -1, No bps activated.
- 2022-08-07 10:49:47.043 [taskGroup-0] INFO Channel - Channel set record_speed_limit to -1, No tps activated.
- 2022-08-07 10:49:47.050 [taskGroup-0] INFO TaskGroupContainer - taskGroup[0] taskId[0] attemptCount[1] is started
- 2022-08-07 10:49:47.053 [0-0-0-reader] INFO CommonRdbmsReader$Task - Begin to read record by Sql: [select * from gene.test
- ] jdbcUrl:[jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
- 2022-08-07 10:49:47.068 [0-0-0-reader] INFO CommonRdbmsReader$Task - Finished read record by Sql: [select * from gene.test
- ] jdbcUrl:[jdbc:mysql://192.168.2.2:3306/gene?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
- 2022-08-07 10:49:47.251 [taskGroup-0] INFO TaskGroupContainer - taskGroup[0] taskId[0] is successed, used[202]ms
- 2022-08-07 10:49:47.251 [taskGroup-0] INFO TaskGroupContainer - taskGroup[0] completed it's tasks.
- 2022-08-07 10:49:57.047 [job-0] INFO StandAloneJobContainerCommunicator - Total 3 records, 14 bytes | Speed 1B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 100.00%
- 2022-08-07 10:49:57.047 [job-0] INFO AbstractScheduler - Scheduler accomplished all tasks.
- 2022-08-07 10:49:57.048 [job-0] INFO JobContainer - DataX Writer.Job [mysqlwriter] do post work.
- 2022-08-07 10:49:57.051 [job-0] INFO JobContainer - DataX Reader.Job [mysqlreader] do post work.
- 2022-08-07 10:49:57.052 [job-0] INFO JobContainer - DataX jobId [0] completed successfully.
- 2022-08-07 10:49:57.054 [job-0] INFO HookInvoker - No hook invoked, because base dir not exists or is a file: /home/zhouze/PycharmProjects/yili/yili-portal/app/datax/hook
- 2022-08-07 10:49:57.058 [job-0] INFO JobContainer -
- [total cpu info] =>
- averageCpu | maxDeltaCpu | minDeltaCpu
- -1.00% | -1.00% | -1.00%
-
- [total gc info] =>
- NAME | totalGCCount | maxDeltaGCCount | minDeltaGCCount | totalGCTime | maxDeltaGCTime | minDeltaGCTime
- G1 Young Generation | 0 | 0 | 0 | 0.000s | 0.000s | 0.000s
- G1 Old Generation | 0 | 0 | 0 | 0.000s | 0.000s | 0.000s
- 2022-08-07 10:49:57.059 [job-0] INFO JobContainer - PerfTrace not enable!
- 2022-08-07 10:49:57.061 [job-0] INFO StandAloneJobContainerCommunicator - Total 3 records, 14 bytes | Speed 1B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 100.00%
- 2022-08-07 10:49:57.063 [job-0] INFO JobContainer -
- 任务启动时刻 : 2022-08-07 10:49:46
- 任务结束时刻 : 2022-08-07 10:49:57
- 任务总计耗时 : 10s
- 任务平均流量 : 1B/s
- 记录写入速度 : 0rec/s
- 读出记录总数 : 3
- 读写失败总数 : 0
|
