2024-05-20 02:53:45 UTC
|
|
2024-05-20 02:53:40 goca-rt-virt /usr/local/goca_rt/monitor_validate
USER GROUP PID PPID ELAPSED %CPU %MEM TIME VSZ RSS SIZE NI COMMAND
dataflow dataflow 2309439 1 27-03:58:54 4.5 0.1 15:32:26 34024 20292 25076 5 /usr/bin/tclsh /usr/local/goca_rt/monitor_validate
2024-05-20 02:53:40 [debug] rrd process: pipe=0 create=0 update=9 graph=21
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_filesystem_+data.1day,now.png
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_filesystem_+data.6hour,now.png
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_filesystem_+.1month,now.png
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_filesystem_+.1week,now.png
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_filesystem_+.1day,now.png
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_filesystem_+.6hour,now.png
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_ping_gateway.6hour,now.png
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_ifconfig_eth1.1month,now.png
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_ifconfig_eth1.1week,now.png
2024-05-20 02:53:40 [debug] graph cgsm_mcmu_iti-02_ifconfig_eth1.6hour,now.png
2024-05-20 02:53:40 [debug] graph cgsm_rank_iti-t01_apcups-snmp_iti-ups2.1day,now.png
2024-05-20 02:53:40 [debug] graph cgsm_rank_iti-t01_apcups-snmp_iti-ups2.6hour,now.png
2024-05-20 02:53:40 [debug] update 1: /data/dataflow/validate/monitor/rrd/cgsm_mcmu_iti-02/cgsm_mcmu_iti-02_ntp_ualberta.rrd
2024-05-20 02:53:40 [debug] update 1: /data/dataflow/validate/monitor/rrd/cgsm_mcmu_iti-02/cgsm_mcmu_iti-02_ntp_iti-gps.rrd
2024-05-20 02:53:40 [debug] update 1: /data/dataflow/validate/monitor/rrd/cgsm_mcmu_iti-02/cgsm_mcmu_iti-02_filesystem_+dev+shm.rrd
2024-05-20 02:53:40 [debug] update 1: /data/dataflow/validate/monitor/rrd/cgsm_mcmu_iti-02/cgsm_mcmu_iti-02_filesystem_+data.rrd
2024-05-20 02:53:40 [debug] update 1: /data/dataflow/validate/monitor/rrd/cgsm_mcmu_iti-02/cgsm_mcmu_iti-02_filesystem_+.rrd
2024-05-20 02:53:40 [debug] update 1: /data/dataflow/validate/monitor/rrd/cgsm_mcmu_iti-02/cgsm_mcmu_iti-02_ping_cgsm-rt.rrd
2024-05-20 02:53:40 [debug] update 1: /data/dataflow/validate/monitor/rrd/cgsm_mcmu_iti-02/cgsm_mcmu_iti-02_ping_gateway.rrd
2024-05-20 02:53:40 [debug] update 1: /data/dataflow/validate/monitor/rrd/cgsm_mcmu_iti-02/cgsm_mcmu_iti-02_ifconfig_eth1.rrd
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:network,IP_ADDRESS
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:network IP_ADDRESS, parent:network, child:IP_ADDRESS
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: network,IP_ADDRESS UID:cgsm_fsmi_iti-t02 triplet:1716173619 184.151.91.93 ignore
2024-05-20 02:53:39 [info] Change to config(class_parent): {misc cgsm_fsim_iti-11} {computer,misc,monitor cgsm_gill_iti-12} {misc,age cgsm_gill_iti-12} {network,time,aurora-ntp cgsm_gill_
2024-05-20 02:53:39 [info] IN if statement config(class_parent): {misc cgsm_fsim_iti-11} {computer,misc,monitor cgsm_gill_iti-12} {misc,age cgsm_gill_iti-12} {network,time,aurora-ntp cgsm
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:misc,age,ntp,ualberta
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:misc age ntp ualberta, parent:misc,age,ntp, child:ualberta
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: misc,age,ntp,ualberta UID:cgsm_fsmi_iti-t02 triplet:1716173613 {2024-05-20 02:53:33} {}
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:misc,monitor,CADENCE,ntp,ualberta
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:misc monitor CADENCE ntp ualberta, parent:misc,monitor,CADENCE,ntp, child:ualberta
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: misc,monitor,CADENCE,ntp,ualberta UID:cgsm_fsmi_iti-t02 triplet:1716173613 300 ignore
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:network,time,ualberta,reference
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:network time ualberta reference, parent:network,time,ualberta, child:reference
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: network,time,ualberta,reference UID:cgsm_fsmi_iti-t02 triplet:1716173613 172.30.248.10 ignore
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:network,time,ualberta,delay
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:network time ualberta delay, parent:network,time,ualberta, child:delay
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: network,time,ualberta,delay UID:cgsm_fsmi_iti-t02 triplet:1716173613 0.149154 ignore
2024-05-20 02:53:39 [info] Change to config(class_parent): {misc cgsm_fsim_iti-11} {computer,misc,monitor cgsm_gill_iti-12} {misc,age cgsm_gill_iti-12} {network,time,aurora-ntp cgsm_gill_
2024-05-20 02:53:39 [info] IN if statement config(class_parent): {misc cgsm_fsim_iti-11} {computer,misc,monitor cgsm_gill_iti-12} {misc,age cgsm_gill_iti-12} {network,time,aurora-ntp cgsm
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:network,time,ualberta,offset
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:network time ualberta offset, parent:network,time,ualberta, child:offset
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: network,time,ualberta,offset UID:cgsm_fsmi_iti-t02 triplet:1716173613 0.106218 good
2024-05-20 02:53:39 [info] Change to config(class_parent): {misc cgsm_fsim_iti-11} {computer,misc,monitor cgsm_gill_iti-12} {misc,age cgsm_gill_iti-12} {network,time,aurora-ntp cgsm_gill_
2024-05-20 02:53:39 [info] IN if statement config(class_parent): {misc cgsm_fsim_iti-11} {computer,misc,monitor cgsm_gill_iti-12} {misc,age cgsm_gill_iti-12} {network,time,aurora-ntp cgsm
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:network,time,ualberta,jitter
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:network time ualberta jitter, parent:network,time,ualberta, child:jitter
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: network,time,ualberta,jitter UID:cgsm_fsmi_iti-t02 triplet:1716173613 0.049955 good
2024-05-20 02:53:39 [info] Change to config(class_parent): {misc cgsm_fsim_iti-11} {computer,misc,monitor cgsm_gill_iti-12} {misc,age cgsm_gill_iti-12} {network,time,aurora-ntp cgsm_gill_
2024-05-20 02:53:39 [info] IN if statement config(class_parent): {misc cgsm_fsim_iti-11} {computer,misc,monitor cgsm_gill_iti-12} {misc,age cgsm_gill_iti-12} {network,time,aurora-ntp cgsm
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:network,time,ualberta,status
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:network time ualberta status, parent:network,time,ualberta, child:status
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: network,time,ualberta,status UID:cgsm_fsmi_iti-t02 triplet:1716173613 + good
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:network,time,ualberta,stratum
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:network time ualberta stratum, parent:network,time,ualberta, child:stratum
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: network,time,ualberta,stratum UID:cgsm_fsmi_iti-t02 triplet:1716173613 2 ignore
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:network,time,ualberta,target
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:network time ualberta target, parent:network,time,ualberta, child:target
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: network,time,ualberta,target UID:cgsm_fsmi_iti-t02 triplet:1716173613 129.128.12.20 ignore
2024-05-20 02:53:39 [debug] module classified: {network,time,ualberta,target 129.128.12.20 ignore} {network,time,ualberta,stratum 2 ignore} {network,time,ualberta,status + good} {network,t
2024-05-20 02:53:39 [info] END of dataflow monitor data_update
2024-05-20 02:53:39 [debug] rrd_update +1 (1): cgsm_fsmi_iti-t02_ntp_ualberta.rrd
2024-05-20 02:53:39 [info] MODULES Dsource names: delay
2024-05-20 02:53:39 [info] MODULES Dsource names: offset
2024-05-20 02:53:39 [info] MODULES Dsource names: jitter
2024-05-20 02:53:39 [info] THE MODULE IS ntp,ualberta
2024-05-20 02:53:39 [info] CHECK Module: template:ntp cadence: 300 args:ualberta
2024-05-20 02:53:39 [info] PRINT DATALINE: ntp,ualberta 1716173613 target 129.128.12.20 stratum 2 status + jitter 0.049955 offset 0.106218 delay 0.149154 reference 172.30.248.10 CADENCE 3
2024-05-20 02:53:39 [info] dataflow::monitor::data_update Enter
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:misc,UNKNOWN,process,riometer.relay
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:misc UNKNOWN process riometer.relay, parent:misc,UNKNOWN,process, child:riometer.relay
2024-05-20 02:53:39 [info] MON_VAL::CLASS_ADD node: misc,UNKNOWN,process,riometer.relay UID:cgsm_fsmi_iti-t02 triplet:1716173610 1716173610 ignore
2024-05-20 02:53:39 [ERROR] module::process,riometer.relay::classify -
2024-05-20 02:53:39 [info] END of dataflow monitor data_update
2024-05-20 02:53:39 [info] MODULES Dsource names: memory
2024-05-20 02:53:39 [info] MODULES Dsource names: cpu
2024-05-20 02:53:39 [info] THE MODULE IS process,riometer.relay
2024-05-20 02:53:39 [info] CHECK Module: template:process cadence: 900 args:riometer.relay
2024-05-20 02:53:39 [info] PRINT DATALINE: process,riometer.relay 1716173610 CADENCE 900
2024-05-20 02:53:39 [info] dataflow::monitor::data_update Enter
2024-05-20 02:53:39 [info] flag? config(class_item):computer,misc,monitor,version computer,misc,monitor,Project computer,misc,monitor,Site computer,misc,monitor,Device computer,misc,monit
2024-05-20 02:53:39 [info] what is node:misc,UNKNOWN,process,riometer
2024-05-20 02:53:39 [info] IN ADD_NODE BREAK NODE parts:misc UNKNOWN process riometer, parent:misc,UNKNOWN,process, child:riometer
|