2022-10-07 03:21:22.133 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37812)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130409268 ms)
2022-10-07 03:21:32.358 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130419493 ms)
2022-10-07 03:21:32.359 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130419494 ms)
2022-10-07 03:21:32.361 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:21:31.122504+00:00', 'runtime': '2130420.001', 'adc_vb_f': '12.729', 'adc_va_f': '0.235', 'adc_vl_f': '12.704', 'adc_ic_f': '0.002', 'adc_il_f': '0.498', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.72', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130419497 ms)
2022-10-07 03:21:32.362 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:20:31.122591+00:00', 'runtime': '2130360.001', 'adc_vb_f': '12.729', 'adc_va_f': '0.235', 'adc_vl_f': '12.701', 'adc_ic_f': '0.002', 'adc_il_f': '0.529', 't_hs': '21', 't_batt': '24', 't_amb': '24', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.726', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130419498 ms)
2022-10-07 03:21:37.202 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130424337 ms)
2022-10-07 03:21:37.202 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130424337 ms)
2022-10-07 03:21:37.203 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37828)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130424338 ms)
2022-10-07 03:21:56.321 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130443457 ms)
2022-10-07 03:21:56.322 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130443457 ms)
2022-10-07 03:21:56.322 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37848)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130443458 ms)
2022-10-07 03:21:59.401 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130446536 ms)
2022-10-07 03:21:59.402 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130446537 ms)
2022-10-07 03:21:59.402 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37852)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130446538 ms)
2022-10-07 03:22:02.502 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130449638 ms)
2022-10-07 03:22:02.503 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130449638 ms)
2022-10-07 03:22:02.504 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37856)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130449639 ms)
2022-10-07 03:22:07.580 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130454716 ms)
2022-10-07 03:22:07.581 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130454716 ms)
2022-10-07 03:22:07.582 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37862)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130454717 ms)
2022-10-07 03:22:14.658 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130461793 ms)
2022-10-07 03:22:14.658 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130461794 ms)
2022-10-07 03:22:14.660 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37870)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130461795 ms)
2022-10-07 03:22:20.712 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130467848 ms)
2022-10-07 03:22:20.713 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130467848 ms)
2022-10-07 03:22:20.714 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37878)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130467849 ms)
2022-10-07 03:22:21.802 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130468937 ms)
2022-10-07 03:22:21.802 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130468938 ms)
2022-10-07 03:22:21.804 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37880)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130468939 ms)
2022-10-07 03:22:23.872 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130471008 ms)
2022-10-07 03:22:23.873 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130471008 ms)
2022-10-07 03:22:23.874 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37884)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130471010 ms)
2022-10-07 03:22:32.362 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130479497 ms)
2022-10-07 03:22:32.363 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130479498 ms)
2022-10-07 03:22:32.365 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:22:31.122616+00:00', 'runtime': '2130480.001', 'adc_vb_f': '12.723', 'adc_va_f': '0.235', 'adc_vl_f': '12.701', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.726', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130479500 ms)
2022-10-07 03:22:32.366 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:21:31.122504+00:00', 'runtime': '2130420.001', 'adc_vb_f': '12.729', 'adc_va_f': '0.235', 'adc_vl_f': '12.704', 'adc_ic_f': '0.002', 'adc_il_f': '0.498', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.72', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130479501 ms)
2022-10-07 03:22:40.971 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130488106 ms)
2022-10-07 03:22:40.971 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130488107 ms)
2022-10-07 03:22:40.972 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37904)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130488107 ms)
2022-10-07 03:22:59.052 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130506188 ms)
2022-10-07 03:22:59.053 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130506188 ms)
2022-10-07 03:22:59.054 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37926)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130506189 ms)
2022-10-07 03:23:03.130 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130510265 ms)
2022-10-07 03:23:03.130 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130510266 ms)
2022-10-07 03:23:03.131 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37932)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130510267 ms)
2022-10-07 03:23:04.211 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130511347 ms)
2022-10-07 03:23:04.212 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130511347 ms)
2022-10-07 03:23:04.213 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37934)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130511348 ms)
2022-10-07 03:23:08.281 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130515417 ms)
2022-10-07 03:23:08.282 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130515417 ms)
2022-10-07 03:23:08.283 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37940)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130515419 ms)
2022-10-07 03:23:10.352 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130517488 ms)
2022-10-07 03:23:10.353 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130517488 ms)
2022-10-07 03:23:10.354 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37944)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130517490 ms)
2022-10-07 03:23:16.440 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130523575 ms)
2022-10-07 03:23:16.440 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130523576 ms)
2022-10-07 03:23:16.442 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37952)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130523577 ms)
2022-10-07 03:23:19.531 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130526666 ms)
2022-10-07 03:23:19.531 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130526667 ms)
2022-10-07 03:23:19.532 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37956)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130526668 ms)
2022-10-07 03:23:26.612 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130533747 ms)
2022-10-07 03:23:26.612 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130533748 ms)
2022-10-07 03:23:26.613 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37964)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130533749 ms)
2022-10-07 03:23:32.353 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130539488 ms)
2022-10-07 03:23:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130539489 ms)
2022-10-07 03:23:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:23:31.122603+00:00', 'runtime': '2130540.001', 'adc_vb_f': '12.72', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.553', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.72', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130539489 ms)
2022-10-07 03:23:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:22:31.122616+00:00', 'runtime': '2130480.001', 'adc_vb_f': '12.723', 'adc_va_f': '0.235', 'adc_vl_f': '12.701', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.726', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130539490 ms)
2022-10-07 03:23:43.721 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130550856 ms)
2022-10-07 03:23:43.721 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130550857 ms)
2022-10-07 03:23:43.723 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37982)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130550858 ms)
2022-10-07 03:23:44.811 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130551946 ms)
2022-10-07 03:23:44.811 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130551947 ms)
2022-10-07 03:23:44.812 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37984)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130551948 ms)
2022-10-07 03:23:45.871 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130553007 ms)
2022-10-07 03:23:45.872 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130553007 ms)
2022-10-07 03:23:45.873 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37986)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130553009 ms)
2022-10-07 03:23:54.981 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130562117 ms)
2022-10-07 03:23:54.982 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130562117 ms)
2022-10-07 03:23:54.983 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 37996)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130562119 ms)
2022-10-07 03:24:01.061 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130568196 ms)
2022-10-07 03:24:01.061 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130568197 ms)
2022-10-07 03:24:01.063 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38004)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130568198 ms)
2022-10-07 03:24:03.111 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130570246 ms)
2022-10-07 03:24:03.111 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130570247 ms)
2022-10-07 03:24:03.113 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38008)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130570249 ms)
2022-10-07 03:24:16.211 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130583347 ms)
2022-10-07 03:24:16.212 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130583347 ms)
2022-10-07 03:24:16.213 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38022)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130583348 ms)
2022-10-07 03:24:16.258 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130583393 ms)
2022-10-07 03:24:16.258 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130583394 ms)
2022-10-07 03:24:16.259 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38024)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130583395 ms)
2022-10-07 03:24:25.353 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130592488 ms)
2022-10-07 03:24:25.353 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130592488 ms)
2022-10-07 03:24:25.354 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38034)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130592490 ms)
2022-10-07 03:24:32.347 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130599483 ms)
2022-10-07 03:24:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130599484 ms)
2022-10-07 03:24:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:24:31.123456+00:00', 'runtime': '2130600.002', 'adc_vb_f': '12.723', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.522', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.723', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130599487 ms)
2022-10-07 03:24:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:23:31.122603+00:00', 'runtime': '2130540.001', 'adc_vb_f': '12.72', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.553', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.72', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130599488 ms)
2022-10-07 03:24:45.441 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130612577 ms)
2022-10-07 03:24:45.442 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130612577 ms)
2022-10-07 03:24:45.442 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38056)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130612578 ms)
2022-10-07 03:24:56.539 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130623675 ms)
2022-10-07 03:24:56.540 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130623675 ms)
2022-10-07 03:24:56.541 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38070)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130623676 ms)
2022-10-07 03:24:58.619 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130625754 ms)
2022-10-07 03:24:58.620 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130625755 ms)
2022-10-07 03:24:58.621 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38074)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130625756 ms)
2022-10-07 03:25:01.692 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130628827 ms)
2022-10-07 03:25:01.692 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130628828 ms)
2022-10-07 03:25:01.694 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38078)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130628829 ms)
2022-10-07 03:25:19.793 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130646928 ms)
2022-10-07 03:25:19.793 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130646929 ms)
2022-10-07 03:25:19.794 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38098)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130646930 ms)
2022-10-07 03:25:19.832 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130646968 ms)
2022-10-07 03:25:19.833 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130646969 ms)
2022-10-07 03:25:19.834 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38100)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130646970 ms)
2022-10-07 03:25:19.872 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130647008 ms)
2022-10-07 03:25:19.873 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130647008 ms)
2022-10-07 03:25:19.874 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38102)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130647010 ms)
2022-10-07 03:25:32.356 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130659491 ms)
2022-10-07 03:25:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130659492 ms)
2022-10-07 03:25:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:25:31.122641+00:00', 'runtime': '2130660.001', 'adc_vb_f': '12.717', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.57', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.72', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130659493 ms)
2022-10-07 03:25:32.358 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:24:31.123456+00:00', 'runtime': '2130600.002', 'adc_vb_f': '12.723', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.522', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.723', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130659493 ms)
2022-10-07 03:25:32.971 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130660106 ms)
2022-10-07 03:25:32.971 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130660106 ms)
2022-10-07 03:25:32.971 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38118)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130660107 ms)
2022-10-07 03:25:42.052 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130669188 ms)
2022-10-07 03:25:42.053 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130669188 ms)
2022-10-07 03:25:42.054 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38128)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130669190 ms)
2022-10-07 03:25:45.121 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130672257 ms)
2022-10-07 03:25:45.122 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130672257 ms)
2022-10-07 03:25:45.123 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38132)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130672258 ms)
2022-10-07 03:25:50.222 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130677358 ms)
2022-10-07 03:25:50.223 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130677358 ms)
2022-10-07 03:25:50.224 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38138)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130677359 ms)
2022-10-07 03:25:54.291 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130681427 ms)
2022-10-07 03:25:54.292 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130681427 ms)
2022-10-07 03:25:54.292 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38144)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130681428 ms)
2022-10-07 03:25:56.361 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130683497 ms)
2022-10-07 03:25:56.362 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130683497 ms)
2022-10-07 03:25:56.363 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38148)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130683498 ms)
2022-10-07 03:26:11.459 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130698594 ms)
2022-10-07 03:26:11.459 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130698595 ms)
2022-10-07 03:26:11.461 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38164)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130698596 ms)
2022-10-07 03:26:13.532 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130700667 ms)
2022-10-07 03:26:13.532 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130700668 ms)
2022-10-07 03:26:13.533 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38168)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130700669 ms)
2022-10-07 03:26:14.621 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130701757 ms)
2022-10-07 03:26:14.622 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130701757 ms)
2022-10-07 03:26:14.623 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38170)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130701758 ms)
2022-10-07 03:26:15.712 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130702848 ms)
2022-10-07 03:26:15.713 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130702848 ms)
2022-10-07 03:26:15.714 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38172)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130702850 ms)
2022-10-07 03:26:17.789 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130704924 ms)
2022-10-07 03:26:17.789 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130704925 ms)
2022-10-07 03:26:17.791 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38176)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130704926 ms)
2022-10-07 03:26:21.872 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130709007 ms)
2022-10-07 03:26:21.872 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130709007 ms)
2022-10-07 03:26:21.873 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38182)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130709009 ms)
2022-10-07 03:26:27.952 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130715087 ms)
2022-10-07 03:26:27.952 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130715088 ms)
2022-10-07 03:26:27.953 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38192)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130715089 ms)
2022-10-07 03:26:31.444 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130718579 ms)
2022-10-07 03:26:31.444 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130718580 ms)
2022-10-07 03:26:31.445 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:26:31.122619+00:00', 'runtime': '2130720.001', 'adc_vb_f': '12.714', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.573', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.717', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130718581 ms)
2022-10-07 03:26:31.446 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:25:31.122641+00:00', 'runtime': '2130660.001', 'adc_vb_f': '12.717', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.57', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.72', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.2', 'ahl_t': '507.2', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.8', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130718581 ms)
2022-10-07 03:26:37.061 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130724197 ms)
2022-10-07 03:26:37.062 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130724197 ms)
2022-10-07 03:26:37.062 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38202)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130724197 ms)
2022-10-07 03:26:39.123 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130726258 ms)
2022-10-07 03:26:39.123 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130726258 ms)
2022-10-07 03:26:39.123 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38206)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130726259 ms)
2022-10-07 03:26:44.202 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130731338 ms)
2022-10-07 03:26:44.203 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130731338 ms)
2022-10-07 03:26:44.203 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38212)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130731338 ms)
2022-10-07 03:26:47.273 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130734408 ms)
2022-10-07 03:26:47.273 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130734409 ms)
2022-10-07 03:26:47.274 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38218)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130734409 ms)
2022-10-07 03:26:48.333 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130735468 ms)
2022-10-07 03:26:48.333 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130735468 ms)
2022-10-07 03:26:48.333 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38220)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130735469 ms)
2022-10-07 03:26:59.411 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130746547 ms)
2022-10-07 03:26:59.412 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130746547 ms)
2022-10-07 03:26:59.413 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38232)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130746548 ms)
2022-10-07 03:27:01.482 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130748618 ms)
2022-10-07 03:27:01.483 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130748618 ms)
2022-10-07 03:27:01.484 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38236)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130748619 ms)
2022-10-07 03:27:01.521 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130748657 ms)
2022-10-07 03:27:01.522 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130748657 ms)
2022-10-07 03:27:01.523 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38238)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130748659 ms)
2022-10-07 03:27:18.618 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130765754 ms)
2022-10-07 03:27:18.619 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130765754 ms)
2022-10-07 03:27:18.620 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38256)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130765755 ms)
2022-10-07 03:27:30.709 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130777845 ms)
2022-10-07 03:27:30.710 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130777845 ms)
2022-10-07 03:27:30.711 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38270)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130777847 ms)
2022-10-07 03:27:32.347 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130779483 ms)
2022-10-07 03:27:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130779483 ms)
2022-10-07 03:27:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:27:31.122561+00:00', 'runtime': '2130780.001', 'adc_vb_f': '12.714', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.556', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.717', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130779485 ms)
2022-10-07 03:27:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:26:31.122619+00:00', 'runtime': '2130720.001', 'adc_vb_f': '12.714', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.573', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.717', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130779485 ms)
2022-10-07 03:27:35.811 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130782947 ms)
2022-10-07 03:27:35.812 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130782947 ms)
2022-10-07 03:27:35.812 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38278)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130782948 ms)
2022-10-07 03:27:54.922 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130802057 ms)
2022-10-07 03:27:54.922 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130802058 ms)
2022-10-07 03:27:54.923 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38298)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130802059 ms)
2022-10-07 03:28:07.009 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130814144 ms)
2022-10-07 03:28:07.009 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130814145 ms)
2022-10-07 03:28:07.011 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38312)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130814146 ms)
2022-10-07 03:28:17.082 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130824217 ms)
2022-10-07 03:28:17.082 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130824218 ms)
2022-10-07 03:28:17.084 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38324)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130824219 ms)
2022-10-07 03:28:17.121 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130824256 ms)
2022-10-07 03:28:17.121 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130824257 ms)
2022-10-07 03:28:17.123 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38326)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130824258 ms)
2022-10-07 03:28:32.351 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130839486 ms)
2022-10-07 03:28:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130839487 ms)
2022-10-07 03:28:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:28:31.122595+00:00', 'runtime': '2130840.001', 'adc_vb_f': '12.717', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.531', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.717', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130839488 ms)
2022-10-07 03:28:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:27:31.122561+00:00', 'runtime': '2130780.001', 'adc_vb_f': '12.714', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.556', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.717', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130839489 ms)
2022-10-07 03:28:38.242 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130845377 ms)
2022-10-07 03:28:38.242 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130845377 ms)
2022-10-07 03:28:38.243 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38348)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130845378 ms)
2022-10-07 03:28:43.331 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130850467 ms)
2022-10-07 03:28:43.332 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130850467 ms)
2022-10-07 03:28:43.332 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38354)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130850468 ms)
2022-10-07 03:28:44.413 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130851548 ms)
2022-10-07 03:28:44.413 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130851549 ms)
2022-10-07 03:28:44.414 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38356)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130851549 ms)
2022-10-07 03:28:45.513 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130852648 ms)
2022-10-07 03:28:45.513 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130852649 ms)
2022-10-07 03:28:45.515 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38358)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130852650 ms)
2022-10-07 03:29:25.632 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130892768 ms)
2022-10-07 03:29:25.633 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130892768 ms)
2022-10-07 03:29:25.634 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38402)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130892769 ms)
2022-10-07 03:29:25.671 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130892807 ms)
2022-10-07 03:29:25.672 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130892807 ms)
2022-10-07 03:29:25.673 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38404)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130892808 ms)
2022-10-07 03:29:32.353 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130899488 ms)
2022-10-07 03:29:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130899489 ms)
2022-10-07 03:29:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:29:31.123428+00:00', 'runtime': '2130900.002', 'adc_vb_f': '12.714', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.558', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.714', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130899490 ms)
2022-10-07 03:29:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:28:31.122595+00:00', 'runtime': '2130840.001', 'adc_vb_f': '12.717', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.531', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.717', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130899491 ms)
2022-10-07 03:29:47.750 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130914885 ms)
2022-10-07 03:29:47.750 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130914886 ms)
2022-10-07 03:29:47.752 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38428)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130914887 ms)
2022-10-07 03:29:52.833 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130919968 ms)
2022-10-07 03:29:52.833 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130919969 ms)
2022-10-07 03:29:52.835 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38434)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130919970 ms)
2022-10-07 03:30:07.949 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130935085 ms)
2022-10-07 03:30:07.950 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130935085 ms)
2022-10-07 03:30:07.951 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38450)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130935086 ms)
2022-10-07 03:30:26.060 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130953196 ms)
2022-10-07 03:30:26.061 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130953196 ms)
2022-10-07 03:30:26.062 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38470)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130953198 ms)
2022-10-07 03:30:32.342 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2130959478 ms)
2022-10-07 03:30:32.343 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2130959478 ms)
2022-10-07 03:30:32.344 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:30:31.122646+00:00', 'runtime': '2130960.001', 'adc_vb_f': '12.714', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.558', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.717', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130959479 ms)
2022-10-07 03:30:32.344 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:29:31.123428+00:00', 'runtime': '2130900.002', 'adc_vb_f': '12.714', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.558', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.714', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2130959480 ms)
2022-10-07 03:30:34.131 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130961267 ms)
2022-10-07 03:30:34.132 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130961267 ms)
2022-10-07 03:30:34.132 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38482)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130961267 ms)
2022-10-07 03:30:34.161 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130961297 ms)
2022-10-07 03:30:34.162 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130961297 ms)
2022-10-07 03:30:34.162 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38484)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130961297 ms)
2022-10-07 03:30:43.241 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130970377 ms)
2022-10-07 03:30:43.242 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130970377 ms)
2022-10-07 03:30:43.242 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38494)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130970378 ms)
2022-10-07 03:30:43.272 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130970408 ms)
2022-10-07 03:30:43.273 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130970408 ms)
2022-10-07 03:30:43.273 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38496)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130970409 ms)
2022-10-07 03:30:45.332 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130972467 ms)
2022-10-07 03:30:45.332 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130972468 ms)
2022-10-07 03:30:45.333 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38500)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130972468 ms)
2022-10-07 03:30:45.363 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130972498 ms)
2022-10-07 03:30:45.363 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130972498 ms)
2022-10-07 03:30:45.363 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38502)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130972499 ms)
2022-10-07 03:30:50.433 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130977568 ms)
2022-10-07 03:30:50.433 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130977569 ms)
2022-10-07 03:30:50.433 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38510)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130977569 ms)
2022-10-07 03:30:58.512 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130985647 ms)
2022-10-07 03:30:58.512 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130985648 ms)
2022-10-07 03:30:58.513 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38520)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130985648 ms)
2022-10-07 03:31:02.582 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130989717 ms)
2022-10-07 03:31:02.582 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130989718 ms)
2022-10-07 03:31:02.584 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38526)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130989719 ms)
2022-10-07 03:31:06.631 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130993766 ms)
2022-10-07 03:31:06.631 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130993767 ms)
2022-10-07 03:31:06.632 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38540)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130993767 ms)
2022-10-07 03:31:08.672 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130995808 ms)
2022-10-07 03:31:08.673 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130995808 ms)
2022-10-07 03:31:08.673 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38546)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130995809 ms)
2022-10-07 03:31:08.710 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2130995846 ms)
2022-10-07 03:31:08.711 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2130995846 ms)
2022-10-07 03:31:08.711 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38548)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2130995847 ms)
2022-10-07 03:31:21.793 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131008928 ms)
2022-10-07 03:31:21.793 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131008929 ms)
2022-10-07 03:31:21.795 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38562)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131008930 ms)
2022-10-07 03:31:25.861 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131012997 ms)
2022-10-07 03:31:25.862 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131012997 ms)
2022-10-07 03:31:25.863 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38568)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131012999 ms)
2022-10-07 03:31:29.912 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131017047 ms)
2022-10-07 03:31:29.912 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131017048 ms)
2022-10-07 03:31:29.914 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38574)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131017049 ms)
2022-10-07 03:31:32.346 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131019481 ms)
2022-10-07 03:31:32.346 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131019482 ms)
2022-10-07 03:31:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:31:31.122646+00:00', 'runtime': '2131020.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.56', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.714', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131019483 ms)
2022-10-07 03:31:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:30:31.122646+00:00', 'runtime': '2130960.001', 'adc_vb_f': '12.714', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.558', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.717', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131019483 ms)
2022-10-07 03:31:44.002 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131031137 ms)
2022-10-07 03:31:44.002 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131031138 ms)
2022-10-07 03:31:44.003 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38590)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131031138 ms)
2022-10-07 03:31:55.097 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131042232 ms)
2022-10-07 03:31:55.097 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131042233 ms)
2022-10-07 03:31:55.098 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38602)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131042233 ms)
2022-10-07 03:31:56.168 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131043304 ms)
2022-10-07 03:31:56.169 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131043304 ms)
2022-10-07 03:31:56.170 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38604)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131043306 ms)
2022-10-07 03:31:57.252 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131044387 ms)
2022-10-07 03:31:57.252 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131044388 ms)
2022-10-07 03:31:57.253 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38606)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131044388 ms)
2022-10-07 03:32:00.302 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131047438 ms)
2022-10-07 03:32:00.303 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131047438 ms)
2022-10-07 03:32:00.304 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38610)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131047440 ms)
2022-10-07 03:32:02.373 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131049508 ms)
2022-10-07 03:32:02.373 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131049509 ms)
2022-10-07 03:32:02.375 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38614)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131049510 ms)
2022-10-07 03:32:02.413 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131049548 ms)
2022-10-07 03:32:02.413 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131049549 ms)
2022-10-07 03:32:02.415 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38616)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131049550 ms)
2022-10-07 03:32:03.500 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131050635 ms)
2022-10-07 03:32:03.500 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131050636 ms)
2022-10-07 03:32:03.502 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38618)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131050637 ms)
2022-10-07 03:32:04.581 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131051717 ms)
2022-10-07 03:32:04.582 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131051717 ms)
2022-10-07 03:32:04.583 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38620)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131051719 ms)
2022-10-07 03:32:07.653 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131054788 ms)
2022-10-07 03:32:07.653 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131054789 ms)
2022-10-07 03:32:07.655 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38624)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131054790 ms)
2022-10-07 03:32:32.350 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131079485 ms)
2022-10-07 03:32:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131079486 ms)
2022-10-07 03:32:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:32:31.122639+00:00', 'runtime': '2131080.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.57', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.714', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131079489 ms)
2022-10-07 03:32:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:31:31.122646+00:00', 'runtime': '2131020.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.56', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.714', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131079489 ms)
2022-10-07 03:32:36.781 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131083916 ms)
2022-10-07 03:32:36.781 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131083917 ms)
2022-10-07 03:32:36.782 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38656)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131083917 ms)
2022-10-07 03:32:50.871 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131098007 ms)
2022-10-07 03:32:50.872 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131098007 ms)
2022-10-07 03:32:50.872 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38674)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131098008 ms)
2022-10-07 03:32:56.923 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131104058 ms)
2022-10-07 03:32:56.923 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131104058 ms)
2022-10-07 03:32:56.924 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38682)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131104060 ms)
2022-10-07 03:33:10.022 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131117157 ms)
2022-10-07 03:33:10.022 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131117158 ms)
2022-10-07 03:33:10.023 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38696)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131117159 ms)
2022-10-07 03:33:23.101 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131130236 ms)
2022-10-07 03:33:23.101 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131130237 ms)
2022-10-07 03:33:23.102 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38710)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131130238 ms)
2022-10-07 03:33:23.143 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131130278 ms)
2022-10-07 03:33:23.143 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131130279 ms)
2022-10-07 03:33:23.144 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38712)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131130280 ms)
2022-10-07 03:33:30.241 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131137377 ms)
2022-10-07 03:33:30.242 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131137377 ms)
2022-10-07 03:33:30.243 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38720)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131137379 ms)
2022-10-07 03:33:32.346 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131139482 ms)
2022-10-07 03:33:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131139483 ms)
2022-10-07 03:33:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:33:31.122641+00:00', 'runtime': '2131140.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131139487 ms)
2022-10-07 03:33:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:32:31.122639+00:00', 'runtime': '2131080.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.57', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.714', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131139488 ms)
2022-10-07 03:33:34.291 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131141427 ms)
2022-10-07 03:33:34.292 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131141427 ms)
2022-10-07 03:33:34.293 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38726)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131141428 ms)
2022-10-07 03:33:36.373 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131143508 ms)
2022-10-07 03:33:36.373 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131143509 ms)
2022-10-07 03:33:36.374 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38730)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131143510 ms)
2022-10-07 03:33:36.411 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131143547 ms)
2022-10-07 03:33:36.412 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131143547 ms)
2022-10-07 03:33:36.415 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38732)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131143550 ms)
2022-10-07 03:33:37.493 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131144628 ms)
2022-10-07 03:33:37.493 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131144629 ms)
2022-10-07 03:33:37.494 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38734)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131144630 ms)
2022-10-07 03:33:39.574 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131146710 ms)
2022-10-07 03:33:39.575 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131146710 ms)
2022-10-07 03:33:39.576 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38738)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131146712 ms)
2022-10-07 03:33:39.619 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131146755 ms)
2022-10-07 03:33:39.620 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131146755 ms)
2022-10-07 03:33:39.621 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38740)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131146757 ms)
2022-10-07 03:33:39.661 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131146797 ms)
2022-10-07 03:33:39.662 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131146797 ms)
2022-10-07 03:33:39.663 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38742)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131146799 ms)
2022-10-07 03:33:43.741 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131150877 ms)
2022-10-07 03:33:43.742 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131150877 ms)
2022-10-07 03:33:43.743 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38748)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131150879 ms)
2022-10-07 03:34:02.832 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131169967 ms)
2022-10-07 03:34:02.832 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131169968 ms)
2022-10-07 03:34:02.834 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38768)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131169969 ms)
2022-10-07 03:34:16.928 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131184064 ms)
2022-10-07 03:34:16.929 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131184064 ms)
2022-10-07 03:34:16.930 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38784)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131184066 ms)
2022-10-07 03:34:18.028 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131185164 ms)
2022-10-07 03:34:18.029 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131185164 ms)
2022-10-07 03:34:18.030 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38786)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131185165 ms)
2022-10-07 03:34:21.121 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131188257 ms)
2022-10-07 03:34:21.122 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131188257 ms)
2022-10-07 03:34:21.123 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38790)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131188258 ms)
2022-10-07 03:34:22.211 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131189347 ms)
2022-10-07 03:34:22.212 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131189347 ms)
2022-10-07 03:34:22.213 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38792)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131189348 ms)
2022-10-07 03:34:25.292 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131192428 ms)
2022-10-07 03:34:25.293 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131192428 ms)
2022-10-07 03:34:25.294 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38796)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131192430 ms)
2022-10-07 03:34:26.371 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131193507 ms)
2022-10-07 03:34:26.372 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131193507 ms)
2022-10-07 03:34:26.372 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38798)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131193508 ms)
2022-10-07 03:34:27.461 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131194596 ms)
2022-10-07 03:34:27.461 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131194597 ms)
2022-10-07 03:34:27.463 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38800)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131194598 ms)
2022-10-07 03:34:28.531 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131195667 ms)
2022-10-07 03:34:28.532 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131195667 ms)
2022-10-07 03:34:28.533 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38802)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131195668 ms)
2022-10-07 03:34:32.351 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131199487 ms)
2022-10-07 03:34:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131199488 ms)
2022-10-07 03:34:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:34:31.122614+00:00', 'runtime': '2131200.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.548', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131199490 ms)
2022-10-07 03:34:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:33:31.122641+00:00', 'runtime': '2131140.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131199491 ms)
2022-10-07 03:34:41.649 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131208784 ms)
2022-10-07 03:34:41.649 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131208785 ms)
2022-10-07 03:34:41.650 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38818)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131208786 ms)
2022-10-07 03:34:46.697 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131213833 ms)
2022-10-07 03:34:46.698 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131213833 ms)
2022-10-07 03:34:46.698 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38824)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131213834 ms)
2022-10-07 03:34:48.761 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131215897 ms)
2022-10-07 03:34:48.762 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131215897 ms)
2022-10-07 03:34:48.762 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38830)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131215898 ms)
2022-10-07 03:34:52.842 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131219977 ms)
2022-10-07 03:34:52.842 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131219978 ms)
2022-10-07 03:34:52.843 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38836)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131219978 ms)
2022-10-07 03:35:10.931 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131238066 ms)
2022-10-07 03:35:10.931 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131238067 ms)
2022-10-07 03:35:10.933 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38856)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131238068 ms)
2022-10-07 03:35:18.020 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131245156 ms)
2022-10-07 03:35:18.021 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131245156 ms)
2022-10-07 03:35:18.022 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38864)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131245158 ms)
2022-10-07 03:35:22.092 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131249227 ms)
2022-10-07 03:35:22.092 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131249227 ms)
2022-10-07 03:35:22.093 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38870)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131249229 ms)
2022-10-07 03:35:30.149 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131257284 ms)
2022-10-07 03:35:30.149 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131257285 ms)
2022-10-07 03:35:30.151 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38880)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131257286 ms)
2022-10-07 03:35:32.341 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131259477 ms)
2022-10-07 03:35:32.342 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131259477 ms)
2022-10-07 03:35:32.343 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:35:31.122649+00:00', 'runtime': '2131260.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131259478 ms)
2022-10-07 03:35:32.343 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:34:31.122614+00:00', 'runtime': '2131200.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.548', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131259479 ms)
2022-10-07 03:35:37.258 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131264393 ms)
2022-10-07 03:35:37.258 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131264394 ms)
2022-10-07 03:35:37.259 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38888)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131264394 ms)
2022-10-07 03:35:44.361 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131271497 ms)
2022-10-07 03:35:44.362 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131271497 ms)
2022-10-07 03:35:44.363 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38896)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131271499 ms)
2022-10-07 03:35:46.433 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131273568 ms)
2022-10-07 03:35:46.433 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131273569 ms)
2022-10-07 03:35:46.435 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38900)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131273570 ms)
2022-10-07 03:35:52.510 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131279646 ms)
2022-10-07 03:35:52.511 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131279646 ms)
2022-10-07 03:35:52.512 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38908)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131279648 ms)
2022-10-07 03:35:57.602 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131284737 ms)
2022-10-07 03:35:57.602 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131284738 ms)
2022-10-07 03:35:57.604 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38914)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131284739 ms)
2022-10-07 03:36:01.681 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131288816 ms)
2022-10-07 03:36:01.682 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131288817 ms)
2022-10-07 03:36:01.683 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38920)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131288818 ms)
2022-10-07 03:36:02.751 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131289887 ms)
2022-10-07 03:36:02.752 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131289887 ms)
2022-10-07 03:36:02.753 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38922)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131289889 ms)
2022-10-07 03:36:10.838 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131297974 ms)
2022-10-07 03:36:10.839 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131297974 ms)
2022-10-07 03:36:10.842 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38932)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131297977 ms)
2022-10-07 03:36:32.358 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131319494 ms)
2022-10-07 03:36:32.359 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131319494 ms)
2022-10-07 03:36:32.361 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:36:31.123466+00:00', 'runtime': '2131320.002', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.551', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131319496 ms)
2022-10-07 03:36:32.361 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:35:31.122649+00:00', 'runtime': '2131260.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131319497 ms)
2022-10-07 03:36:33.970 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131321106 ms)
2022-10-07 03:36:33.971 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131321106 ms)
2022-10-07 03:36:33.971 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38958)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131321107 ms)
2022-10-07 03:36:46.020 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131333155 ms)
2022-10-07 03:36:46.020 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131333155 ms)
2022-10-07 03:36:46.020 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38974)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131333156 ms)
2022-10-07 03:36:47.081 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131334216 ms)
2022-10-07 03:36:47.082 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131334217 ms)
2022-10-07 03:36:47.083 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38976)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131334218 ms)
2022-10-07 03:36:49.151 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131336286 ms)
2022-10-07 03:36:49.151 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131336286 ms)
2022-10-07 03:36:49.152 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38980)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131336287 ms)
2022-10-07 03:37:02.240 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131349375 ms)
2022-10-07 03:37:02.240 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131349376 ms)
2022-10-07 03:37:02.241 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 38994)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131349377 ms)
2022-10-07 03:37:06.310 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131353446 ms)
2022-10-07 03:37:06.311 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131353446 ms)
2022-10-07 03:37:06.312 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39000)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131353447 ms)
2022-10-07 03:37:11.391 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131358527 ms)
2022-10-07 03:37:11.392 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131358527 ms)
2022-10-07 03:37:11.393 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39006)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131358529 ms)
2022-10-07 03:37:25.481 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131372617 ms)
2022-10-07 03:37:25.482 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131372617 ms)
2022-10-07 03:37:25.483 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39022)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131372618 ms)
2022-10-07 03:37:28.581 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131375717 ms)
2022-10-07 03:37:28.582 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131375717 ms)
2022-10-07 03:37:28.583 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39026)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131375719 ms)
2022-10-07 03:37:28.620 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131375756 ms)
2022-10-07 03:37:28.621 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131375756 ms)
2022-10-07 03:37:28.622 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39028)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131375757 ms)
2022-10-07 03:37:28.660 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131375796 ms)
2022-10-07 03:37:28.661 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131375796 ms)
2022-10-07 03:37:28.662 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39030)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131375797 ms)
2022-10-07 03:37:29.711 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131376846 ms)
2022-10-07 03:37:29.711 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131376847 ms)
2022-10-07 03:37:29.712 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39032)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131376848 ms)
2022-10-07 03:37:32.356 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131379492 ms)
2022-10-07 03:37:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131379493 ms)
2022-10-07 03:37:32.361 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:37:31.122602+00:00', 'runtime': '2131380.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.577', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131379497 ms)
2022-10-07 03:37:32.362 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:36:31.123466+00:00', 'runtime': '2131320.002', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.551', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.3', 'ahl_t': '507.3', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '1.9', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131379498 ms)
2022-10-07 03:37:37.791 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131384926 ms)
2022-10-07 03:37:37.791 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131384927 ms)
2022-10-07 03:37:37.792 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39044)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131384928 ms)
2022-10-07 03:37:40.880 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131388015 ms)
2022-10-07 03:37:40.880 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131388016 ms)
2022-10-07 03:37:40.882 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39048)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131388017 ms)
2022-10-07 03:37:42.930 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131390066 ms)
2022-10-07 03:37:42.931 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131390066 ms)
2022-10-07 03:37:42.932 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39052)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131390068 ms)
2022-10-07 03:37:47.001 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131394136 ms)
2022-10-07 03:37:47.001 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131394137 ms)
2022-10-07 03:37:47.003 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39058)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131394138 ms)
2022-10-07 03:38:08.095 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131415231 ms)
2022-10-07 03:38:08.096 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131415231 ms)
2022-10-07 03:38:08.097 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39080)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131415232 ms)
2022-10-07 03:38:09.169 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131416305 ms)
2022-10-07 03:38:09.170 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131416305 ms)
2022-10-07 03:38:09.171 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39082)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131416306 ms)
2022-10-07 03:38:13.241 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131420376 ms)
2022-10-07 03:38:13.241 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131420377 ms)
2022-10-07 03:38:13.243 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39088)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131420378 ms)
2022-10-07 03:38:14.289 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131421424 ms)
2022-10-07 03:38:14.289 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131421425 ms)
2022-10-07 03:38:14.291 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39090)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131421426 ms)
2022-10-07 03:38:18.358 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131425494 ms)
2022-10-07 03:38:18.359 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131425494 ms)
2022-10-07 03:38:18.360 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39096)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131425495 ms)
2022-10-07 03:38:18.398 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131425533 ms)
2022-10-07 03:38:18.398 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131425534 ms)
2022-10-07 03:38:18.399 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39098)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131425534 ms)
2022-10-07 03:38:22.473 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131429608 ms)
2022-10-07 03:38:22.473 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131429609 ms)
2022-10-07 03:38:22.474 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39104)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131429610 ms)
2022-10-07 03:38:27.549 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131434685 ms)
2022-10-07 03:38:27.550 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131434685 ms)
2022-10-07 03:38:27.551 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39110)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131434687 ms)
2022-10-07 03:38:32.347 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131439482 ms)
2022-10-07 03:38:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131439483 ms)
2022-10-07 03:38:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:38:31.123841+00:00', 'runtime': '2131440.002', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.548', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131439484 ms)
2022-10-07 03:38:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:37:31.122602+00:00', 'runtime': '2131380.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.577', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131439484 ms)
2022-10-07 03:38:37.629 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131444765 ms)
2022-10-07 03:38:37.630 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131444765 ms)
2022-10-07 03:38:37.630 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39122)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131444766 ms)
2022-10-07 03:38:40.709 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131447845 ms)
2022-10-07 03:38:40.710 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131447845 ms)
2022-10-07 03:38:40.710 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39126)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131447846 ms)
2022-10-07 03:38:45.799 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131452934 ms)
2022-10-07 03:38:45.799 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131452934 ms)
2022-10-07 03:38:45.800 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39132)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131452935 ms)
2022-10-07 03:38:53.880 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131461016 ms)
2022-10-07 03:38:53.881 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131461016 ms)
2022-10-07 03:38:53.882 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39144)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131461018 ms)
2022-10-07 03:38:58.980 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131466115 ms)
2022-10-07 03:38:58.981 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131466116 ms)
2022-10-07 03:38:58.982 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39150)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131466117 ms)
2022-10-07 03:38:59.019 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131466154 ms)
2022-10-07 03:38:59.019 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131466155 ms)
2022-10-07 03:38:59.021 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39152)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131466156 ms)
2022-10-07 03:39:07.089 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131474224 ms)
2022-10-07 03:39:07.090 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131474225 ms)
2022-10-07 03:39:07.091 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39162)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131474226 ms)
2022-10-07 03:39:08.169 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131475304 ms)
2022-10-07 03:39:08.169 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131475305 ms)
2022-10-07 03:39:08.171 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39164)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131475306 ms)
2022-10-07 03:39:14.256 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131481392 ms)
2022-10-07 03:39:14.257 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131481392 ms)
2022-10-07 03:39:14.258 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39172)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131481394 ms)
2022-10-07 03:39:23.359 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131490495 ms)
2022-10-07 03:39:23.360 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131490495 ms)
2022-10-07 03:39:23.361 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39182)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131490497 ms)
2022-10-07 03:39:24.448 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131491584 ms)
2022-10-07 03:39:24.449 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131491584 ms)
2022-10-07 03:39:24.450 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39184)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131491586 ms)
2022-10-07 03:39:27.519 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131494654 ms)
2022-10-07 03:39:27.519 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131494655 ms)
2022-10-07 03:39:27.521 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39188)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131494656 ms)
2022-10-07 03:39:32.353 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131499488 ms)
2022-10-07 03:39:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131499489 ms)
2022-10-07 03:39:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:39:31.122681+00:00', 'runtime': '2131500.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.534', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131499490 ms)
2022-10-07 03:39:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:38:31.123841+00:00', 'runtime': '2131440.002', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.548', 't_hs': '21', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131499490 ms)
2022-10-07 03:39:34.589 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131501725 ms)
2022-10-07 03:39:34.589 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131501725 ms)
2022-10-07 03:39:34.590 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39198)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131501725 ms)
2022-10-07 03:39:39.679 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131506814 ms)
2022-10-07 03:39:39.679 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131506815 ms)
2022-10-07 03:39:39.681 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39204)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131506816 ms)
2022-10-07 03:39:39.719 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131506854 ms)
2022-10-07 03:39:39.719 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131506855 ms)
2022-10-07 03:39:39.721 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39206)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131506856 ms)
2022-10-07 03:39:46.829 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131513965 ms)
2022-10-07 03:39:46.830 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131513965 ms)
2022-10-07 03:39:46.831 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39214)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131513967 ms)
2022-10-07 03:39:49.919 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131517055 ms)
2022-10-07 03:39:49.920 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131517055 ms)
2022-10-07 03:39:49.922 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39218)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131517057 ms)
2022-10-07 03:40:02.017 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131529152 ms)
2022-10-07 03:40:02.017 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131529153 ms)
2022-10-07 03:40:02.019 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39232)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131529154 ms)
2022-10-07 03:40:28.118 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131555254 ms)
2022-10-07 03:40:28.119 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131555254 ms)
2022-10-07 03:40:28.120 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39260)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131555255 ms)
2022-10-07 03:40:32.350 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131559485 ms)
2022-10-07 03:40:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131559486 ms)
2022-10-07 03:40:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:40:31.122606+00:00', 'runtime': '2131560.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.534', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131559490 ms)
2022-10-07 03:40:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:39:31.122681+00:00', 'runtime': '2131500.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.534', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131559491 ms)
2022-10-07 03:40:39.216 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131566351 ms)
2022-10-07 03:40:39.216 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131566352 ms)
2022-10-07 03:40:39.219 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39272)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131566355 ms)
2022-10-07 03:40:40.277 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131567412 ms)
2022-10-07 03:40:40.277 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131567413 ms)
2022-10-07 03:40:40.280 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39274)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131567416 ms)
2022-10-07 03:40:43.360 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131570495 ms)
2022-10-07 03:40:43.360 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131570495 ms)
2022-10-07 03:40:43.361 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39278)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131570496 ms)
2022-10-07 03:40:52.460 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131579595 ms)
2022-10-07 03:40:52.460 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131579596 ms)
2022-10-07 03:40:52.462 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39290)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131579597 ms)
2022-10-07 03:41:02.538 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131589674 ms)
2022-10-07 03:41:02.539 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131589675 ms)
2022-10-07 03:41:02.541 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39302)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131589676 ms)
2022-10-07 03:41:03.628 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131590763 ms)
2022-10-07 03:41:03.628 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131590764 ms)
2022-10-07 03:41:03.630 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39306)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131590766 ms)
2022-10-07 03:41:07.679 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131594815 ms)
2022-10-07 03:41:07.680 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131594815 ms)
2022-10-07 03:41:07.680 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39318)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131594816 ms)
2022-10-07 03:41:27.780 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131614915 ms)
2022-10-07 03:41:27.780 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131614916 ms)
2022-10-07 03:41:27.782 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39342)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131614917 ms)
2022-10-07 03:41:31.828 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131618964 ms)
2022-10-07 03:41:31.829 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131618964 ms)
2022-10-07 03:41:31.830 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39348)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131618966 ms)
2022-10-07 03:41:32.350 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131619485 ms)
2022-10-07 03:41:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131619486 ms)
2022-10-07 03:41:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:41:31.122586+00:00', 'runtime': '2131620.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.565', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131619489 ms)
2022-10-07 03:41:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:40:31.122606+00:00', 'runtime': '2131560.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.534', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131619490 ms)
2022-10-07 03:41:44.929 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131632064 ms)
2022-10-07 03:41:44.930 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131632065 ms)
2022-10-07 03:41:44.931 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39362)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131632066 ms)
2022-10-07 03:42:25.059 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131672194 ms)
2022-10-07 03:42:25.059 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131672195 ms)
2022-10-07 03:42:25.061 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39404)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131672196 ms)
2022-10-07 03:42:26.129 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131673264 ms)
2022-10-07 03:42:26.130 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131673265 ms)
2022-10-07 03:42:26.131 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39406)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131673266 ms)
2022-10-07 03:42:27.208 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131674343 ms)
2022-10-07 03:42:27.208 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131674344 ms)
2022-10-07 03:42:27.210 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39408)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131674345 ms)
2022-10-07 03:42:28.294 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131675430 ms)
2022-10-07 03:42:28.295 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131675430 ms)
2022-10-07 03:42:28.296 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39410)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131675432 ms)
2022-10-07 03:42:32.362 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131679497 ms)
2022-10-07 03:42:32.362 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131679498 ms)
2022-10-07 03:42:32.364 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:42:31.122584+00:00', 'runtime': '2131680.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.524', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131679499 ms)
2022-10-07 03:42:32.364 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:41:31.122586+00:00', 'runtime': '2131620.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.565', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131679499 ms)
2022-10-07 03:42:43.388 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131690523 ms)
2022-10-07 03:42:43.388 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131690524 ms)
2022-10-07 03:42:43.389 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39428)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131690525 ms)
2022-10-07 03:42:43.418 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131690553 ms)
2022-10-07 03:42:43.418 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131690554 ms)
2022-10-07 03:42:43.419 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39430)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131690554 ms)
2022-10-07 03:42:47.457 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131694593 ms)
2022-10-07 03:42:47.458 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131694593 ms)
2022-10-07 03:42:47.459 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39438)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131694595 ms)
2022-10-07 03:42:56.528 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131703663 ms)
2022-10-07 03:42:56.529 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131703664 ms)
2022-10-07 03:42:56.530 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39448)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131703665 ms)
2022-10-07 03:43:02.608 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131709743 ms)
2022-10-07 03:43:02.608 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131709744 ms)
2022-10-07 03:43:02.610 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39456)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131709745 ms)
2022-10-07 03:43:06.696 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131713832 ms)
2022-10-07 03:43:06.697 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131713832 ms)
2022-10-07 03:43:06.698 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39462)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131713834 ms)
2022-10-07 03:43:14.776 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131721911 ms)
2022-10-07 03:43:14.776 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131721912 ms)
2022-10-07 03:43:14.778 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39472)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131721913 ms)
2022-10-07 03:43:29.907 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131737042 ms)
2022-10-07 03:43:29.908 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131737043 ms)
2022-10-07 03:43:29.909 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39488)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131737044 ms)
2022-10-07 03:43:32.348 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131739483 ms)
2022-10-07 03:43:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131739484 ms)
2022-10-07 03:43:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:43:31.122625+00:00', 'runtime': '2131740.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131739485 ms)
2022-10-07 03:43:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:42:31.122584+00:00', 'runtime': '2131680.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.524', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131739485 ms)
2022-10-07 03:43:41.968 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131749104 ms)
2022-10-07 03:43:41.969 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131749104 ms)
2022-10-07 03:43:41.970 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39502)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131749106 ms)
2022-10-07 03:43:53.057 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131760193 ms)
2022-10-07 03:43:53.058 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131760193 ms)
2022-10-07 03:43:53.059 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39514)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131760195 ms)
2022-10-07 03:44:04.175 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131771310 ms)
2022-10-07 03:44:04.175 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131771311 ms)
2022-10-07 03:44:04.177 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39526)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131771312 ms)
2022-10-07 03:44:05.248 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131772383 ms)
2022-10-07 03:44:05.248 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131772384 ms)
2022-10-07 03:44:05.250 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39528)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131772385 ms)
2022-10-07 03:44:06.347 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131773483 ms)
2022-10-07 03:44:06.348 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131773483 ms)
2022-10-07 03:44:06.349 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39530)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131773485 ms)
2022-10-07 03:44:09.439 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131776574 ms)
2022-10-07 03:44:09.439 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131776575 ms)
2022-10-07 03:44:09.440 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39534)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131776576 ms)
2022-10-07 03:44:18.546 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131785682 ms)
2022-10-07 03:44:18.547 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131785682 ms)
2022-10-07 03:44:18.548 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39544)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131785684 ms)
2022-10-07 03:44:24.618 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131791754 ms)
2022-10-07 03:44:24.619 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131791754 ms)
2022-10-07 03:44:24.621 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39552)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131791757 ms)
2022-10-07 03:44:32.365 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131799500 ms)
2022-10-07 03:44:32.366 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131799501 ms)
2022-10-07 03:44:32.368 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:44:31.122625+00:00', 'runtime': '2131800.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.565', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131799503 ms)
2022-10-07 03:44:32.370 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:43:31.122625+00:00', 'runtime': '2131740.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131799505 ms)
2022-10-07 03:44:43.707 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131810843 ms)
2022-10-07 03:44:43.708 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131810843 ms)
2022-10-07 03:44:43.708 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39574)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131810844 ms)
2022-10-07 03:44:50.776 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131817911 ms)
2022-10-07 03:44:50.776 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131817912 ms)
2022-10-07 03:44:50.777 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39584)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131817912 ms)
2022-10-07 03:44:54.848 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131821984 ms)
2022-10-07 03:44:54.849 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131821984 ms)
2022-10-07 03:44:54.850 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39590)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131821986 ms)
2022-10-07 03:45:08.938 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131836073 ms)
2022-10-07 03:45:08.938 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131836073 ms)
2022-10-07 03:45:08.939 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39606)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131836075 ms)
2022-10-07 03:45:32.048 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131859184 ms)
2022-10-07 03:45:32.048 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131859184 ms)
2022-10-07 03:45:32.049 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39630)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131859184 ms)
2022-10-07 03:45:32.352 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131859487 ms)
2022-10-07 03:45:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131859488 ms)
2022-10-07 03:45:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:45:31.122578+00:00', 'runtime': '2131860.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131859489 ms)
2022-10-07 03:45:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:44:31.122625+00:00', 'runtime': '2131800.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.565', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131859489 ms)
2022-10-07 03:45:35.147 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131862283 ms)
2022-10-07 03:45:35.148 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131862283 ms)
2022-10-07 03:45:35.148 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39634)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131862284 ms)
2022-10-07 03:45:40.236 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131867371 ms)
2022-10-07 03:45:40.236 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131867371 ms)
2022-10-07 03:45:40.237 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39640)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131867373 ms)
2022-10-07 03:45:44.288 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131871423 ms)
2022-10-07 03:45:44.288 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131871424 ms)
2022-10-07 03:45:44.290 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39646)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131871425 ms)
2022-10-07 03:45:47.364 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131874500 ms)
2022-10-07 03:45:47.365 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131874500 ms)
2022-10-07 03:45:47.366 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39650)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131874502 ms)
2022-10-07 03:45:53.455 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131880591 ms)
2022-10-07 03:45:53.456 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131880591 ms)
2022-10-07 03:45:53.457 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39658)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131880593 ms)
2022-10-07 03:45:54.515 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131881651 ms)
2022-10-07 03:45:54.516 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131881651 ms)
2022-10-07 03:45:54.517 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39660)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131881653 ms)
2022-10-07 03:46:01.614 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131888750 ms)
2022-10-07 03:46:01.615 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131888750 ms)
2022-10-07 03:46:01.616 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39668)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131888751 ms)
2022-10-07 03:46:11.688 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131898824 ms)
2022-10-07 03:46:11.689 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131898824 ms)
2022-10-07 03:46:11.690 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39680)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131898826 ms)
2022-10-07 03:46:14.806 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131901941 ms)
2022-10-07 03:46:14.806 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131901942 ms)
2022-10-07 03:46:14.808 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39684)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131901943 ms)
2022-10-07 03:46:32.355 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131919491 ms)
2022-10-07 03:46:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131919491 ms)
2022-10-07 03:46:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:46:31.122643+00:00', 'runtime': '2131920.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.548', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131919492 ms)
2022-10-07 03:46:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:45:31.122578+00:00', 'runtime': '2131860.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131919493 ms)
2022-10-07 03:46:41.928 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131929064 ms)
2022-10-07 03:46:41.929 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131929064 ms)
2022-10-07 03:46:41.929 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39714)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131929065 ms)
2022-10-07 03:46:53.007 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131940143 ms)
2022-10-07 03:46:53.008 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131940143 ms)
2022-10-07 03:46:53.009 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39728)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131940144 ms)
2022-10-07 03:46:54.087 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131941223 ms)
2022-10-07 03:46:54.088 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131941223 ms)
2022-10-07 03:46:54.089 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39730)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131941225 ms)
2022-10-07 03:47:03.185 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131950321 ms)
2022-10-07 03:47:03.186 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131950321 ms)
2022-10-07 03:47:03.187 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39740)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131950322 ms)
2022-10-07 03:47:04.267 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131951403 ms)
2022-10-07 03:47:04.268 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131951403 ms)
2022-10-07 03:47:04.269 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39742)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131951404 ms)
2022-10-07 03:47:11.367 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131958503 ms)
2022-10-07 03:47:11.368 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131958503 ms)
2022-10-07 03:47:11.369 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39750)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131958504 ms)
2022-10-07 03:47:15.418 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131962553 ms)
2022-10-07 03:47:15.418 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131962554 ms)
2022-10-07 03:47:15.420 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39756)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131962555 ms)
2022-10-07 03:47:21.498 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131968633 ms)
2022-10-07 03:47:21.499 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131968634 ms)
2022-10-07 03:47:21.500 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39764)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131968635 ms)
2022-10-07 03:47:21.538 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131968674 ms)
2022-10-07 03:47:21.539 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131968674 ms)
2022-10-07 03:47:21.540 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39766)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131968675 ms)
2022-10-07 03:47:22.628 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131969763 ms)
2022-10-07 03:47:22.628 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131969764 ms)
2022-10-07 03:47:22.630 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39768)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131969765 ms)
2022-10-07 03:47:32.355 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2131979490 ms)
2022-10-07 03:47:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2131979491 ms)
2022-10-07 03:47:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:47:31.122626+00:00', 'runtime': '2131980.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.556', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131979492 ms)
2022-10-07 03:47:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:46:31.122643+00:00', 'runtime': '2131920.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.548', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2131979492 ms)
2022-10-07 03:47:37.707 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2131984843 ms)
2022-10-07 03:47:37.708 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2131984843 ms)
2022-10-07 03:47:37.709 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39786)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2131984844 ms)
2022-10-07 03:47:55.814 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132002950 ms)
2022-10-07 03:47:55.815 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132002950 ms)
2022-10-07 03:47:55.816 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39806)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132002952 ms)
2022-10-07 03:48:00.903 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132008038 ms)
2022-10-07 03:48:00.903 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132008039 ms)
2022-10-07 03:48:00.905 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39812)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132008040 ms)
2022-10-07 03:48:00.947 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132008083 ms)
2022-10-07 03:48:00.948 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132008083 ms)
2022-10-07 03:48:00.950 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39814)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132008086 ms)
2022-10-07 03:48:02.018 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132009153 ms)
2022-10-07 03:48:02.018 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132009154 ms)
2022-10-07 03:48:02.019 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39816)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132009155 ms)
2022-10-07 03:48:05.097 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132012232 ms)
2022-10-07 03:48:05.098 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132012233 ms)
2022-10-07 03:48:05.099 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39820)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132012234 ms)
2022-10-07 03:48:11.177 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132018312 ms)
2022-10-07 03:48:11.177 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132018313 ms)
2022-10-07 03:48:11.179 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39828)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132018314 ms)
2022-10-07 03:48:11.224 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132018359 ms)
2022-10-07 03:48:11.224 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132018360 ms)
2022-10-07 03:48:11.226 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39830)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132018361 ms)
2022-10-07 03:48:24.297 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132031433 ms)
2022-10-07 03:48:24.298 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132031433 ms)
2022-10-07 03:48:24.299 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39844)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132031434 ms)
2022-10-07 03:48:27.389 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132034524 ms)
2022-10-07 03:48:27.390 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132034525 ms)
2022-10-07 03:48:27.391 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39848)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132034526 ms)
2022-10-07 03:48:31.437 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132038573 ms)
2022-10-07 03:48:31.438 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132038573 ms)
2022-10-07 03:48:31.438 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39854)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132038574 ms)
2022-10-07 03:48:32.351 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132039486 ms)
2022-10-07 03:48:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132039487 ms)
2022-10-07 03:48:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:48:31.122642+00:00', 'runtime': '2132040.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132039489 ms)
2022-10-07 03:48:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:47:31.122626+00:00', 'runtime': '2131980.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.556', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.4', 'ahl_t': '507.4', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.0', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132039490 ms)
2022-10-07 03:48:36.511 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132043646 ms)
2022-10-07 03:48:36.511 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132043647 ms)
2022-10-07 03:48:36.512 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39860)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132043647 ms)
2022-10-07 03:48:41.578 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132048713 ms)
2022-10-07 03:48:41.578 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132048714 ms)
2022-10-07 03:48:41.579 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39866)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132048714 ms)
2022-10-07 03:48:50.638 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132057773 ms)
2022-10-07 03:48:50.638 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132057774 ms)
2022-10-07 03:48:50.639 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39878)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132057775 ms)
2022-10-07 03:48:50.678 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132057813 ms)
2022-10-07 03:48:50.678 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132057814 ms)
2022-10-07 03:48:50.679 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39880)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132057815 ms)
2022-10-07 03:48:57.807 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132064942 ms)
2022-10-07 03:48:57.807 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132064943 ms)
2022-10-07 03:48:57.809 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39888)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132064944 ms)
2022-10-07 03:49:04.884 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132072019 ms)
2022-10-07 03:49:04.884 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132072020 ms)
2022-10-07 03:49:04.886 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39896)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132072021 ms)
2022-10-07 03:49:04.917 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132072052 ms)
2022-10-07 03:49:04.917 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132072053 ms)
2022-10-07 03:49:04.918 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39898)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132072054 ms)
2022-10-07 03:49:09.997 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132077133 ms)
2022-10-07 03:49:09.998 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132077133 ms)
2022-10-07 03:49:09.999 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39904)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132077135 ms)
2022-10-07 03:49:14.067 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132081202 ms)
2022-10-07 03:49:14.067 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132081203 ms)
2022-10-07 03:49:14.069 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39910)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132081204 ms)
2022-10-07 03:49:14.108 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132081243 ms)
2022-10-07 03:49:14.108 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132081244 ms)
2022-10-07 03:49:14.110 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39912)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132081245 ms)
2022-10-07 03:49:15.207 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132082343 ms)
2022-10-07 03:49:15.208 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132082343 ms)
2022-10-07 03:49:15.209 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39914)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132082345 ms)
2022-10-07 03:49:15.247 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132082383 ms)
2022-10-07 03:49:15.248 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132082383 ms)
2022-10-07 03:49:15.249 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39916)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132082385 ms)
2022-10-07 03:49:23.315 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132090451 ms)
2022-10-07 03:49:23.316 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132090451 ms)
2022-10-07 03:49:23.317 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39926)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132090453 ms)
2022-10-07 03:49:32.352 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132099488 ms)
2022-10-07 03:49:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132099489 ms)
2022-10-07 03:49:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:49:31.122604+00:00', 'runtime': '2132100.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.529', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132099491 ms)
2022-10-07 03:49:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:48:31.122642+00:00', 'runtime': '2132040.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132099492 ms)
2022-10-07 03:49:33.386 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132100521 ms)
2022-10-07 03:49:33.386 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132100522 ms)
2022-10-07 03:49:33.388 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39938)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132100523 ms)
2022-10-07 03:49:36.477 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132103612 ms)
2022-10-07 03:49:36.477 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132103613 ms)
2022-10-07 03:49:36.479 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39942)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132103614 ms)
2022-10-07 03:49:39.547 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132106683 ms)
2022-10-07 03:49:39.548 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132106683 ms)
2022-10-07 03:49:39.549 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39946)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132106685 ms)
2022-10-07 03:49:41.617 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132108752 ms)
2022-10-07 03:49:41.617 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132108753 ms)
2022-10-07 03:49:41.619 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39950)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132108754 ms)
2022-10-07 03:49:42.697 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132109832 ms)
2022-10-07 03:49:42.697 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132109833 ms)
2022-10-07 03:49:42.699 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39952)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132109834 ms)
2022-10-07 03:49:46.783 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132113918 ms)
2022-10-07 03:49:46.784 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132113919 ms)
2022-10-07 03:49:46.785 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39958)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132113920 ms)
2022-10-07 03:49:58.868 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132126003 ms)
2022-10-07 03:49:58.868 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132126003 ms)
2022-10-07 03:49:58.869 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39972)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132126005 ms)
2022-10-07 03:49:58.907 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132126042 ms)
2022-10-07 03:49:58.907 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132126043 ms)
2022-10-07 03:49:58.908 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39974)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132126044 ms)
2022-10-07 03:50:10.968 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132138103 ms)
2022-10-07 03:50:10.968 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132138104 ms)
2022-10-07 03:50:10.970 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39988)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132138105 ms)
2022-10-07 03:50:11.008 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132138143 ms)
2022-10-07 03:50:11.008 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132138144 ms)
2022-10-07 03:50:11.010 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 39990)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132138145 ms)
2022-10-07 03:50:22.098 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132149233 ms)
2022-10-07 03:50:22.098 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132149234 ms)
2022-10-07 03:50:22.100 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40002)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132149235 ms)
2022-10-07 03:50:25.168 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132152303 ms)
2022-10-07 03:50:25.168 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132152304 ms)
2022-10-07 03:50:25.170 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40006)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132152305 ms)
2022-10-07 03:50:32.237 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132159372 ms)
2022-10-07 03:50:32.237 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132159372 ms)
2022-10-07 03:50:32.237 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40014)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132159373 ms)
2022-10-07 03:50:32.361 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132159497 ms)
2022-10-07 03:50:32.362 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132159497 ms)
2022-10-07 03:50:32.363 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:50:31.122583+00:00', 'runtime': '2132160.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.529', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132159498 ms)
2022-10-07 03:50:32.363 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:49:31.122604+00:00', 'runtime': '2132100.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.529', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132159499 ms)
2022-10-07 03:50:36.308 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132163443 ms)
2022-10-07 03:50:36.308 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132163443 ms)
2022-10-07 03:50:36.308 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40022)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132163444 ms)
2022-10-07 03:50:55.397 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132182533 ms)
2022-10-07 03:50:55.398 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132182533 ms)
2022-10-07 03:50:55.399 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40044)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132182534 ms)
2022-10-07 03:50:55.437 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132182573 ms)
2022-10-07 03:50:55.438 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132182573 ms)
2022-10-07 03:50:55.439 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40046)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132182575 ms)
2022-10-07 03:50:59.516 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132186652 ms)
2022-10-07 03:50:59.517 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132186652 ms)
2022-10-07 03:50:59.518 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40052)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132186654 ms)
2022-10-07 03:50:59.565 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132186701 ms)
2022-10-07 03:50:59.566 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132186701 ms)
2022-10-07 03:50:59.567 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40054)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132186703 ms)
2022-10-07 03:51:09.654 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132196790 ms)
2022-10-07 03:51:09.655 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132196790 ms)
2022-10-07 03:51:09.656 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40076)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132196792 ms)
2022-10-07 03:51:13.708 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132200843 ms)
2022-10-07 03:51:13.708 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132200843 ms)
2022-10-07 03:51:13.709 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40082)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132200844 ms)
2022-10-07 03:51:23.756 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132210892 ms)
2022-10-07 03:51:23.757 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132210892 ms)
2022-10-07 03:51:23.757 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40094)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132210893 ms)
2022-10-07 03:51:23.788 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132210923 ms)
2022-10-07 03:51:23.788 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132210923 ms)
2022-10-07 03:51:23.788 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40096)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132210924 ms)
2022-10-07 03:51:25.858 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132212993 ms)
2022-10-07 03:51:25.858 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132212994 ms)
2022-10-07 03:51:25.860 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40100)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132212995 ms)
2022-10-07 03:51:26.928 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132214063 ms)
2022-10-07 03:51:26.928 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132214064 ms)
2022-10-07 03:51:26.930 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40102)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132214065 ms)
2022-10-07 03:51:31.014 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132218150 ms)
2022-10-07 03:51:31.015 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132218150 ms)
2022-10-07 03:51:31.016 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40108)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132218152 ms)
2022-10-07 03:51:32.348 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132219484 ms)
2022-10-07 03:51:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132219484 ms)
2022-10-07 03:51:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:51:31.122701+00:00', 'runtime': '2132220.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.546', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132219485 ms)
2022-10-07 03:51:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:50:31.122583+00:00', 'runtime': '2132160.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.529', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132219486 ms)
2022-10-07 03:51:49.116 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132236252 ms)
2022-10-07 03:51:49.117 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132236252 ms)
2022-10-07 03:51:49.118 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40128)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132236254 ms)
2022-10-07 03:52:06.217 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132253352 ms)
2022-10-07 03:52:06.217 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132253353 ms)
2022-10-07 03:52:06.218 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40146)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132253354 ms)
2022-10-07 03:52:06.257 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132253392 ms)
2022-10-07 03:52:06.257 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132253393 ms)
2022-10-07 03:52:06.259 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40148)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132253394 ms)
2022-10-07 03:52:07.337 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132254473 ms)
2022-10-07 03:52:07.338 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132254473 ms)
2022-10-07 03:52:07.339 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40150)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132254474 ms)
2022-10-07 03:52:15.397 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132262532 ms)
2022-10-07 03:52:15.397 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132262533 ms)
2022-10-07 03:52:15.399 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40160)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132262534 ms)
2022-10-07 03:52:18.447 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132265582 ms)
2022-10-07 03:52:18.447 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132265583 ms)
2022-10-07 03:52:18.449 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40164)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132265584 ms)
2022-10-07 03:52:19.527 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132266663 ms)
2022-10-07 03:52:19.528 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132266663 ms)
2022-10-07 03:52:19.529 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40166)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132266665 ms)
2022-10-07 03:52:20.587 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132267722 ms)
2022-10-07 03:52:20.587 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132267723 ms)
2022-10-07 03:52:20.588 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40168)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132267724 ms)
2022-10-07 03:52:22.657 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132269793 ms)
2022-10-07 03:52:22.658 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132269793 ms)
2022-10-07 03:52:22.659 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40172)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132269795 ms)
2022-10-07 03:52:23.757 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132270892 ms)
2022-10-07 03:52:23.757 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132270893 ms)
2022-10-07 03:52:23.758 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40174)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132270894 ms)
2022-10-07 03:52:26.857 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132273992 ms)
2022-10-07 03:52:26.857 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132273993 ms)
2022-10-07 03:52:26.859 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40178)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132273994 ms)
2022-10-07 03:52:29.976 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132277112 ms)
2022-10-07 03:52:29.977 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132277112 ms)
2022-10-07 03:52:29.978 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40182)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132277114 ms)
2022-10-07 03:52:31.024 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132278160 ms)
2022-10-07 03:52:31.025 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132278160 ms)
2022-10-07 03:52:31.026 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40184)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132278162 ms)
2022-10-07 03:52:31.067 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132278203 ms)
2022-10-07 03:52:31.068 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132278203 ms)
2022-10-07 03:52:31.069 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40186)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132278205 ms)
2022-10-07 03:52:32.336 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132279472 ms)
2022-10-07 03:52:32.337 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132279472 ms)
2022-10-07 03:52:32.338 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:52:31.122628+00:00', 'runtime': '2132280.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.582', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132279473 ms)
2022-10-07 03:52:32.338 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:51:31.122701+00:00', 'runtime': '2132220.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.546', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132279474 ms)
2022-10-07 03:52:35.144 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132282279 ms)
2022-10-07 03:52:35.144 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132282280 ms)
2022-10-07 03:52:35.145 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40194)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132282280 ms)
2022-10-07 03:52:49.227 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132296363 ms)
2022-10-07 03:52:49.228 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132296363 ms)
2022-10-07 03:52:49.228 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40212)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132296363 ms)
2022-10-07 03:52:50.317 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132297453 ms)
2022-10-07 03:52:50.318 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132297453 ms)
2022-10-07 03:52:50.318 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40214)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132297454 ms)
2022-10-07 03:52:50.347 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132297483 ms)
2022-10-07 03:52:50.348 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132297483 ms)
2022-10-07 03:52:50.348 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40216)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132297484 ms)
2022-10-07 03:52:59.416 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132306551 ms)
2022-10-07 03:52:59.416 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132306552 ms)
2022-10-07 03:52:59.418 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40226)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132306553 ms)
2022-10-07 03:53:03.494 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132310630 ms)
2022-10-07 03:53:03.495 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132310630 ms)
2022-10-07 03:53:03.496 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40232)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132310632 ms)
2022-10-07 03:53:05.556 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132312691 ms)
2022-10-07 03:53:05.556 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132312692 ms)
2022-10-07 03:53:05.558 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40236)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132312693 ms)
2022-10-07 03:53:05.597 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132312732 ms)
2022-10-07 03:53:05.597 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132312733 ms)
2022-10-07 03:53:05.599 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40238)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132312734 ms)
2022-10-07 03:53:18.703 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132325839 ms)
2022-10-07 03:53:18.704 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132325839 ms)
2022-10-07 03:53:18.705 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40252)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132325841 ms)
2022-10-07 03:53:32.368 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132339503 ms)
2022-10-07 03:53:32.369 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132339504 ms)
2022-10-07 03:53:32.371 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:53:31.122672+00:00', 'runtime': '2132340.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.58', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132339506 ms)
2022-10-07 03:53:32.372 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:52:31.122628+00:00', 'runtime': '2132280.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.582', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132339507 ms)
2022-10-07 03:53:34.797 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132341932 ms)
2022-10-07 03:53:34.798 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132341933 ms)
2022-10-07 03:53:34.799 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40270)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132341934 ms)
2022-10-07 03:53:35.903 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132343039 ms)
2022-10-07 03:53:35.904 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132343039 ms)
2022-10-07 03:53:35.905 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40272)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132343041 ms)
2022-10-07 03:53:36.977 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132344112 ms)
2022-10-07 03:53:36.977 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132344113 ms)
2022-10-07 03:53:36.979 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40274)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132344114 ms)
2022-10-07 03:53:47.065 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132354200 ms)
2022-10-07 03:53:47.065 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132354201 ms)
2022-10-07 03:53:47.066 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40286)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132354201 ms)
2022-10-07 03:53:47.105 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132354240 ms)
2022-10-07 03:53:47.106 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132354241 ms)
2022-10-07 03:53:47.106 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40288)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132354242 ms)
2022-10-07 03:53:47.147 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132354282 ms)
2022-10-07 03:53:47.147 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132354282 ms)
2022-10-07 03:53:47.148 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40290)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132354283 ms)
2022-10-07 03:53:50.246 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132357382 ms)
2022-10-07 03:53:50.247 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132357382 ms)
2022-10-07 03:53:50.248 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40294)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132357383 ms)
2022-10-07 03:53:53.316 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132360452 ms)
2022-10-07 03:53:53.317 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132360452 ms)
2022-10-07 03:53:53.318 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40298)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132360453 ms)
2022-10-07 03:53:54.446 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132361581 ms)
2022-10-07 03:53:54.446 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132361582 ms)
2022-10-07 03:53:54.447 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40300)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132361582 ms)
2022-10-07 03:54:08.527 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132375663 ms)
2022-10-07 03:54:08.528 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132375663 ms)
2022-10-07 03:54:08.529 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40316)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132375664 ms)
2022-10-07 03:54:08.566 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132375702 ms)
2022-10-07 03:54:08.567 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132375702 ms)
2022-10-07 03:54:08.568 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40318)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132375703 ms)
2022-10-07 03:54:12.644 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132379779 ms)
2022-10-07 03:54:12.645 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132379780 ms)
2022-10-07 03:54:12.646 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40324)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132379781 ms)
2022-10-07 03:54:15.703 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132382839 ms)
2022-10-07 03:54:15.704 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132382839 ms)
2022-10-07 03:54:15.705 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40328)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132382841 ms)
2022-10-07 03:54:15.737 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132382873 ms)
2022-10-07 03:54:15.738 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132382873 ms)
2022-10-07 03:54:15.739 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40330)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132382874 ms)
2022-10-07 03:54:31.806 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132398942 ms)
2022-10-07 03:54:31.806 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132398942 ms)
2022-10-07 03:54:31.807 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40348)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132398943 ms)
2022-10-07 03:54:31.836 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132398972 ms)
2022-10-07 03:54:31.836 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132398972 ms)
2022-10-07 03:54:31.837 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40350)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132398973 ms)
2022-10-07 03:54:32.344 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132399479 ms)
2022-10-07 03:54:32.344 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132399479 ms)
2022-10-07 03:54:32.345 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:54:31.122609+00:00', 'runtime': '2132400.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.568', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132399480 ms)
2022-10-07 03:54:32.345 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:53:31.122672+00:00', 'runtime': '2132340.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.58', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132399481 ms)
2022-10-07 03:54:32.946 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132400082 ms)
2022-10-07 03:54:32.947 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132400082 ms)
2022-10-07 03:54:32.947 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40352)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132400083 ms)
2022-10-07 03:54:38.038 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132405173 ms)
2022-10-07 03:54:38.038 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132405174 ms)
2022-10-07 03:54:38.040 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40358)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132405175 ms)
2022-10-07 03:54:39.087 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132406223 ms)
2022-10-07 03:54:39.088 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132406223 ms)
2022-10-07 03:54:39.088 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40360)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132406224 ms)
2022-10-07 03:54:39.117 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132406253 ms)
2022-10-07 03:54:39.118 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132406253 ms)
2022-10-07 03:54:39.118 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40362)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132406253 ms)
2022-10-07 03:54:41.173 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132408308 ms)
2022-10-07 03:54:41.173 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132408309 ms)
2022-10-07 03:54:41.174 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40366)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132408309 ms)
2022-10-07 03:54:42.246 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132409382 ms)
2022-10-07 03:54:42.247 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132409382 ms)
2022-10-07 03:54:42.247 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40368)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132409382 ms)
2022-10-07 03:54:47.306 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132414442 ms)
2022-10-07 03:54:47.307 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132414442 ms)
2022-10-07 03:54:47.308 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40376)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132414443 ms)
2022-10-07 03:55:20.405 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132447540 ms)
2022-10-07 03:55:20.405 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132447541 ms)
2022-10-07 03:55:20.407 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40410)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132447542 ms)
2022-10-07 03:55:23.513 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132450649 ms)
2022-10-07 03:55:23.514 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132450649 ms)
2022-10-07 03:55:23.515 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40414)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132450651 ms)
2022-10-07 03:55:25.575 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132452711 ms)
2022-10-07 03:55:25.576 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132452711 ms)
2022-10-07 03:55:25.577 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40418)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132452713 ms)
2022-10-07 03:55:28.685 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132455820 ms)
2022-10-07 03:55:28.685 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132455821 ms)
2022-10-07 03:55:28.687 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40422)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132455822 ms)
2022-10-07 03:55:29.764 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132456899 ms)
2022-10-07 03:55:29.764 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132456900 ms)
2022-10-07 03:55:29.766 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40424)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132456901 ms)
2022-10-07 03:55:29.797 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132456932 ms)
2022-10-07 03:55:29.798 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132456933 ms)
2022-10-07 03:55:29.799 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40426)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132456934 ms)
2022-10-07 03:55:32.347 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132459482 ms)
2022-10-07 03:55:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132459483 ms)
2022-10-07 03:55:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:55:31.122601+00:00', 'runtime': '2132460.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.573', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132459484 ms)
2022-10-07 03:55:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:54:31.122609+00:00', 'runtime': '2132400.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.568', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132459484 ms)
2022-10-07 03:55:33.873 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132461008 ms)
2022-10-07 03:55:33.873 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132461008 ms)
2022-10-07 03:55:33.874 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40434)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132461009 ms)
2022-10-07 03:55:40.949 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132468084 ms)
2022-10-07 03:55:40.949 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132468085 ms)
2022-10-07 03:55:40.950 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40442)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132468086 ms)
2022-10-07 03:55:52.044 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132479179 ms)
2022-10-07 03:55:52.044 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132479180 ms)
2022-10-07 03:55:52.046 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40454)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132479181 ms)
2022-10-07 03:55:55.136 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132482271 ms)
2022-10-07 03:55:55.136 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132482272 ms)
2022-10-07 03:55:55.137 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40458)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132482273 ms)
2022-10-07 03:56:00.213 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132487348 ms)
2022-10-07 03:56:00.214 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132487349 ms)
2022-10-07 03:56:00.215 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40464)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132487350 ms)
2022-10-07 03:56:00.247 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132487383 ms)
2022-10-07 03:56:00.248 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132487383 ms)
2022-10-07 03:56:00.249 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40466)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132487384 ms)
2022-10-07 03:56:04.367 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132491503 ms)
2022-10-07 03:56:04.368 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132491503 ms)
2022-10-07 03:56:04.369 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40472)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132491504 ms)
2022-10-07 03:56:31.441 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132518576 ms)
2022-10-07 03:56:31.442 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132518577 ms)
2022-10-07 03:56:31.446 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:56:31.122673+00:00', 'runtime': '2132520.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132518581 ms)
2022-10-07 03:56:31.447 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:55:31.122601+00:00', 'runtime': '2132460.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.573', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132518582 ms)
2022-10-07 03:56:32.447 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132519582 ms)
2022-10-07 03:56:32.447 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132519583 ms)
2022-10-07 03:56:32.448 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40504)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132519583 ms)
2022-10-07 03:56:32.489 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132519624 ms)
2022-10-07 03:56:32.489 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132519625 ms)
2022-10-07 03:56:32.491 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40506)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132519626 ms)
2022-10-07 03:56:33.547 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132520683 ms)
2022-10-07 03:56:33.548 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132520683 ms)
2022-10-07 03:56:33.549 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40508)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132520684 ms)
2022-10-07 03:56:41.626 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132528761 ms)
2022-10-07 03:56:41.626 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132528762 ms)
2022-10-07 03:56:41.627 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40518)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132528762 ms)
2022-10-07 03:56:41.657 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132528792 ms)
2022-10-07 03:56:41.657 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132528793 ms)
2022-10-07 03:56:41.658 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40520)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132528793 ms)
2022-10-07 03:56:42.697 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132529832 ms)
2022-10-07 03:56:42.697 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132529833 ms)
2022-10-07 03:56:42.698 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40522)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132529833 ms)
2022-10-07 03:56:47.757 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132534892 ms)
2022-10-07 03:56:47.757 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132534893 ms)
2022-10-07 03:56:47.758 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40530)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132534893 ms)
2022-10-07 03:56:52.818 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132539954 ms)
2022-10-07 03:56:52.819 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132539954 ms)
2022-10-07 03:56:52.820 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40536)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132539956 ms)
2022-10-07 03:56:55.887 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132543023 ms)
2022-10-07 03:56:55.888 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132543023 ms)
2022-10-07 03:56:55.889 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40540)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132543025 ms)
2022-10-07 03:57:07.977 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132555113 ms)
2022-10-07 03:57:07.978 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132555113 ms)
2022-10-07 03:57:07.979 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40554)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132555115 ms)
2022-10-07 03:57:08.016 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132555152 ms)
2022-10-07 03:57:08.017 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132555152 ms)
2022-10-07 03:57:08.018 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40556)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132555154 ms)
2022-10-07 03:57:19.106 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132566241 ms)
2022-10-07 03:57:19.106 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132566242 ms)
2022-10-07 03:57:19.108 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40568)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132566243 ms)
2022-10-07 03:57:20.216 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132567352 ms)
2022-10-07 03:57:20.217 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132567352 ms)
2022-10-07 03:57:20.218 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40570)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132567354 ms)
2022-10-07 03:57:25.337 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132572472 ms)
2022-10-07 03:57:25.337 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132572473 ms)
2022-10-07 03:57:25.339 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40576)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132572474 ms)
2022-10-07 03:57:31.386 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132578521 ms)
2022-10-07 03:57:31.386 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132578522 ms)
2022-10-07 03:57:31.386 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40586)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132578522 ms)
2022-10-07 03:57:32.354 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132579490 ms)
2022-10-07 03:57:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132579490 ms)
2022-10-07 03:57:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:57:31.122521+00:00', 'runtime': '2132580.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.539', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132579491 ms)
2022-10-07 03:57:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:56:31.122673+00:00', 'runtime': '2132520.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132579492 ms)
2022-10-07 03:57:55.487 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132602622 ms)
2022-10-07 03:57:55.487 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132602623 ms)
2022-10-07 03:57:55.488 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40612)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132602624 ms)
2022-10-07 03:58:03.567 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132610702 ms)
2022-10-07 03:58:03.567 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132610703 ms)
2022-10-07 03:58:03.568 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40622)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132610704 ms)
2022-10-07 03:58:07.655 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132614791 ms)
2022-10-07 03:58:07.656 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132614791 ms)
2022-10-07 03:58:07.657 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40628)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132614792 ms)
2022-10-07 03:58:15.736 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132622871 ms)
2022-10-07 03:58:15.736 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132622871 ms)
2022-10-07 03:58:15.737 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40638)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132622873 ms)
2022-10-07 03:58:20.837 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132627972 ms)
2022-10-07 03:58:20.837 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132627973 ms)
2022-10-07 03:58:20.838 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40644)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132627974 ms)
2022-10-07 03:58:20.875 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132628011 ms)
2022-10-07 03:58:20.876 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132628011 ms)
2022-10-07 03:58:20.877 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40646)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132628012 ms)
2022-10-07 03:58:32.351 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132639486 ms)
2022-10-07 03:58:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132639487 ms)
2022-10-07 03:58:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:58:31.123946+00:00', 'runtime': '2132640.002', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.553', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132639491 ms)
2022-10-07 03:58:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:57:31.122521+00:00', 'runtime': '2132580.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.539', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132639492 ms)
2022-10-07 03:58:41.997 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132649133 ms)
2022-10-07 03:58:41.997 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132649133 ms)
2022-10-07 03:58:41.998 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40668)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132649133 ms)
2022-10-07 03:58:48.047 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132655182 ms)
2022-10-07 03:58:48.047 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132655182 ms)
2022-10-07 03:58:48.047 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40678)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132655183 ms)
2022-10-07 03:58:53.126 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132660261 ms)
2022-10-07 03:58:53.126 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132660262 ms)
2022-10-07 03:58:53.127 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40684)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132660262 ms)
2022-10-07 03:59:04.207 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132671342 ms)
2022-10-07 03:59:04.207 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132671343 ms)
2022-10-07 03:59:04.208 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40696)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132671343 ms)
2022-10-07 03:59:04.246 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132671381 ms)
2022-10-07 03:59:04.246 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132671382 ms)
2022-10-07 03:59:04.247 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40698)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132671383 ms)
2022-10-07 03:59:05.317 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132672453 ms)
2022-10-07 03:59:05.318 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132672453 ms)
2022-10-07 03:59:05.319 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40700)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132672454 ms)
2022-10-07 03:59:05.358 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132672493 ms)
2022-10-07 03:59:05.359 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132672494 ms)
2022-10-07 03:59:05.360 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40702)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132672495 ms)
2022-10-07 03:59:14.447 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132681582 ms)
2022-10-07 03:59:14.447 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132681583 ms)
2022-10-07 03:59:14.449 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40712)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132681584 ms)
2022-10-07 03:59:14.493 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132681628 ms)
2022-10-07 03:59:14.493 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132681629 ms)
2022-10-07 03:59:14.495 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40714)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132681630 ms)
2022-10-07 03:59:32.346 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132699481 ms)
2022-10-07 03:59:32.346 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132699482 ms)
2022-10-07 03:59:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 03:59:31.122634+00:00', 'runtime': '2132700.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.534', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132699485 ms)
2022-10-07 03:59:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:58:31.123946+00:00', 'runtime': '2132640.002', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.553', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.5', 'ahl_t': '507.5', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.1', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132699485 ms)
2022-10-07 03:59:35.616 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132702751 ms)
2022-10-07 03:59:35.616 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132702751 ms)
2022-10-07 03:59:35.617 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40738)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132702752 ms)
2022-10-07 03:59:40.687 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132707822 ms)
2022-10-07 03:59:40.687 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132707823 ms)
2022-10-07 03:59:40.689 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40744)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132707824 ms)
2022-10-07 03:59:59.816 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132726951 ms)
2022-10-07 03:59:59.816 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132726952 ms)
2022-10-07 03:59:59.817 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40764)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132726953 ms)
2022-10-07 04:00:05.894 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132733030 ms)
2022-10-07 04:00:05.895 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132733030 ms)
2022-10-07 04:00:05.896 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40772)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132733031 ms)
2022-10-07 04:00:05.925 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132733061 ms)
2022-10-07 04:00:05.926 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132733061 ms)
2022-10-07 04:00:05.927 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40774)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132733062 ms)
2022-10-07 04:00:07.997 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132735133 ms)
2022-10-07 04:00:07.998 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132735133 ms)
2022-10-07 04:00:07.998 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40778)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132735134 ms)
2022-10-07 04:00:13.093 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132740229 ms)
2022-10-07 04:00:13.094 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132740229 ms)
2022-10-07 04:00:13.094 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40784)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132740230 ms)
2022-10-07 04:00:13.125 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132740261 ms)
2022-10-07 04:00:13.126 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132740261 ms)
2022-10-07 04:00:13.126 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40786)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132740262 ms)
2022-10-07 04:00:18.222 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132745358 ms)
2022-10-07 04:00:18.223 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132745358 ms)
2022-10-07 04:00:18.223 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40792)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132745359 ms)
2022-10-07 04:00:32.348 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132759484 ms)
2022-10-07 04:00:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132759484 ms)
2022-10-07 04:00:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:00:31.122629+00:00', 'runtime': '2132760.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.51', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132759485 ms)
2022-10-07 04:00:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 03:59:31.122634+00:00', 'runtime': '2132700.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.534', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12356', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132759486 ms)
2022-10-07 04:00:33.325 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132760460 ms)
2022-10-07 04:00:33.325 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132760461 ms)
2022-10-07 04:00:33.326 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40808)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132760461 ms)
2022-10-07 04:00:35.385 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132762521 ms)
2022-10-07 04:00:35.385 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132762521 ms)
2022-10-07 04:00:35.386 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40812)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132762521 ms)
2022-10-07 04:00:44.468 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132771604 ms)
2022-10-07 04:00:44.469 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132771604 ms)
2022-10-07 04:00:44.469 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40822)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132771605 ms)
2022-10-07 04:00:48.534 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132775669 ms)
2022-10-07 04:00:48.534 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132775669 ms)
2022-10-07 04:00:48.534 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40830)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132775670 ms)
2022-10-07 04:00:48.567 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132775702 ms)
2022-10-07 04:00:48.567 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132775702 ms)
2022-10-07 04:00:48.567 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40832)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132775703 ms)
2022-10-07 04:00:55.647 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132782782 ms)
2022-10-07 04:00:55.647 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132782783 ms)
2022-10-07 04:00:55.648 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40840)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132782784 ms)
2022-10-07 04:00:58.718 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132785854 ms)
2022-10-07 04:00:58.719 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132785854 ms)
2022-10-07 04:00:58.720 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40844)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132785855 ms)
2022-10-07 04:01:06.774 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132793909 ms)
2022-10-07 04:01:06.774 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132793910 ms)
2022-10-07 04:01:06.775 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40862)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132793910 ms)
2022-10-07 04:01:10.854 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132797989 ms)
2022-10-07 04:01:10.854 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132797990 ms)
2022-10-07 04:01:10.855 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40870)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132797991 ms)
2022-10-07 04:01:10.886 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132798021 ms)
2022-10-07 04:01:10.886 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132798022 ms)
2022-10-07 04:01:10.888 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40872)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132798023 ms)
2022-10-07 04:01:11.966 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132799101 ms)
2022-10-07 04:01:11.966 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132799102 ms)
2022-10-07 04:01:11.967 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40874)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132799103 ms)
2022-10-07 04:01:15.046 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132802182 ms)
2022-10-07 04:01:15.047 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132802182 ms)
2022-10-07 04:01:15.048 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40878)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132802183 ms)
2022-10-07 04:01:28.127 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132815262 ms)
2022-10-07 04:01:28.127 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132815263 ms)
2022-10-07 04:01:28.128 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40892)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132815264 ms)
2022-10-07 04:01:28.167 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132815302 ms)
2022-10-07 04:01:28.167 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132815303 ms)
2022-10-07 04:01:28.168 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40894)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132815304 ms)
2022-10-07 04:01:32.359 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132819494 ms)
2022-10-07 04:01:32.360 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132819495 ms)
2022-10-07 04:01:32.362 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:01:31.122604+00:00', 'runtime': '2132820.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.519', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.708', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132819497 ms)
2022-10-07 04:01:32.363 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:00:31.122629+00:00', 'runtime': '2132760.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.51', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.711', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132819498 ms)
2022-10-07 04:01:49.284 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132836419 ms)
2022-10-07 04:01:49.284 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132836419 ms)
2022-10-07 04:01:49.285 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40916)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132836421 ms)
2022-10-07 04:01:50.383 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132837519 ms)
2022-10-07 04:01:50.384 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132837519 ms)
2022-10-07 04:01:50.385 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40918)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132837521 ms)
2022-10-07 04:01:58.467 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132845602 ms)
2022-10-07 04:01:58.467 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132845603 ms)
2022-10-07 04:01:58.468 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40928)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132845603 ms)
2022-10-07 04:01:58.506 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132845641 ms)
2022-10-07 04:01:58.506 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132845642 ms)
2022-10-07 04:01:58.507 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40930)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132845643 ms)
2022-10-07 04:02:07.567 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132854702 ms)
2022-10-07 04:02:07.567 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132854702 ms)
2022-10-07 04:02:07.568 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40940)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132854704 ms)
2022-10-07 04:02:21.654 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132868789 ms)
2022-10-07 04:02:21.654 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132868790 ms)
2022-10-07 04:02:21.655 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40956)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132868791 ms)
2022-10-07 04:02:31.400 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132878535 ms)
2022-10-07 04:02:31.400 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132878536 ms)
2022-10-07 04:02:31.401 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:02:31.122571+00:00', 'runtime': '2132880.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.544', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.708', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132878537 ms)
2022-10-07 04:02:31.402 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:01:31.122604+00:00', 'runtime': '2132820.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.519', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.708', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132878537 ms)
2022-10-07 04:02:35.725 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132882861 ms)
2022-10-07 04:02:35.726 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132882861 ms)
2022-10-07 04:02:35.726 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40974)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132882862 ms)
2022-10-07 04:02:47.816 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132894952 ms)
2022-10-07 04:02:47.817 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132894952 ms)
2022-10-07 04:02:47.817 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 40990)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132894953 ms)
2022-10-07 04:02:58.915 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132906051 ms)
2022-10-07 04:02:58.916 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132906051 ms)
2022-10-07 04:02:58.917 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41002)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132906052 ms)
2022-10-07 04:03:01.975 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132909110 ms)
2022-10-07 04:03:01.975 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132909111 ms)
2022-10-07 04:03:01.976 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41006)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132909112 ms)
2022-10-07 04:03:18.066 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132925201 ms)
2022-10-07 04:03:18.066 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132925202 ms)
2022-10-07 04:03:18.067 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41024)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132925202 ms)
2022-10-07 04:03:26.138 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132933273 ms)
2022-10-07 04:03:26.138 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132933274 ms)
2022-10-07 04:03:26.139 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41034)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132933274 ms)
2022-10-07 04:03:26.176 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132933311 ms)
2022-10-07 04:03:26.176 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132933312 ms)
2022-10-07 04:03:26.178 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41036)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132933313 ms)
2022-10-07 04:03:32.257 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132939392 ms)
2022-10-07 04:03:32.257 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132939392 ms)
2022-10-07 04:03:32.258 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41044)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132939393 ms)
2022-10-07 04:03:32.339 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132939474 ms)
2022-10-07 04:03:32.339 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132939475 ms)
2022-10-07 04:03:32.340 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:03:31.122555+00:00', 'runtime': '2132940.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.507', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.708', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132939476 ms)
2022-10-07 04:03:32.341 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:02:31.122571+00:00', 'runtime': '2132880.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.544', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.708', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132939476 ms)
2022-10-07 04:03:33.326 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132940461 ms)
2022-10-07 04:03:33.326 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132940462 ms)
2022-10-07 04:03:33.327 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41046)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132940462 ms)
2022-10-07 04:03:41.406 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132948541 ms)
2022-10-07 04:03:41.406 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132948542 ms)
2022-10-07 04:03:41.407 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41056)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132948543 ms)
2022-10-07 04:03:43.476 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132950611 ms)
2022-10-07 04:03:43.476 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132950612 ms)
2022-10-07 04:03:43.478 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41060)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132950613 ms)
2022-10-07 04:03:54.565 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132961701 ms)
2022-10-07 04:03:54.566 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132961701 ms)
2022-10-07 04:03:54.567 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41072)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132961703 ms)
2022-10-07 04:04:12.664 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132979799 ms)
2022-10-07 04:04:12.664 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132979799 ms)
2022-10-07 04:04:12.665 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41092)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132979800 ms)
2022-10-07 04:04:24.746 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132991881 ms)
2022-10-07 04:04:24.746 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132991882 ms)
2022-10-07 04:04:24.747 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41106)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132991883 ms)
2022-10-07 04:04:25.812 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132992947 ms)
2022-10-07 04:04:25.813 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132992948 ms)
2022-10-07 04:04:25.814 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41108)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132992949 ms)
2022-10-07 04:04:29.895 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2132997030 ms)
2022-10-07 04:04:29.895 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2132997031 ms)
2022-10-07 04:04:29.897 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41114)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2132997032 ms)
2022-10-07 04:04:31.407 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2132998542 ms)
2022-10-07 04:04:31.407 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2132998542 ms)
2022-10-07 04:04:31.408 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:04:31.122652+00:00', 'runtime': '2133000.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.575', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.708', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132998543 ms)
2022-10-07 04:04:31.408 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:03:31.122555+00:00', 'runtime': '2132940.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.507', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.708', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2132998544 ms)
2022-10-07 04:04:33.974 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133001109 ms)
2022-10-07 04:04:33.974 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133001109 ms)
2022-10-07 04:04:33.974 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41122)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133001110 ms)
2022-10-07 04:04:34.005 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133001141 ms)
2022-10-07 04:04:34.006 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133001141 ms)
2022-10-07 04:04:34.006 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41124)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133001142 ms)
2022-10-07 04:04:38.075 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133005211 ms)
2022-10-07 04:04:38.076 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133005211 ms)
2022-10-07 04:04:38.076 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41130)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133005212 ms)
2022-10-07 04:04:46.126 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133013262 ms)
2022-10-07 04:04:46.127 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133013262 ms)
2022-10-07 04:04:46.127 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41142)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133013262 ms)
2022-10-07 04:04:52.196 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133019331 ms)
2022-10-07 04:04:52.196 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133019332 ms)
2022-10-07 04:04:52.197 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41150)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133019333 ms)
2022-10-07 04:04:53.276 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133020412 ms)
2022-10-07 04:04:53.277 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133020412 ms)
2022-10-07 04:04:53.278 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41152)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133020414 ms)
2022-10-07 04:05:10.365 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133037501 ms)
2022-10-07 04:05:10.366 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133037501 ms)
2022-10-07 04:05:10.367 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41170)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133037503 ms)
2022-10-07 04:05:12.416 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133039551 ms)
2022-10-07 04:05:12.416 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133039552 ms)
2022-10-07 04:05:12.418 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41174)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133039553 ms)
2022-10-07 04:05:20.495 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133047631 ms)
2022-10-07 04:05:20.496 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133047631 ms)
2022-10-07 04:05:20.497 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41184)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133047633 ms)
2022-10-07 04:05:31.566 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133058702 ms)
2022-10-07 04:05:31.567 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133058702 ms)
2022-10-07 04:05:31.567 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41196)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133058703 ms)
2022-10-07 04:05:32.344 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133059479 ms)
2022-10-07 04:05:32.344 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133059480 ms)
2022-10-07 04:05:32.345 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:05:31.122632+00:00', 'runtime': '2133060.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.515', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.704', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133059481 ms)
2022-10-07 04:05:32.346 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:04:31.122652+00:00', 'runtime': '2133000.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.575', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.708', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133059481 ms)
2022-10-07 04:05:36.645 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133063781 ms)
2022-10-07 04:05:36.646 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133063781 ms)
2022-10-07 04:05:36.649 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41202)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133063784 ms)
2022-10-07 04:05:36.685 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133063821 ms)
2022-10-07 04:05:36.686 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133063821 ms)
2022-10-07 04:05:36.687 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41204)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133063822 ms)
2022-10-07 04:05:40.767 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133067902 ms)
2022-10-07 04:05:40.767 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133067902 ms)
2022-10-07 04:05:40.768 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41210)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133067904 ms)
2022-10-07 04:05:42.845 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133069981 ms)
2022-10-07 04:05:42.846 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133069981 ms)
2022-10-07 04:05:42.847 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41214)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133069982 ms)
2022-10-07 04:05:46.927 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133074062 ms)
2022-10-07 04:05:46.927 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133074063 ms)
2022-10-07 04:05:46.928 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41220)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133074064 ms)
2022-10-07 04:05:54.025 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133081161 ms)
2022-10-07 04:05:54.026 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133081161 ms)
2022-10-07 04:05:54.027 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41228)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133081162 ms)
2022-10-07 04:05:55.086 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133082222 ms)
2022-10-07 04:05:55.087 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133082222 ms)
2022-10-07 04:05:55.088 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41230)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133082223 ms)
2022-10-07 04:05:55.126 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133082262 ms)
2022-10-07 04:05:55.127 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133082262 ms)
2022-10-07 04:05:55.130 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41232)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133082265 ms)
2022-10-07 04:05:56.195 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133083331 ms)
2022-10-07 04:05:56.196 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133083331 ms)
2022-10-07 04:05:56.197 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41234)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133083333 ms)
2022-10-07 04:05:58.256 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133085391 ms)
2022-10-07 04:05:58.256 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133085391 ms)
2022-10-07 04:05:58.258 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41238)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133085393 ms)
2022-10-07 04:05:59.326 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133086461 ms)
2022-10-07 04:05:59.327 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133086462 ms)
2022-10-07 04:05:59.328 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41240)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133086463 ms)
2022-10-07 04:05:59.372 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133086507 ms)
2022-10-07 04:05:59.372 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133086508 ms)
2022-10-07 04:05:59.374 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41242)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133086509 ms)
2022-10-07 04:06:07.465 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133094600 ms)
2022-10-07 04:06:07.465 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133094601 ms)
2022-10-07 04:06:07.467 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41252)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133094602 ms)
2022-10-07 04:06:16.532 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133103668 ms)
2022-10-07 04:06:16.533 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133103668 ms)
2022-10-07 04:06:16.534 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41262)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133103670 ms)
2022-10-07 04:06:30.756 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133117891 ms)
2022-10-07 04:06:30.756 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133117892 ms)
2022-10-07 04:06:30.758 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41278)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133117893 ms)
2022-10-07 04:06:32.347 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133119483 ms)
2022-10-07 04:06:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133119483 ms)
2022-10-07 04:06:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:06:31.122681+00:00', 'runtime': '2133120.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.58', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.704', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133119484 ms)
2022-10-07 04:06:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:05:31.122632+00:00', 'runtime': '2133060.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.515', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.704', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133119485 ms)
2022-10-07 04:06:32.826 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133119961 ms)
2022-10-07 04:06:32.826 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133119961 ms)
2022-10-07 04:06:32.826 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41284)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133119962 ms)
2022-10-07 04:06:33.867 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133121002 ms)
2022-10-07 04:06:33.868 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133121003 ms)
2022-10-07 04:06:33.869 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41286)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133121005 ms)
2022-10-07 04:06:39.916 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133127052 ms)
2022-10-07 04:06:39.917 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133127052 ms)
2022-10-07 04:06:39.917 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41296)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133127053 ms)
2022-10-07 04:06:45.012 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133132148 ms)
2022-10-07 04:06:45.013 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133132148 ms)
2022-10-07 04:06:45.013 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41302)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133132149 ms)
2022-10-07 04:06:45.045 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133132181 ms)
2022-10-07 04:06:45.045 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133132181 ms)
2022-10-07 04:06:45.046 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41304)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133132182 ms)
2022-10-07 04:06:52.136 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133139271 ms)
2022-10-07 04:06:52.136 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133139272 ms)
2022-10-07 04:06:52.137 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41314)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133139272 ms)
2022-10-07 04:06:52.166 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133139301 ms)
2022-10-07 04:06:52.166 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133139302 ms)
2022-10-07 04:06:52.167 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41316)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133139302 ms)
2022-10-07 04:07:09.246 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133156382 ms)
2022-10-07 04:07:09.247 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133156382 ms)
2022-10-07 04:07:09.248 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41334)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133156384 ms)
2022-10-07 04:07:16.315 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133163451 ms)
2022-10-07 04:07:16.316 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133163451 ms)
2022-10-07 04:07:16.317 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41342)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133163453 ms)
2022-10-07 04:07:20.396 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133167532 ms)
2022-10-07 04:07:20.397 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133167532 ms)
2022-10-07 04:07:20.398 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41348)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133167534 ms)
2022-10-07 04:07:20.436 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133167572 ms)
2022-10-07 04:07:20.437 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133167572 ms)
2022-10-07 04:07:20.438 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41350)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133167573 ms)
2022-10-07 04:07:30.527 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133177662 ms)
2022-10-07 04:07:30.527 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133177663 ms)
2022-10-07 04:07:30.528 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41362)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133177664 ms)
2022-10-07 04:07:32.341 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133179476 ms)
2022-10-07 04:07:32.342 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133179478 ms)
2022-10-07 04:07:32.344 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:07:31.122641+00:00', 'runtime': '2133180.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.534', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.698', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133179480 ms)
2022-10-07 04:07:32.345 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:06:31.122681+00:00', 'runtime': '2133120.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.58', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.704', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133179481 ms)
2022-10-07 04:07:37.605 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133184740 ms)
2022-10-07 04:07:37.605 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133184741 ms)
2022-10-07 04:07:37.607 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41370)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133184742 ms)
2022-10-07 04:07:42.686 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133189822 ms)
2022-10-07 04:07:42.687 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133189822 ms)
2022-10-07 04:07:42.688 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41376)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133189824 ms)
2022-10-07 04:07:46.778 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133193914 ms)
2022-10-07 04:07:46.779 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133193914 ms)
2022-10-07 04:07:46.780 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41382)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133193915 ms)
2022-10-07 04:07:50.852 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133197987 ms)
2022-10-07 04:07:50.852 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133197988 ms)
2022-10-07 04:07:50.854 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41388)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133197989 ms)
2022-10-07 04:07:56.906 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133204041 ms)
2022-10-07 04:07:56.906 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133204042 ms)
2022-10-07 04:07:56.908 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41396)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133204043 ms)
2022-10-07 04:08:00.976 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133208112 ms)
2022-10-07 04:08:00.977 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133208112 ms)
2022-10-07 04:08:00.978 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41402)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133208114 ms)
2022-10-07 04:08:06.047 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133213183 ms)
2022-10-07 04:08:06.048 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133213183 ms)
2022-10-07 04:08:06.049 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41408)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133213185 ms)
2022-10-07 04:08:20.134 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133227269 ms)
2022-10-07 04:08:20.134 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133227270 ms)
2022-10-07 04:08:20.136 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41424)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133227271 ms)
2022-10-07 04:08:25.234 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133232370 ms)
2022-10-07 04:08:25.235 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133232370 ms)
2022-10-07 04:08:25.236 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41430)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133232372 ms)
2022-10-07 04:08:32.348 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133239484 ms)
2022-10-07 04:08:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133239485 ms)
2022-10-07 04:08:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:08:31.122609+00:00', 'runtime': '2133240.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.51', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.698', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133239487 ms)
2022-10-07 04:08:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:07:31.122641+00:00', 'runtime': '2133180.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.534', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.698', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133239488 ms)
2022-10-07 04:08:38.337 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133245473 ms)
2022-10-07 04:08:38.338 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133245473 ms)
2022-10-07 04:08:38.338 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41444)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133245474 ms)
2022-10-07 04:08:41.417 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133248553 ms)
2022-10-07 04:08:41.418 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133248553 ms)
2022-10-07 04:08:41.418 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41448)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133248554 ms)
2022-10-07 04:08:41.448 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133248584 ms)
2022-10-07 04:08:41.448 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133248584 ms)
2022-10-07 04:08:41.449 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41450)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133248584 ms)
2022-10-07 04:09:16.589 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133283724 ms)
2022-10-07 04:09:16.589 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133283725 ms)
2022-10-07 04:09:16.591 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41488)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133283726 ms)
2022-10-07 04:09:17.649 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133284785 ms)
2022-10-07 04:09:17.650 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133284785 ms)
2022-10-07 04:09:17.651 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41490)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133284786 ms)
2022-10-07 04:09:29.709 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133296844 ms)
2022-10-07 04:09:29.709 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133296845 ms)
2022-10-07 04:09:29.711 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41504)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133296846 ms)
2022-10-07 04:09:32.357 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133299492 ms)
2022-10-07 04:09:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133299493 ms)
2022-10-07 04:09:32.358 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:09:31.122641+00:00', 'runtime': '2133300.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.575', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.698', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133299494 ms)
2022-10-07 04:09:32.359 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:08:31.122609+00:00', 'runtime': '2133240.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.51', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.698', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133299494 ms)
2022-10-07 04:09:53.826 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133320962 ms)
2022-10-07 04:09:53.827 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133320962 ms)
2022-10-07 04:09:53.828 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41532)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133320963 ms)
2022-10-07 04:10:23.931 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133351066 ms)
2022-10-07 04:10:23.931 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133351067 ms)
2022-10-07 04:10:23.932 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41564)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133351068 ms)
2022-10-07 04:10:25.027 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133352162 ms)
2022-10-07 04:10:25.027 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133352163 ms)
2022-10-07 04:10:25.029 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41566)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133352164 ms)
2022-10-07 04:10:25.069 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133352204 ms)
2022-10-07 04:10:25.069 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133352205 ms)
2022-10-07 04:10:25.071 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41568)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133352206 ms)
2022-10-07 04:10:26.143 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133353278 ms)
2022-10-07 04:10:26.143 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133353279 ms)
2022-10-07 04:10:26.145 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41570)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133353280 ms)
2022-10-07 04:10:28.210 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133355346 ms)
2022-10-07 04:10:28.211 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133355346 ms)
2022-10-07 04:10:28.212 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41574)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133355347 ms)
2022-10-07 04:10:31.394 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133358529 ms)
2022-10-07 04:10:31.394 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133358530 ms)
2022-10-07 04:10:31.396 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:10:31.122621+00:00', 'runtime': '2133360.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.517', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.698', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133358532 ms)
2022-10-07 04:10:31.397 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:09:31.122641+00:00', 'runtime': '2133300.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.575', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.6', 'ahl_t': '507.6', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.698', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.2', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133358532 ms)
2022-10-07 04:10:38.290 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133365426 ms)
2022-10-07 04:10:38.291 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133365426 ms)
2022-10-07 04:10:38.291 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41586)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133365427 ms)
2022-10-07 04:10:52.379 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133379515 ms)
2022-10-07 04:10:52.380 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133379515 ms)
2022-10-07 04:10:52.381 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41604)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133379517 ms)
2022-10-07 04:10:53.470 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133380606 ms)
2022-10-07 04:10:53.471 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133380606 ms)
2022-10-07 04:10:53.472 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41606)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133380607 ms)
2022-10-07 04:10:56.539 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133383674 ms)
2022-10-07 04:10:56.539 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133383675 ms)
2022-10-07 04:10:56.541 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41610)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133383676 ms)
2022-10-07 04:10:56.582 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133383717 ms)
2022-10-07 04:10:56.582 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133383718 ms)
2022-10-07 04:10:56.584 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41612)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133383719 ms)
2022-10-07 04:10:56.620 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133383755 ms)
2022-10-07 04:10:56.620 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133383756 ms)
2022-10-07 04:10:56.622 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41614)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133383757 ms)
2022-10-07 04:10:57.701 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133384836 ms)
2022-10-07 04:10:57.701 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133384837 ms)
2022-10-07 04:10:57.703 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41616)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133384838 ms)
2022-10-07 04:11:08.778 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133395913 ms)
2022-10-07 04:11:08.778 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133395913 ms)
2022-10-07 04:11:08.779 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41636)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133395914 ms)
2022-10-07 04:11:09.860 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133396995 ms)
2022-10-07 04:11:09.860 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133396996 ms)
2022-10-07 04:11:09.861 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41640)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133396997 ms)
2022-10-07 04:11:09.900 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133397035 ms)
2022-10-07 04:11:09.900 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133397036 ms)
2022-10-07 04:11:09.902 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41642)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133397037 ms)
2022-10-07 04:11:21.981 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133409116 ms)
2022-10-07 04:11:21.981 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133409117 ms)
2022-10-07 04:11:21.983 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41656)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133409118 ms)
2022-10-07 04:11:30.067 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133417202 ms)
2022-10-07 04:11:30.067 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133417203 ms)
2022-10-07 04:11:30.069 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41666)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133417204 ms)
2022-10-07 04:11:32.350 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133419486 ms)
2022-10-07 04:11:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133419486 ms)
2022-10-07 04:11:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:11:31.122581+00:00', 'runtime': '2133420.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.551', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133419487 ms)
2022-10-07 04:11:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:10:31.122621+00:00', 'runtime': '2133360.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.517', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.698', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133419487 ms)
2022-10-07 04:11:55.178 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133442314 ms)
2022-10-07 04:11:55.179 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133442314 ms)
2022-10-07 04:11:55.180 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41692)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133442316 ms)
2022-10-07 04:12:20.292 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133467427 ms)
2022-10-07 04:12:20.292 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133467428 ms)
2022-10-07 04:12:20.293 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41718)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133467429 ms)
2022-10-07 04:12:29.381 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133476516 ms)
2022-10-07 04:12:29.382 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133476517 ms)
2022-10-07 04:12:29.383 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41728)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133476518 ms)
2022-10-07 04:12:32.346 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133479482 ms)
2022-10-07 04:12:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133479483 ms)
2022-10-07 04:12:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:12:31.122613+00:00', 'runtime': '2133480.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.531', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133479488 ms)
2022-10-07 04:12:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:11:31.122581+00:00', 'runtime': '2133420.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.551', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133479489 ms)
2022-10-07 04:12:33.452 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133480588 ms)
2022-10-07 04:12:33.453 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133480588 ms)
2022-10-07 04:12:33.454 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41736)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133480589 ms)
2022-10-07 04:12:40.532 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133487668 ms)
2022-10-07 04:12:40.533 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133487668 ms)
2022-10-07 04:12:40.533 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41744)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133487669 ms)
2022-10-07 04:12:44.602 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133491737 ms)
2022-10-07 04:12:44.602 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133491737 ms)
2022-10-07 04:12:44.603 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41750)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133491738 ms)
2022-10-07 04:12:51.690 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133498825 ms)
2022-10-07 04:12:51.690 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133498826 ms)
2022-10-07 04:12:51.691 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41760)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133498826 ms)
2022-10-07 04:12:52.772 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133499908 ms)
2022-10-07 04:12:52.773 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133499908 ms)
2022-10-07 04:12:52.773 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41762)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133499909 ms)
2022-10-07 04:12:52.811 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133499946 ms)
2022-10-07 04:12:52.811 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133499947 ms)
2022-10-07 04:12:52.812 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41764)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133499948 ms)
2022-10-07 04:12:57.893 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133505028 ms)
2022-10-07 04:12:57.893 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133505029 ms)
2022-10-07 04:12:57.894 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41770)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133505029 ms)
2022-10-07 04:13:05.952 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133513087 ms)
2022-10-07 04:13:05.952 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133513088 ms)
2022-10-07 04:13:05.953 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41780)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133513088 ms)
2022-10-07 04:13:20.050 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133527185 ms)
2022-10-07 04:13:20.050 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133527186 ms)
2022-10-07 04:13:20.052 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41796)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133527187 ms)
2022-10-07 04:13:27.143 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133534278 ms)
2022-10-07 04:13:27.143 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133534279 ms)
2022-10-07 04:13:27.145 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41804)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133534280 ms)
2022-10-07 04:13:29.200 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133536336 ms)
2022-10-07 04:13:29.201 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133536336 ms)
2022-10-07 04:13:29.202 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41808)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133536337 ms)
2022-10-07 04:13:32.341 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133539477 ms)
2022-10-07 04:13:32.342 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133539477 ms)
2022-10-07 04:13:32.343 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:13:31.122621+00:00', 'runtime': '2133540.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.515', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133539478 ms)
2022-10-07 04:13:32.343 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:12:31.122613+00:00', 'runtime': '2133480.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.531', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133539479 ms)
2022-10-07 04:13:41.283 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133548419 ms)
2022-10-07 04:13:41.284 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133548419 ms)
2022-10-07 04:13:41.285 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41822)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133548421 ms)
2022-10-07 04:13:46.374 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133553509 ms)
2022-10-07 04:13:46.374 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133553510 ms)
2022-10-07 04:13:46.375 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41828)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133553511 ms)
2022-10-07 04:13:50.449 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133557585 ms)
2022-10-07 04:13:50.450 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133557585 ms)
2022-10-07 04:13:50.451 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41834)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133557587 ms)
2022-10-07 04:13:55.532 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133562668 ms)
2022-10-07 04:13:55.533 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133562668 ms)
2022-10-07 04:13:55.534 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41840)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133562670 ms)
2022-10-07 04:13:56.613 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133563748 ms)
2022-10-07 04:13:56.613 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133563749 ms)
2022-10-07 04:13:56.615 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41842)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133563750 ms)
2022-10-07 04:13:57.672 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133564808 ms)
2022-10-07 04:13:57.673 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133564809 ms)
2022-10-07 04:13:57.674 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41844)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133564810 ms)
2022-10-07 04:13:57.727 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133564863 ms)
2022-10-07 04:13:57.728 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133564863 ms)
2022-10-07 04:13:57.729 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41846)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133564865 ms)
2022-10-07 04:13:59.773 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133566908 ms)
2022-10-07 04:13:59.773 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133566909 ms)
2022-10-07 04:13:59.774 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41850)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133566910 ms)
2022-10-07 04:14:03.823 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133570958 ms)
2022-10-07 04:14:03.823 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133570959 ms)
2022-10-07 04:14:03.825 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41856)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133570960 ms)
2022-10-07 04:14:24.934 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133592069 ms)
2022-10-07 04:14:24.934 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133592070 ms)
2022-10-07 04:14:24.936 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41878)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133592071 ms)
2022-10-07 04:14:27.092 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133594228 ms)
2022-10-07 04:14:27.093 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133594228 ms)
2022-10-07 04:14:27.094 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41882)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133594230 ms)
2022-10-07 04:14:32.358 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133599493 ms)
2022-10-07 04:14:32.358 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133599494 ms)
2022-10-07 04:14:32.359 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:14:31.122671+00:00', 'runtime': '2133600.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.553', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.708', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133599495 ms)
2022-10-07 04:14:32.360 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:13:31.122621+00:00', 'runtime': '2133540.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.515', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133599495 ms)
2022-10-07 04:14:38.272 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133605407 ms)
2022-10-07 04:14:38.272 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133605408 ms)
2022-10-07 04:14:38.273 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41896)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133605408 ms)
2022-10-07 04:14:39.381 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133606516 ms)
2022-10-07 04:14:39.381 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133606517 ms)
2022-10-07 04:14:39.382 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41898)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133606517 ms)
2022-10-07 04:14:47.434 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133614570 ms)
2022-10-07 04:14:47.435 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133614570 ms)
2022-10-07 04:14:47.436 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41910)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133614571 ms)
2022-10-07 04:15:04.543 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133631679 ms)
2022-10-07 04:15:04.544 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133631679 ms)
2022-10-07 04:15:04.545 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41928)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133631681 ms)
2022-10-07 04:15:14.612 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133641747 ms)
2022-10-07 04:15:14.612 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133641748 ms)
2022-10-07 04:15:14.613 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41940)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133641749 ms)
2022-10-07 04:15:22.694 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133649830 ms)
2022-10-07 04:15:22.695 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133649830 ms)
2022-10-07 04:15:22.696 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41950)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133649831 ms)
2022-10-07 04:15:27.784 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133654919 ms)
2022-10-07 04:15:27.785 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133654920 ms)
2022-10-07 04:15:27.786 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41956)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133654921 ms)
2022-10-07 04:15:31.404 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133658540 ms)
2022-10-07 04:15:31.405 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133658541 ms)
2022-10-07 04:15:31.407 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:15:31.122637+00:00', 'runtime': '2133660.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133658542 ms)
2022-10-07 04:15:31.408 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:14:31.122671+00:00', 'runtime': '2133600.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.553', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.708', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133658543 ms)
2022-10-07 04:15:35.854 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133662990 ms)
2022-10-07 04:15:35.855 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133662990 ms)
2022-10-07 04:15:35.856 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41966)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133662991 ms)
2022-10-07 04:15:46.944 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133674079 ms)
2022-10-07 04:15:46.945 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133674080 ms)
2022-10-07 04:15:46.946 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41978)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133674081 ms)
2022-10-07 04:15:46.985 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133674121 ms)
2022-10-07 04:15:46.986 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133674121 ms)
2022-10-07 04:15:46.987 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41980)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133674122 ms)
2022-10-07 04:15:56.061 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133683196 ms)
2022-10-07 04:15:56.061 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133683197 ms)
2022-10-07 04:15:56.063 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41990)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133683198 ms)
2022-10-07 04:15:57.161 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133684296 ms)
2022-10-07 04:15:57.161 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133684297 ms)
2022-10-07 04:15:57.163 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41992)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133684298 ms)
2022-10-07 04:16:02.244 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133689380 ms)
2022-10-07 04:16:02.245 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133689380 ms)
2022-10-07 04:16:02.246 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 41998)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133689382 ms)
2022-10-07 04:16:23.364 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133710500 ms)
2022-10-07 04:16:23.365 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133710500 ms)
2022-10-07 04:16:23.366 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42020)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133710501 ms)
2022-10-07 04:16:30.486 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133717621 ms)
2022-10-07 04:16:30.486 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133717622 ms)
2022-10-07 04:16:30.487 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42028)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133717623 ms)
2022-10-07 04:16:32.351 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133719486 ms)
2022-10-07 04:16:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133719487 ms)
2022-10-07 04:16:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:16:31.122566+00:00', 'runtime': '2133720.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.527', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133719488 ms)
2022-10-07 04:16:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:15:31.122637+00:00', 'runtime': '2133660.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133719489 ms)
2022-10-07 04:16:33.583 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133720718 ms)
2022-10-07 04:16:33.583 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133720719 ms)
2022-10-07 04:16:33.584 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42034)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133720719 ms)
2022-10-07 04:16:33.614 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133720749 ms)
2022-10-07 04:16:33.614 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133720750 ms)
2022-10-07 04:16:33.615 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42036)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133720750 ms)
2022-10-07 04:16:37.665 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133724801 ms)
2022-10-07 04:16:37.665 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133724801 ms)
2022-10-07 04:16:37.666 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42044)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133724802 ms)
2022-10-07 04:16:37.695 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133724831 ms)
2022-10-07 04:16:37.696 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133724831 ms)
2022-10-07 04:16:37.696 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42046)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133724832 ms)
2022-10-07 04:16:39.755 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133726891 ms)
2022-10-07 04:16:39.755 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133726891 ms)
2022-10-07 04:16:39.756 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42050)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133726892 ms)
2022-10-07 04:16:45.805 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133732940 ms)
2022-10-07 04:16:45.805 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133732941 ms)
2022-10-07 04:16:45.806 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42058)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133732941 ms)
2022-10-07 04:16:56.903 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133744038 ms)
2022-10-07 04:16:56.903 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133744038 ms)
2022-10-07 04:16:56.904 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42072)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133744040 ms)
2022-10-07 04:16:56.941 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133744077 ms)
2022-10-07 04:16:56.942 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133744077 ms)
2022-10-07 04:16:56.943 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42074)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133744079 ms)
2022-10-07 04:16:56.985 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133744120 ms)
2022-10-07 04:16:56.985 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133744120 ms)
2022-10-07 04:16:56.986 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42076)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133744122 ms)
2022-10-07 04:17:23.095 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133770230 ms)
2022-10-07 04:17:23.095 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133770231 ms)
2022-10-07 04:17:23.096 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42104)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133770232 ms)
2022-10-07 04:17:29.182 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133776317 ms)
2022-10-07 04:17:29.182 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133776318 ms)
2022-10-07 04:17:29.184 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42112)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133776319 ms)
2022-10-07 04:17:32.351 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133779486 ms)
2022-10-07 04:17:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133779487 ms)
2022-10-07 04:17:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:17:31.122600+00:00', 'runtime': '2133780.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.708', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133779488 ms)
2022-10-07 04:17:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:16:31.122566+00:00', 'runtime': '2133720.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.527', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133779488 ms)
2022-10-07 04:17:33.233 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133780369 ms)
2022-10-07 04:17:33.233 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133780369 ms)
2022-10-07 04:17:33.234 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42118)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133780369 ms)
2022-10-07 04:17:33.266 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133780402 ms)
2022-10-07 04:17:33.266 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133780402 ms)
2022-10-07 04:17:33.267 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42120)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133780402 ms)
2022-10-07 04:17:42.371 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133789506 ms)
2022-10-07 04:17:42.371 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133789507 ms)
2022-10-07 04:17:42.372 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42130)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133789508 ms)
2022-10-07 04:17:47.462 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133794597 ms)
2022-10-07 04:17:47.463 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133794598 ms)
2022-10-07 04:17:47.464 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42136)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133794599 ms)
2022-10-07 04:17:57.539 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133804675 ms)
2022-10-07 04:17:57.540 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133804675 ms)
2022-10-07 04:17:57.541 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42148)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133804677 ms)
2022-10-07 04:17:58.622 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133805758 ms)
2022-10-07 04:17:58.623 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133805758 ms)
2022-10-07 04:17:58.624 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42150)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133805759 ms)
2022-10-07 04:17:58.654 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133805790 ms)
2022-10-07 04:17:58.655 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133805790 ms)
2022-10-07 04:17:58.656 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42152)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133805791 ms)
2022-10-07 04:17:59.751 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133806887 ms)
2022-10-07 04:17:59.752 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133806887 ms)
2022-10-07 04:17:59.753 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42154)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133806889 ms)
2022-10-07 04:18:03.795 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133810931 ms)
2022-10-07 04:18:03.796 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133810931 ms)
2022-10-07 04:18:03.797 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42160)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133810933 ms)
2022-10-07 04:18:08.872 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133816008 ms)
2022-10-07 04:18:08.873 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133816008 ms)
2022-10-07 04:18:08.874 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42166)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133816010 ms)
2022-10-07 04:18:08.912 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133816047 ms)
2022-10-07 04:18:08.912 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133816047 ms)
2022-10-07 04:18:08.913 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42168)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133816049 ms)
2022-10-07 04:18:10.986 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133818121 ms)
2022-10-07 04:18:10.986 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133818122 ms)
2022-10-07 04:18:10.988 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42172)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133818123 ms)
2022-10-07 04:18:13.054 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133820189 ms)
2022-10-07 04:18:13.054 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133820190 ms)
2022-10-07 04:18:13.056 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42176)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133820191 ms)
2022-10-07 04:18:14.125 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133821260 ms)
2022-10-07 04:18:14.125 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133821261 ms)
2022-10-07 04:18:14.127 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42178)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133821262 ms)
2022-10-07 04:18:16.194 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133823330 ms)
2022-10-07 04:18:16.195 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133823330 ms)
2022-10-07 04:18:16.196 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42182)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133823332 ms)
2022-10-07 04:18:23.307 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133830443 ms)
2022-10-07 04:18:23.308 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133830443 ms)
2022-10-07 04:18:23.309 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42190)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133830445 ms)
2022-10-07 04:18:28.376 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133835511 ms)
2022-10-07 04:18:28.376 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133835512 ms)
2022-10-07 04:18:28.378 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42196)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133835513 ms)
2022-10-07 04:18:29.425 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133836560 ms)
2022-10-07 04:18:29.425 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133836561 ms)
2022-10-07 04:18:29.427 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42198)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133836562 ms)
2022-10-07 04:18:32.353 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133839489 ms)
2022-10-07 04:18:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133839489 ms)
2022-10-07 04:18:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:18:31.122704+00:00', 'runtime': '2133840.001', 'adc_vb_f': '12.708', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.529', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133839490 ms)
2022-10-07 04:18:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:17:31.122600+00:00', 'runtime': '2133780.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.708', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133839490 ms)
2022-10-07 04:18:36.515 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133843650 ms)
2022-10-07 04:18:36.515 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133843651 ms)
2022-10-07 04:18:36.516 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42208)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133843651 ms)
2022-10-07 04:18:42.593 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133849728 ms)
2022-10-07 04:18:42.593 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133849728 ms)
2022-10-07 04:18:42.594 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42216)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133849729 ms)
2022-10-07 04:18:42.624 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133849760 ms)
2022-10-07 04:18:42.625 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133849760 ms)
2022-10-07 04:18:42.625 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42218)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133849761 ms)
2022-10-07 04:18:45.712 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133852847 ms)
2022-10-07 04:18:45.712 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133852847 ms)
2022-10-07 04:18:45.713 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42222)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133852848 ms)
2022-10-07 04:18:45.745 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133852880 ms)
2022-10-07 04:18:45.745 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133852881 ms)
2022-10-07 04:18:45.746 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42224)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133852881 ms)
2022-10-07 04:19:01.835 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133868971 ms)
2022-10-07 04:19:01.836 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133868971 ms)
2022-10-07 04:19:01.837 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42244)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133868973 ms)
2022-10-07 04:19:01.873 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133869009 ms)
2022-10-07 04:19:01.874 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133869009 ms)
2022-10-07 04:19:01.875 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42246)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133869010 ms)
2022-10-07 04:19:06.959 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133874095 ms)
2022-10-07 04:19:06.960 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133874095 ms)
2022-10-07 04:19:06.961 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42252)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133874097 ms)
2022-10-07 04:19:08.038 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133875174 ms)
2022-10-07 04:19:08.039 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133875174 ms)
2022-10-07 04:19:08.040 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42254)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133875175 ms)
2022-10-07 04:19:08.086 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133875222 ms)
2022-10-07 04:19:08.087 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133875222 ms)
2022-10-07 04:19:08.088 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42256)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133875223 ms)
2022-10-07 04:19:15.175 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133882311 ms)
2022-10-07 04:19:15.176 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133882311 ms)
2022-10-07 04:19:15.177 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42264)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133882312 ms)
2022-10-07 04:19:19.245 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133886381 ms)
2022-10-07 04:19:19.246 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133886381 ms)
2022-10-07 04:19:19.247 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42270)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133886383 ms)
2022-10-07 04:19:25.314 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133892450 ms)
2022-10-07 04:19:25.315 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133892450 ms)
2022-10-07 04:19:25.316 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42278)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133892452 ms)
2022-10-07 04:19:26.405 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133893540 ms)
2022-10-07 04:19:26.405 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133893541 ms)
2022-10-07 04:19:26.407 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42280)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133893542 ms)
2022-10-07 04:19:26.446 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133893581 ms)
2022-10-07 04:19:26.446 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133893582 ms)
2022-10-07 04:19:26.448 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42282)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133893583 ms)
2022-10-07 04:19:29.543 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133896678 ms)
2022-10-07 04:19:29.543 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133896679 ms)
2022-10-07 04:19:29.544 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42286)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133896680 ms)
2022-10-07 04:19:32.353 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133899489 ms)
2022-10-07 04:19:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133899490 ms)
2022-10-07 04:19:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:19:31.122597+00:00', 'runtime': '2133900.001', 'adc_vb_f': '12.701', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.704', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133899492 ms)
2022-10-07 04:19:32.358 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:18:31.122704+00:00', 'runtime': '2133840.001', 'adc_vb_f': '12.708', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.529', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.711', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133899493 ms)
2022-10-07 04:19:50.655 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133917791 ms)
2022-10-07 04:19:50.656 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133917791 ms)
2022-10-07 04:19:50.657 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42308)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133917793 ms)
2022-10-07 04:19:51.736 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133918871 ms)
2022-10-07 04:19:51.736 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133918872 ms)
2022-10-07 04:19:51.738 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42310)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133918873 ms)
2022-10-07 04:19:58.824 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133925960 ms)
2022-10-07 04:19:58.825 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133925960 ms)
2022-10-07 04:19:58.826 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42318)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133925962 ms)
2022-10-07 04:20:01.907 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133929043 ms)
2022-10-07 04:20:01.908 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133929043 ms)
2022-10-07 04:20:01.909 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42322)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133929045 ms)
2022-10-07 04:20:02.993 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133930128 ms)
2022-10-07 04:20:02.993 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133930129 ms)
2022-10-07 04:20:02.995 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42324)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133930130 ms)
2022-10-07 04:20:06.087 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133933222 ms)
2022-10-07 04:20:06.087 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133933223 ms)
2022-10-07 04:20:06.088 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42328)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133933224 ms)
2022-10-07 04:20:06.127 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133933262 ms)
2022-10-07 04:20:06.127 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133933263 ms)
2022-10-07 04:20:06.128 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42330)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133933264 ms)
2022-10-07 04:20:13.217 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133940352 ms)
2022-10-07 04:20:13.217 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133940353 ms)
2022-10-07 04:20:13.219 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42338)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133940354 ms)
2022-10-07 04:20:13.257 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133940392 ms)
2022-10-07 04:20:13.257 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133940393 ms)
2022-10-07 04:20:13.258 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42340)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133940394 ms)
2022-10-07 04:20:13.296 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133940431 ms)
2022-10-07 04:20:13.296 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133940432 ms)
2022-10-07 04:20:13.297 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42342)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133940433 ms)
2022-10-07 04:20:29.374 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133956509 ms)
2022-10-07 04:20:29.374 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133956510 ms)
2022-10-07 04:20:29.376 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42360)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133956511 ms)
2022-10-07 04:20:30.465 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133957601 ms)
2022-10-07 04:20:30.466 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133957601 ms)
2022-10-07 04:20:30.467 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42362)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133957603 ms)
2022-10-07 04:20:32.345 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2133959481 ms)
2022-10-07 04:20:32.346 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2133959481 ms)
2022-10-07 04:20:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:20:31.122608+00:00', 'runtime': '2133960.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.5', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.708', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133959482 ms)
2022-10-07 04:20:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:19:31.122597+00:00', 'runtime': '2133900.001', 'adc_vb_f': '12.701', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.704', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2133959483 ms)
2022-10-07 04:20:33.535 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133960671 ms)
2022-10-07 04:20:33.536 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133960671 ms)
2022-10-07 04:20:33.536 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42366)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133960671 ms)
2022-10-07 04:20:38.626 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133965761 ms)
2022-10-07 04:20:38.626 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133965761 ms)
2022-10-07 04:20:38.627 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42372)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133965762 ms)
2022-10-07 04:20:48.705 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133975841 ms)
2022-10-07 04:20:48.706 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133975841 ms)
2022-10-07 04:20:48.706 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42386)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133975841 ms)
2022-10-07 04:20:57.804 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133984939 ms)
2022-10-07 04:20:57.804 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133984940 ms)
2022-10-07 04:20:57.805 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42396)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133984941 ms)
2022-10-07 04:21:09.904 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2133997040 ms)
2022-10-07 04:21:09.905 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2133997040 ms)
2022-10-07 04:21:09.906 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42420)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2133997041 ms)
2022-10-07 04:21:25.983 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134013118 ms)
2022-10-07 04:21:25.983 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134013119 ms)
2022-10-07 04:21:25.984 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42438)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134013119 ms)
2022-10-07 04:21:32.347 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134019482 ms)
2022-10-07 04:21:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134019483 ms)
2022-10-07 04:21:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:21:31.122662+00:00', 'runtime': '2134020.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.701', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.689', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134019485 ms)
2022-10-07 04:21:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:20:31.122608+00:00', 'runtime': '2133960.001', 'adc_vb_f': '12.711', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.002', 'adc_il_f': '0.5', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.708', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.7', 'ahl_t': '507.7', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.695', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.3', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134019485 ms)
2022-10-07 04:21:40.063 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134027198 ms)
2022-10-07 04:21:40.063 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134027199 ms)
2022-10-07 04:21:40.066 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42456)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134027201 ms)
2022-10-07 04:21:40.107 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134027242 ms)
2022-10-07 04:21:40.107 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134027243 ms)
2022-10-07 04:21:40.109 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42458)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134027244 ms)
2022-10-07 04:21:43.206 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134030342 ms)
2022-10-07 04:21:43.207 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134030342 ms)
2022-10-07 04:21:43.208 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42462)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134030344 ms)
2022-10-07 04:21:47.276 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134034411 ms)
2022-10-07 04:21:47.276 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134034412 ms)
2022-10-07 04:21:47.278 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42468)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134034413 ms)
2022-10-07 04:21:56.357 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134043493 ms)
2022-10-07 04:21:56.358 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134043493 ms)
2022-10-07 04:21:56.359 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42478)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134043495 ms)
2022-10-07 04:22:03.456 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134050591 ms)
2022-10-07 04:22:03.456 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134050592 ms)
2022-10-07 04:22:03.458 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42486)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134050593 ms)
2022-10-07 04:22:08.536 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134055672 ms)
2022-10-07 04:22:08.537 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134055672 ms)
2022-10-07 04:22:08.538 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42492)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134055674 ms)
2022-10-07 04:22:08.577 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134055713 ms)
2022-10-07 04:22:08.578 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134055713 ms)
2022-10-07 04:22:08.580 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42494)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134055716 ms)
2022-10-07 04:22:09.667 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134056802 ms)
2022-10-07 04:22:09.667 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134056803 ms)
2022-10-07 04:22:09.668 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42496)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134056804 ms)
2022-10-07 04:22:09.706 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134056842 ms)
2022-10-07 04:22:09.707 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134056842 ms)
2022-10-07 04:22:09.708 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42498)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134056844 ms)
2022-10-07 04:22:16.815 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134063950 ms)
2022-10-07 04:22:16.815 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134063951 ms)
2022-10-07 04:22:16.817 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42506)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134063952 ms)
2022-10-07 04:22:17.888 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134065023 ms)
2022-10-07 04:22:17.888 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134065024 ms)
2022-10-07 04:22:17.890 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42508)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134065025 ms)
2022-10-07 04:22:25.948 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134073083 ms)
2022-10-07 04:22:25.948 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134073083 ms)
2022-10-07 04:22:25.949 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42518)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134073084 ms)
2022-10-07 04:22:25.987 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134073122 ms)
2022-10-07 04:22:25.987 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134073122 ms)
2022-10-07 04:22:25.988 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42520)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134073124 ms)
2022-10-07 04:22:29.056 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134076191 ms)
2022-10-07 04:22:29.056 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134076192 ms)
2022-10-07 04:22:29.058 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42524)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134076193 ms)
2022-10-07 04:22:32.363 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134079498 ms)
2022-10-07 04:22:32.364 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134079499 ms)
2022-10-07 04:22:32.366 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:22:31.122670+00:00', 'runtime': '2134080.001', 'adc_vb_f': '12.701', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.558', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.704', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.689', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134079501 ms)
2022-10-07 04:22:32.367 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:21:31.122662+00:00', 'runtime': '2134020.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.701', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.689', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134079502 ms)
2022-10-07 04:22:35.108 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134082243 ms)
2022-10-07 04:22:35.108 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134082244 ms)
2022-10-07 04:22:35.109 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42532)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134082245 ms)
2022-10-07 04:22:39.185 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134086320 ms)
2022-10-07 04:22:39.185 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134086321 ms)
2022-10-07 04:22:39.186 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42538)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134086321 ms)
2022-10-07 04:22:44.256 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134091392 ms)
2022-10-07 04:22:44.257 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134091392 ms)
2022-10-07 04:22:44.257 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42544)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134091392 ms)
2022-10-07 04:22:44.286 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134091422 ms)
2022-10-07 04:22:44.286 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134091422 ms)
2022-10-07 04:22:44.287 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42546)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134091422 ms)
2022-10-07 04:22:48.337 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134095473 ms)
2022-10-07 04:22:48.338 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134095473 ms)
2022-10-07 04:22:48.338 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42554)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134095473 ms)
2022-10-07 04:22:49.417 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134096552 ms)
2022-10-07 04:22:49.417 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134096553 ms)
2022-10-07 04:22:49.418 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42556)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134096553 ms)
2022-10-07 04:23:03.497 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134110632 ms)
2022-10-07 04:23:03.498 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134110633 ms)
2022-10-07 04:23:03.498 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42572)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134110634 ms)
2022-10-07 04:23:04.583 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134111719 ms)
2022-10-07 04:23:04.584 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134111719 ms)
2022-10-07 04:23:04.584 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42574)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134111720 ms)
2022-10-07 04:23:25.678 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134132813 ms)
2022-10-07 04:23:25.678 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134132814 ms)
2022-10-07 04:23:25.680 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42596)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134132815 ms)
2022-10-07 04:23:32.353 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134139488 ms)
2022-10-07 04:23:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134139489 ms)
2022-10-07 04:23:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:23:31.122647+00:00', 'runtime': '2134140.001', 'adc_vb_f': '12.704', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.524', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.701', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.689', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134139490 ms)
2022-10-07 04:23:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:22:31.122670+00:00', 'runtime': '2134080.001', 'adc_vb_f': '12.701', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.558', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.704', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.689', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134139491 ms)
2022-10-07 04:23:38.777 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134145912 ms)
2022-10-07 04:23:38.777 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134145913 ms)
2022-10-07 04:23:38.778 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42610)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134145914 ms)
2022-10-07 04:23:41.874 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134149009 ms)
2022-10-07 04:23:41.875 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134149010 ms)
2022-10-07 04:23:41.876 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42614)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134149011 ms)
2022-10-07 04:23:46.957 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134154093 ms)
2022-10-07 04:23:46.958 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134154093 ms)
2022-10-07 04:23:46.959 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42620)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134154094 ms)
2022-10-07 04:23:48.045 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134155181 ms)
2022-10-07 04:23:48.046 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134155181 ms)
2022-10-07 04:23:48.047 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42622)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134155183 ms)
2022-10-07 04:23:57.136 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134164271 ms)
2022-10-07 04:23:57.136 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134164272 ms)
2022-10-07 04:23:57.137 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42632)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134164273 ms)
2022-10-07 04:23:58.218 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134165354 ms)
2022-10-07 04:23:58.219 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134165354 ms)
2022-10-07 04:23:58.220 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42634)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134165355 ms)
2022-10-07 04:24:01.324 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134168460 ms)
2022-10-07 04:24:01.325 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134168460 ms)
2022-10-07 04:24:01.326 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42638)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134168462 ms)
2022-10-07 04:24:01.358 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134168494 ms)
2022-10-07 04:24:01.359 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134168494 ms)
2022-10-07 04:24:01.360 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42640)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134168495 ms)
2022-10-07 04:24:19.427 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134186563 ms)
2022-10-07 04:24:19.428 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134186563 ms)
2022-10-07 04:24:19.429 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42660)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134186565 ms)
2022-10-07 04:24:23.497 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134190633 ms)
2022-10-07 04:24:23.498 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134190633 ms)
2022-10-07 04:24:23.499 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42666)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134190635 ms)
2022-10-07 04:24:32.359 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134199495 ms)
2022-10-07 04:24:32.360 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134199495 ms)
2022-10-07 04:24:32.360 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:24:31.125395+00:00', 'runtime': '2134200.004', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.553', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.701', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.689', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134199496 ms)
2022-10-07 04:24:32.361 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:23:31.122647+00:00', 'runtime': '2134140.001', 'adc_vb_f': '12.704', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.524', 't_hs': '20', 't_batt': '23', 't_amb': '23', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.701', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.689', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134199496 ms)
2022-10-07 04:24:36.609 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134203745 ms)
2022-10-07 04:24:36.610 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134203746 ms)
2022-10-07 04:24:36.612 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42682)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134203748 ms)
2022-10-07 04:24:41.698 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134208833 ms)
2022-10-07 04:24:41.698 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134208834 ms)
2022-10-07 04:24:41.699 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42688)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134208834 ms)
2022-10-07 04:24:44.748 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134211884 ms)
2022-10-07 04:24:44.749 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134211884 ms)
2022-10-07 04:24:44.749 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42692)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134211885 ms)
2022-10-07 04:24:55.854 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134222990 ms)
2022-10-07 04:24:55.855 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134222990 ms)
2022-10-07 04:24:55.856 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42706)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134222992 ms)
2022-10-07 04:25:05.928 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134233064 ms)
2022-10-07 04:25:05.929 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134233064 ms)
2022-10-07 04:25:05.930 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42718)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134233065 ms)
2022-10-07 04:25:15.014 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134242149 ms)
2022-10-07 04:25:15.014 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134242150 ms)
2022-10-07 04:25:15.016 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42728)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134242151 ms)
2022-10-07 04:25:25.106 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134252241 ms)
2022-10-07 04:25:25.106 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134252242 ms)
2022-10-07 04:25:25.107 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42740)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134252243 ms)
2022-10-07 04:25:32.345 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134259481 ms)
2022-10-07 04:25:32.346 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134259481 ms)
2022-10-07 04:25:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:25:31.122612+00:00', 'runtime': '2134260.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.56', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.698', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.686', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134259482 ms)
2022-10-07 04:25:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:24:31.125395+00:00', 'runtime': '2134200.004', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.553', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.701', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.689', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134259483 ms)
2022-10-07 04:25:47.208 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134274343 ms)
2022-10-07 04:25:47.208 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134274343 ms)
2022-10-07 04:25:47.209 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42764)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134274345 ms)
2022-10-07 04:25:51.258 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134278393 ms)
2022-10-07 04:25:51.259 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134278394 ms)
2022-10-07 04:25:51.260 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42770)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134278395 ms)
2022-10-07 04:25:51.298 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134278433 ms)
2022-10-07 04:25:51.298 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134278434 ms)
2022-10-07 04:25:51.300 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42772)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134278435 ms)
2022-10-07 04:25:53.368 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134280503 ms)
2022-10-07 04:25:53.368 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134280504 ms)
2022-10-07 04:25:53.370 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42776)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134280505 ms)
2022-10-07 04:25:54.438 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134281574 ms)
2022-10-07 04:25:54.439 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134281574 ms)
2022-10-07 04:25:54.440 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42778)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134281576 ms)
2022-10-07 04:26:20.549 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134307684 ms)
2022-10-07 04:26:20.549 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134307685 ms)
2022-10-07 04:26:20.551 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42806)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134307686 ms)
2022-10-07 04:26:32.347 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134319482 ms)
2022-10-07 04:26:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134319483 ms)
2022-10-07 04:26:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:26:31.122651+00:00', 'runtime': '2134320.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.544', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.701', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.686', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134319485 ms)
2022-10-07 04:26:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:25:31.122612+00:00', 'runtime': '2134260.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.56', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.698', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.686', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134319485 ms)
2022-10-07 04:26:32.608 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134319743 ms)
2022-10-07 04:26:32.608 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134319744 ms)
2022-10-07 04:26:32.608 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42822)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134319744 ms)
2022-10-07 04:26:42.688 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134329824 ms)
2022-10-07 04:26:42.688 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134329824 ms)
2022-10-07 04:26:42.689 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42836)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134329825 ms)
2022-10-07 04:26:47.758 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134334893 ms)
2022-10-07 04:26:47.758 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134334893 ms)
2022-10-07 04:26:47.758 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42844)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134334894 ms)
2022-10-07 04:26:48.839 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134335975 ms)
2022-10-07 04:26:48.839 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134335975 ms)
2022-10-07 04:26:48.840 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42846)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134335975 ms)
2022-10-07 04:26:49.936 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134337072 ms)
2022-10-07 04:26:49.937 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134337072 ms)
2022-10-07 04:26:49.937 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42848)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134337073 ms)
2022-10-07 04:26:56.019 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134343154 ms)
2022-10-07 04:26:56.019 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134343155 ms)
2022-10-07 04:26:56.022 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42856)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134343157 ms)
2022-10-07 04:27:04.078 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134351214 ms)
2022-10-07 04:27:04.079 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134351214 ms)
2022-10-07 04:27:04.080 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42866)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134351216 ms)
2022-10-07 04:27:11.243 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134358379 ms)
2022-10-07 04:27:11.244 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134358379 ms)
2022-10-07 04:27:11.245 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42874)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134358381 ms)
2022-10-07 04:27:14.318 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134361454 ms)
2022-10-07 04:27:14.319 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134361454 ms)
2022-10-07 04:27:14.320 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42878)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134361456 ms)
2022-10-07 04:27:14.358 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134361494 ms)
2022-10-07 04:27:14.359 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134361494 ms)
2022-10-07 04:27:14.360 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42880)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134361496 ms)
2022-10-07 04:27:27.465 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134374601 ms)
2022-10-07 04:27:27.466 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134374601 ms)
2022-10-07 04:27:27.467 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42894)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134374603 ms)
2022-10-07 04:27:32.357 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134379492 ms)
2022-10-07 04:27:32.358 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134379493 ms)
2022-10-07 04:27:32.360 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:27:31.122631+00:00', 'runtime': '2134380.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.522', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.698', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.683', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134379496 ms)
2022-10-07 04:27:32.361 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:26:31.122651+00:00', 'runtime': '2134320.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.544', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.701', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.686', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134379497 ms)
2022-10-07 04:27:33.547 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134380682 ms)
2022-10-07 04:27:33.547 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134380683 ms)
2022-10-07 04:27:33.549 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42902)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134380684 ms)
2022-10-07 04:27:40.638 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134387773 ms)
2022-10-07 04:27:40.639 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134387774 ms)
2022-10-07 04:27:40.640 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42910)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134387775 ms)
2022-10-07 04:27:40.679 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134387814 ms)
2022-10-07 04:27:40.680 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134387815 ms)
2022-10-07 04:27:40.681 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42912)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134387816 ms)
2022-10-07 04:27:44.750 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134391886 ms)
2022-10-07 04:27:44.751 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134391886 ms)
2022-10-07 04:27:44.752 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42918)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134391888 ms)
2022-10-07 04:27:49.837 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134396972 ms)
2022-10-07 04:27:49.837 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134396973 ms)
2022-10-07 04:27:49.839 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42924)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134396974 ms)
2022-10-07 04:27:53.926 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134401062 ms)
2022-10-07 04:27:53.927 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134401062 ms)
2022-10-07 04:27:53.928 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42930)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134401064 ms)
2022-10-07 04:27:57.986 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134405122 ms)
2022-10-07 04:27:57.987 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134405122 ms)
2022-10-07 04:27:57.988 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42936)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134405124 ms)
2022-10-07 04:27:58.029 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134405165 ms)
2022-10-07 04:27:58.030 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134405165 ms)
2022-10-07 04:27:58.031 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42938)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134405167 ms)
2022-10-07 04:28:00.105 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134407241 ms)
2022-10-07 04:28:00.106 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134407241 ms)
2022-10-07 04:28:00.107 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42942)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134407243 ms)
2022-10-07 04:28:04.179 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134411314 ms)
2022-10-07 04:28:04.179 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134411315 ms)
2022-10-07 04:28:04.180 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42948)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134411316 ms)
2022-10-07 04:28:05.248 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134412384 ms)
2022-10-07 04:28:05.249 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134412385 ms)
2022-10-07 04:28:05.250 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42950)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134412386 ms)
2022-10-07 04:28:05.288 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134412424 ms)
2022-10-07 04:28:05.289 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134412424 ms)
2022-10-07 04:28:05.290 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42952)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134412426 ms)
2022-10-07 04:28:08.404 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134415539 ms)
2022-10-07 04:28:08.404 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134415540 ms)
2022-10-07 04:28:08.406 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42956)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134415541 ms)
2022-10-07 04:28:12.485 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134419621 ms)
2022-10-07 04:28:12.486 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134419621 ms)
2022-10-07 04:28:12.487 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42962)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134419623 ms)
2022-10-07 04:28:12.517 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134419653 ms)
2022-10-07 04:28:12.518 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134419653 ms)
2022-10-07 04:28:12.519 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42964)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134419654 ms)
2022-10-07 04:28:13.597 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134420732 ms)
2022-10-07 04:28:13.598 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134420733 ms)
2022-10-07 04:28:13.599 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42966)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134420734 ms)
2022-10-07 04:28:16.686 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134423821 ms)
2022-10-07 04:28:16.686 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134423822 ms)
2022-10-07 04:28:16.687 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42970)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134423823 ms)
2022-10-07 04:28:16.719 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134423855 ms)
2022-10-07 04:28:16.720 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134423855 ms)
2022-10-07 04:28:16.721 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42972)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134423857 ms)
2022-10-07 04:28:23.817 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134430952 ms)
2022-10-07 04:28:23.817 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134430953 ms)
2022-10-07 04:28:23.819 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 42980)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134430954 ms)
2022-10-07 04:28:32.345 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134439481 ms)
2022-10-07 04:28:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134439482 ms)
2022-10-07 04:28:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:28:31.122595+00:00', 'runtime': '2134440.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.695', 'adc_ic_f': '0.002', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.698', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.683', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134439486 ms)
2022-10-07 04:28:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:27:31.122631+00:00', 'runtime': '2134380.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.522', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.698', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.683', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134439487 ms)
2022-10-07 04:28:47.889 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134455024 ms)
2022-10-07 04:28:47.889 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134455024 ms)
2022-10-07 04:28:47.890 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43008)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134455025 ms)
2022-10-07 04:28:47.929 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134455065 ms)
2022-10-07 04:28:47.930 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134455065 ms)
2022-10-07 04:28:47.930 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43010)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134455066 ms)
2022-10-07 04:28:49.1000 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134457135 ms)
2022-10-07 04:28:50.000 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134457135 ms)
2022-10-07 04:28:50.001 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43014)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134457137 ms)
2022-10-07 04:28:57.079 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134464214 ms)
2022-10-07 04:28:57.079 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134464215 ms)
2022-10-07 04:28:57.081 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43022)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134464216 ms)
2022-10-07 04:29:02.158 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134469294 ms)
2022-10-07 04:29:02.159 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134469294 ms)
2022-10-07 04:29:02.160 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43028)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134469296 ms)
2022-10-07 04:29:02.198 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134469334 ms)
2022-10-07 04:29:02.199 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134469334 ms)
2022-10-07 04:29:02.201 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43030)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134469337 ms)
2022-10-07 04:29:09.278 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134476413 ms)
2022-10-07 04:29:09.278 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134476414 ms)
2022-10-07 04:29:09.280 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43038)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134476415 ms)
2022-10-07 04:29:14.385 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134481520 ms)
2022-10-07 04:29:14.385 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134481521 ms)
2022-10-07 04:29:14.387 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43044)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134481522 ms)
2022-10-07 04:29:17.450 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134484585 ms)
2022-10-07 04:29:17.450 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134484586 ms)
2022-10-07 04:29:17.451 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43048)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134484586 ms)
2022-10-07 04:29:23.536 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134490672 ms)
2022-10-07 04:29:23.537 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134490672 ms)
2022-10-07 04:29:23.538 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43056)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134490673 ms)
2022-10-07 04:29:31.403 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134498538 ms)
2022-10-07 04:29:31.403 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134498539 ms)
2022-10-07 04:29:31.404 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:29:31.122595+00:00', 'runtime': '2134500.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.695', 'adc_ic_f': '0.002', 'adc_il_f': '0.548', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.695', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.683', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134498540 ms)
2022-10-07 04:29:31.405 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:28:31.122595+00:00', 'runtime': '2134440.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.695', 'adc_ic_f': '0.002', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.698', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.683', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134498540 ms)
2022-10-07 04:29:32.646 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134499782 ms)
2022-10-07 04:29:32.647 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134499782 ms)
2022-10-07 04:29:32.647 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43068)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134499783 ms)
2022-10-07 04:29:34.719 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134501854 ms)
2022-10-07 04:29:34.719 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134501855 ms)
2022-10-07 04:29:34.720 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43072)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134501855 ms)
2022-10-07 04:29:46.787 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134513922 ms)
2022-10-07 04:29:46.787 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134513923 ms)
2022-10-07 04:29:46.788 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43086)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134513924 ms)
2022-10-07 04:29:46.829 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134513964 ms)
2022-10-07 04:29:46.829 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134513965 ms)
2022-10-07 04:29:46.831 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43088)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134513966 ms)
2022-10-07 04:29:59.938 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134527074 ms)
2022-10-07 04:29:59.939 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134527074 ms)
2022-10-07 04:29:59.940 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43102)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134527075 ms)
2022-10-07 04:29:59.978 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134527113 ms)
2022-10-07 04:29:59.978 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134527114 ms)
2022-10-07 04:29:59.979 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43104)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134527115 ms)
2022-10-07 04:30:02.050 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134529185 ms)
2022-10-07 04:30:02.050 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134529186 ms)
2022-10-07 04:30:02.052 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43108)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134529187 ms)
2022-10-07 04:30:18.147 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134545282 ms)
2022-10-07 04:30:18.147 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134545283 ms)
2022-10-07 04:30:18.148 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43126)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134545283 ms)
2022-10-07 04:30:25.256 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134552392 ms)
2022-10-07 04:30:25.257 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134552392 ms)
2022-10-07 04:30:25.258 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43134)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134552393 ms)
2022-10-07 04:30:32.354 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134559489 ms)
2022-10-07 04:30:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134559490 ms)
2022-10-07 04:30:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:30:31.122583+00:00', 'runtime': '2134560.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.51', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.698', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.683', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134559491 ms)
2022-10-07 04:30:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:29:31.122595+00:00', 'runtime': '2134500.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.695', 'adc_ic_f': '0.002', 'adc_il_f': '0.548', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.695', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.683', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134559491 ms)
2022-10-07 04:30:52.396 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134579531 ms)
2022-10-07 04:30:52.396 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134579532 ms)
2022-10-07 04:30:52.398 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43164)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134579533 ms)
2022-10-07 04:30:53.450 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134580585 ms)
2022-10-07 04:30:53.450 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134580586 ms)
2022-10-07 04:30:53.452 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43166)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134580587 ms)
2022-10-07 04:30:55.498 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134582634 ms)
2022-10-07 04:30:55.499 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134582634 ms)
2022-10-07 04:30:55.500 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43170)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134582635 ms)
2022-10-07 04:30:55.539 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134582675 ms)
2022-10-07 04:30:55.540 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134582675 ms)
2022-10-07 04:30:55.541 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43172)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134582677 ms)
2022-10-07 04:30:56.610 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134583745 ms)
2022-10-07 04:30:56.610 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134583746 ms)
2022-10-07 04:30:56.611 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43174)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134583747 ms)
2022-10-07 04:30:58.686 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134585821 ms)
2022-10-07 04:30:58.686 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134585822 ms)
2022-10-07 04:30:58.688 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43178)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134585823 ms)
2022-10-07 04:30:58.720 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134585856 ms)
2022-10-07 04:30:58.721 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134585856 ms)
2022-10-07 04:30:58.722 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43180)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134585858 ms)
2022-10-07 04:30:58.760 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134585896 ms)
2022-10-07 04:30:58.761 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134585896 ms)
2022-10-07 04:30:58.762 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43182)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134585897 ms)
2022-10-07 04:31:23.885 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134611021 ms)
2022-10-07 04:31:23.886 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134611021 ms)
2022-10-07 04:31:23.886 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43218)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134611022 ms)
2022-10-07 04:31:31.406 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134618541 ms)
2022-10-07 04:31:31.406 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134618542 ms)
2022-10-07 04:31:31.407 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:31:31.122664+00:00', 'runtime': '2134620.001', 'adc_vb_f': '12.692', 'adc_va_f': '0.235', 'adc_vl_f': '12.668', 'adc_ic_f': '0.002', 'adc_il_f': '0.573', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.68', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134618543 ms)
2022-10-07 04:31:31.408 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:30:31.122583+00:00', 'runtime': '2134560.001', 'adc_vb_f': '12.698', 'adc_va_f': '0.235', 'adc_vl_f': '12.698', 'adc_ic_f': '0.005', 'adc_il_f': '0.51', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.698', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.683', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134618543 ms)
2022-10-07 04:31:32.966 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134620101 ms)
2022-10-07 04:31:32.966 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134620102 ms)
2022-10-07 04:31:32.967 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43230)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134620102 ms)
2022-10-07 04:31:43.050 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134630185 ms)
2022-10-07 04:31:43.050 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134630186 ms)
2022-10-07 04:31:43.052 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43242)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134630187 ms)
2022-10-07 04:31:44.137 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134631272 ms)
2022-10-07 04:31:44.137 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134631273 ms)
2022-10-07 04:31:44.139 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43244)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134631274 ms)
2022-10-07 04:31:48.218 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134635354 ms)
2022-10-07 04:31:48.219 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134635354 ms)
2022-10-07 04:31:48.220 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43250)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134635355 ms)
2022-10-07 04:31:48.259 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134635395 ms)
2022-10-07 04:31:48.260 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134635395 ms)
2022-10-07 04:31:48.261 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43252)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134635396 ms)
2022-10-07 04:31:57.340 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134644476 ms)
2022-10-07 04:31:57.341 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134644476 ms)
2022-10-07 04:31:57.342 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43262)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134644478 ms)
2022-10-07 04:31:57.387 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134644523 ms)
2022-10-07 04:31:57.388 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134644523 ms)
2022-10-07 04:31:57.389 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43264)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134644524 ms)
2022-10-07 04:31:58.469 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134645605 ms)
2022-10-07 04:31:58.470 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134645605 ms)
2022-10-07 04:31:58.471 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43266)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134645607 ms)
2022-10-07 04:31:58.520 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134645656 ms)
2022-10-07 04:31:58.521 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134645656 ms)
2022-10-07 04:31:58.522 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43268)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134645658 ms)
2022-10-07 04:32:05.618 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134652753 ms)
2022-10-07 04:32:05.618 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134652754 ms)
2022-10-07 04:32:05.620 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43276)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134652755 ms)
2022-10-07 04:32:09.690 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134656826 ms)
2022-10-07 04:32:09.691 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134656826 ms)
2022-10-07 04:32:09.692 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43282)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134656828 ms)
2022-10-07 04:32:13.739 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134660874 ms)
2022-10-07 04:32:13.739 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134660875 ms)
2022-10-07 04:32:13.741 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43288)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134660876 ms)
2022-10-07 04:32:21.826 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134668961 ms)
2022-10-07 04:32:21.827 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134668962 ms)
2022-10-07 04:32:21.828 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43298)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134668963 ms)
2022-10-07 04:32:21.858 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134668994 ms)
2022-10-07 04:32:21.859 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134668994 ms)
2022-10-07 04:32:21.860 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43300)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134668996 ms)
2022-10-07 04:32:29.930 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134677065 ms)
2022-10-07 04:32:29.930 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134677066 ms)
2022-10-07 04:32:29.932 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43310)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134677067 ms)
2022-10-07 04:32:32.344 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134679479 ms)
2022-10-07 04:32:32.344 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134679480 ms)
2022-10-07 04:32:32.345 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:32:31.122572+00:00', 'runtime': '2134680.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.68', 'adc_ic_f': '0.005', 'adc_il_f': '0.565', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.695', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.68', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134679481 ms)
2022-10-07 04:32:32.346 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:31:31.122664+00:00', 'runtime': '2134620.001', 'adc_vb_f': '12.692', 'adc_va_f': '0.235', 'adc_vl_f': '12.668', 'adc_ic_f': '0.002', 'adc_il_f': '0.573', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.8', 'ahl_t': '507.8', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.68', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.4', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134679481 ms)
2022-10-07 04:32:35.010 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134682146 ms)
2022-10-07 04:32:35.011 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134682146 ms)
2022-10-07 04:32:35.012 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43316)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134682147 ms)
2022-10-07 04:32:35.049 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134682185 ms)
2022-10-07 04:32:35.050 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134682185 ms)
2022-10-07 04:32:35.052 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43318)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134682187 ms)
2022-10-07 04:32:44.129 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134691265 ms)
2022-10-07 04:32:44.129 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134691265 ms)
2022-10-07 04:32:44.130 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43328)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134691266 ms)
2022-10-07 04:32:50.207 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134697343 ms)
2022-10-07 04:32:50.208 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134697343 ms)
2022-10-07 04:32:50.208 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43338)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134697344 ms)
2022-10-07 04:33:02.318 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134709454 ms)
2022-10-07 04:33:02.319 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134709454 ms)
2022-10-07 04:33:02.320 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43352)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134709456 ms)
2022-10-07 04:33:18.410 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134725546 ms)
2022-10-07 04:33:18.411 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134725546 ms)
2022-10-07 04:33:18.412 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43370)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134725548 ms)
2022-10-07 04:33:20.479 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134727614 ms)
2022-10-07 04:33:20.479 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134727615 ms)
2022-10-07 04:33:20.481 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43374)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134727616 ms)
2022-10-07 04:33:32.347 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134739483 ms)
2022-10-07 04:33:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134739483 ms)
2022-10-07 04:33:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:33:31.122626+00:00', 'runtime': '2134740.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.692', 'adc_ic_f': '0.005', 'adc_il_f': '0.515', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.68', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134739485 ms)
2022-10-07 04:33:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:32:31.122572+00:00', 'runtime': '2134680.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.68', 'adc_ic_f': '0.005', 'adc_il_f': '0.565', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.695', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.68', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134739485 ms)
2022-10-07 04:33:38.571 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134745706 ms)
2022-10-07 04:33:38.571 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134745707 ms)
2022-10-07 04:33:38.573 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43394)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134745708 ms)
2022-10-07 04:33:40.640 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134747775 ms)
2022-10-07 04:33:40.640 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134747776 ms)
2022-10-07 04:33:40.642 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43398)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134747777 ms)
2022-10-07 04:33:44.707 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134751842 ms)
2022-10-07 04:33:44.707 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134751843 ms)
2022-10-07 04:33:44.708 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43404)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134751844 ms)
2022-10-07 04:33:45.805 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134752941 ms)
2022-10-07 04:33:45.806 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134752941 ms)
2022-10-07 04:33:45.807 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43406)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134752942 ms)
2022-10-07 04:33:46.900 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134754035 ms)
2022-10-07 04:33:46.900 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134754036 ms)
2022-10-07 04:33:46.902 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43408)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134754037 ms)
2022-10-07 04:33:47.970 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134755106 ms)
2022-10-07 04:33:47.971 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134755106 ms)
2022-10-07 04:33:47.972 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43410)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134755108 ms)
2022-10-07 04:34:09.091 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134776226 ms)
2022-10-07 04:34:09.092 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134776227 ms)
2022-10-07 04:34:09.093 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43432)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134776228 ms)
2022-10-07 04:34:12.160 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134779296 ms)
2022-10-07 04:34:12.161 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134779296 ms)
2022-10-07 04:34:12.162 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43436)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134779298 ms)
2022-10-07 04:34:16.221 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134783356 ms)
2022-10-07 04:34:16.221 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134783357 ms)
2022-10-07 04:34:16.223 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43442)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134783358 ms)
2022-10-07 04:34:27.330 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134794466 ms)
2022-10-07 04:34:27.331 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134794466 ms)
2022-10-07 04:34:27.332 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43454)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134794467 ms)
2022-10-07 04:34:31.398 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134798534 ms)
2022-10-07 04:34:31.399 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134798534 ms)
2022-10-07 04:34:31.401 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:34:31.125406+00:00', 'runtime': '2134800.004', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.686', 'adc_ic_f': '0.005', 'adc_il_f': '0.527', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.695', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.68', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134798536 ms)
2022-10-07 04:34:31.401 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:33:31.122626+00:00', 'runtime': '2134740.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.692', 'adc_ic_f': '0.005', 'adc_il_f': '0.515', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.68', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134798537 ms)
2022-10-07 04:34:41.420 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134808555 ms)
2022-10-07 04:34:41.420 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134808555 ms)
2022-10-07 04:34:41.420 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43472)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134808556 ms)
2022-10-07 04:34:53.501 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134820637 ms)
2022-10-07 04:34:53.502 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134820637 ms)
2022-10-07 04:34:53.503 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43488)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134820638 ms)
2022-10-07 04:34:53.548 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134820683 ms)
2022-10-07 04:34:53.548 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134820684 ms)
2022-10-07 04:34:53.550 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43490)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134820685 ms)
2022-10-07 04:34:57.630 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134824765 ms)
2022-10-07 04:34:57.631 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134824766 ms)
2022-10-07 04:34:57.632 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43496)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134824767 ms)
2022-10-07 04:34:57.671 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134824806 ms)
2022-10-07 04:34:57.671 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134824807 ms)
2022-10-07 04:34:57.673 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43498)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134824808 ms)
2022-10-07 04:35:14.788 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134841923 ms)
2022-10-07 04:35:14.788 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134841924 ms)
2022-10-07 04:35:14.790 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43516)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134841925 ms)
2022-10-07 04:35:22.841 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134849976 ms)
2022-10-07 04:35:22.841 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134849977 ms)
2022-10-07 04:35:22.842 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43526)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134849978 ms)
2022-10-07 04:35:26.916 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134854052 ms)
2022-10-07 04:35:26.917 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134854052 ms)
2022-10-07 04:35:26.918 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43532)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134854054 ms)
2022-10-07 04:35:29.991 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134857126 ms)
2022-10-07 04:35:29.991 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134857127 ms)
2022-10-07 04:35:29.993 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43536)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134857128 ms)
2022-10-07 04:35:32.353 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134859489 ms)
2022-10-07 04:35:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134859489 ms)
2022-10-07 04:35:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:35:31.123964+00:00', 'runtime': '2134860.002', 'adc_vb_f': '12.692', 'adc_va_f': '0.235', 'adc_vl_f': '12.674', 'adc_ic_f': '0.005', 'adc_il_f': '0.558', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.677', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134859490 ms)
2022-10-07 04:35:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:34:31.125406+00:00', 'runtime': '2134800.004', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.686', 'adc_ic_f': '0.005', 'adc_il_f': '0.527', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.695', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.68', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134859491 ms)
2022-10-07 04:35:58.090 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134885225 ms)
2022-10-07 04:35:58.090 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134885226 ms)
2022-10-07 04:35:58.092 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43566)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134885227 ms)
2022-10-07 04:36:12.182 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134899318 ms)
2022-10-07 04:36:12.183 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134899318 ms)
2022-10-07 04:36:12.184 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43582)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134899319 ms)
2022-10-07 04:36:18.262 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134905397 ms)
2022-10-07 04:36:18.262 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134905397 ms)
2022-10-07 04:36:18.263 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43590)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134905399 ms)
2022-10-07 04:36:23.369 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134910504 ms)
2022-10-07 04:36:23.369 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134910504 ms)
2022-10-07 04:36:23.370 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43596)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134910506 ms)
2022-10-07 04:36:28.450 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134915585 ms)
2022-10-07 04:36:28.450 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134915586 ms)
2022-10-07 04:36:28.451 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43602)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134915587 ms)
2022-10-07 04:36:32.355 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134919490 ms)
2022-10-07 04:36:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134919491 ms)
2022-10-07 04:36:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:36:31.122652+00:00', 'runtime': '2134920.001', 'adc_vb_f': '12.692', 'adc_va_f': '0.235', 'adc_vl_f': '12.68', 'adc_ic_f': '0.005', 'adc_il_f': '0.539', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.677', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134919492 ms)
2022-10-07 04:36:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:35:31.123964+00:00', 'runtime': '2134860.002', 'adc_vb_f': '12.692', 'adc_va_f': '0.235', 'adc_vl_f': '12.674', 'adc_ic_f': '0.005', 'adc_il_f': '0.558', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.677', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134919492 ms)
2022-10-07 04:36:32.527 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134919663 ms)
2022-10-07 04:36:32.528 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134919663 ms)
2022-10-07 04:36:32.528 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43610)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134919664 ms)
2022-10-07 04:36:35.620 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134922756 ms)
2022-10-07 04:36:35.620 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134922756 ms)
2022-10-07 04:36:35.621 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43614)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134922757 ms)
2022-10-07 04:36:35.650 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134922786 ms)
2022-10-07 04:36:35.650 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134922786 ms)
2022-10-07 04:36:35.651 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43616)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134922786 ms)
2022-10-07 04:36:37.720 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134924855 ms)
2022-10-07 04:36:37.720 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134924855 ms)
2022-10-07 04:36:37.721 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43622)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134924856 ms)
2022-10-07 04:36:42.801 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134929937 ms)
2022-10-07 04:36:42.802 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134929937 ms)
2022-10-07 04:36:42.802 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43628)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134929938 ms)
2022-10-07 04:36:46.860 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134933995 ms)
2022-10-07 04:36:46.860 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134933996 ms)
2022-10-07 04:36:46.861 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43636)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134933996 ms)
2022-10-07 04:36:46.897 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134934032 ms)
2022-10-07 04:36:46.897 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134934033 ms)
2022-10-07 04:36:46.898 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43638)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134934033 ms)
2022-10-07 04:36:56.980 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134944115 ms)
2022-10-07 04:36:56.980 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134944116 ms)
2022-10-07 04:36:56.982 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43650)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134944117 ms)
2022-10-07 04:37:02.090 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134949225 ms)
2022-10-07 04:37:02.090 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134949226 ms)
2022-10-07 04:37:02.092 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43656)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134949227 ms)
2022-10-07 04:37:07.188 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134954324 ms)
2022-10-07 04:37:07.189 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134954324 ms)
2022-10-07 04:37:07.190 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43662)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134954326 ms)
2022-10-07 04:37:08.260 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134955395 ms)
2022-10-07 04:37:08.261 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134955396 ms)
2022-10-07 04:37:08.262 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43664)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134955397 ms)
2022-10-07 04:37:11.330 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134958466 ms)
2022-10-07 04:37:11.331 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134958466 ms)
2022-10-07 04:37:11.332 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43668)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134958468 ms)
2022-10-07 04:37:18.440 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134965575 ms)
2022-10-07 04:37:18.440 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134965576 ms)
2022-10-07 04:37:18.442 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43676)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134965577 ms)
2022-10-07 04:37:18.480 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134965615 ms)
2022-10-07 04:37:18.480 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134965616 ms)
2022-10-07 04:37:18.482 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43678)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134965617 ms)
2022-10-07 04:37:19.550 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134966686 ms)
2022-10-07 04:37:19.551 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134966686 ms)
2022-10-07 04:37:19.552 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43680)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134966688 ms)
2022-10-07 04:37:24.641 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134971777 ms)
2022-10-07 04:37:24.642 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134971777 ms)
2022-10-07 04:37:24.643 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43686)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134971779 ms)
2022-10-07 04:37:32.343 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2134979478 ms)
2022-10-07 04:37:32.343 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2134979479 ms)
2022-10-07 04:37:32.345 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:37:31.122592+00:00', 'runtime': '2134980.001', 'adc_vb_f': '12.689', 'adc_va_f': '0.235', 'adc_vl_f': '12.671', 'adc_ic_f': '0.005', 'adc_il_f': '0.558', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.689', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134979481 ms)
2022-10-07 04:37:32.346 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:36:31.122652+00:00', 'runtime': '2134920.001', 'adc_vb_f': '12.692', 'adc_va_f': '0.235', 'adc_vl_f': '12.68', 'adc_ic_f': '0.005', 'adc_il_f': '0.539', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.677', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2134979481 ms)
2022-10-07 04:37:37.739 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134984874 ms)
2022-10-07 04:37:37.739 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134984875 ms)
2022-10-07 04:37:37.741 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43700)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134984876 ms)
2022-10-07 04:37:41.821 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134988956 ms)
2022-10-07 04:37:41.821 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134988957 ms)
2022-10-07 04:37:41.823 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43706)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134988958 ms)
2022-10-07 04:37:48.900 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2134996035 ms)
2022-10-07 04:37:48.900 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2134996036 ms)
2022-10-07 04:37:48.902 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43714)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2134996037 ms)
2022-10-07 04:37:54.981 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135002116 ms)
2022-10-07 04:37:54.981 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135002117 ms)
2022-10-07 04:37:54.983 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43722)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135002118 ms)
2022-10-07 04:37:58.050 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135005185 ms)
2022-10-07 04:37:58.050 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135005186 ms)
2022-10-07 04:37:58.052 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43726)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135005187 ms)
2022-10-07 04:38:30.160 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135037296 ms)
2022-10-07 04:38:30.161 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135037296 ms)
2022-10-07 04:38:30.162 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43760)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135037298 ms)
2022-10-07 04:38:32.347 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135039482 ms)
2022-10-07 04:38:32.347 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135039483 ms)
2022-10-07 04:38:32.348 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:38:31.122637+00:00', 'runtime': '2135040.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.692', 'adc_ic_f': '0.005', 'adc_il_f': '0.495', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135039484 ms)
2022-10-07 04:38:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:37:31.122592+00:00', 'runtime': '2134980.001', 'adc_vb_f': '12.689', 'adc_va_f': '0.235', 'adc_vl_f': '12.671', 'adc_ic_f': '0.005', 'adc_il_f': '0.558', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.689', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135039486 ms)
2022-10-07 04:38:35.241 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135042377 ms)
2022-10-07 04:38:35.241 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135042377 ms)
2022-10-07 04:38:35.242 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43766)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135042378 ms)
2022-10-07 04:38:43.292 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135050427 ms)
2022-10-07 04:38:43.292 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135050428 ms)
2022-10-07 04:38:43.293 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43776)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135050429 ms)
2022-10-07 04:38:59.372 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135066507 ms)
2022-10-07 04:38:59.372 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135066508 ms)
2022-10-07 04:38:59.373 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43796)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135066508 ms)
2022-10-07 04:39:00.462 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135067597 ms)
2022-10-07 04:39:00.462 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135067598 ms)
2022-10-07 04:39:00.464 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43798)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135067599 ms)
2022-10-07 04:39:04.542 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135071677 ms)
2022-10-07 04:39:04.542 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135071678 ms)
2022-10-07 04:39:04.544 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43804)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135071679 ms)
2022-10-07 04:39:06.621 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135073756 ms)
2022-10-07 04:39:06.621 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135073757 ms)
2022-10-07 04:39:06.623 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43808)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135073758 ms)
2022-10-07 04:39:07.718 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135074854 ms)
2022-10-07 04:39:07.719 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135074854 ms)
2022-10-07 04:39:07.720 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43810)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135074856 ms)
2022-10-07 04:39:12.800 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135079936 ms)
2022-10-07 04:39:12.801 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135079936 ms)
2022-10-07 04:39:12.802 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43816)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135079938 ms)
2022-10-07 04:39:17.898 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135085033 ms)
2022-10-07 04:39:17.898 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135085034 ms)
2022-10-07 04:39:17.900 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43822)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135085035 ms)
2022-10-07 04:39:22.981 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135090116 ms)
2022-10-07 04:39:22.982 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135090117 ms)
2022-10-07 04:39:22.983 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43828)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135090118 ms)
2022-10-07 04:39:26.058 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135093193 ms)
2022-10-07 04:39:26.058 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135093194 ms)
2022-10-07 04:39:26.060 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43832)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135093195 ms)
2022-10-07 04:39:26.093 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135093229 ms)
2022-10-07 04:39:26.094 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135093229 ms)
2022-10-07 04:39:26.095 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43834)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135093230 ms)
2022-10-07 04:39:32.351 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135099487 ms)
2022-10-07 04:39:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135099487 ms)
2022-10-07 04:39:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:39:31.122698+00:00', 'runtime': '2135100.001', 'adc_vb_f': '12.689', 'adc_va_f': '0.235', 'adc_vl_f': '12.671', 'adc_ic_f': '0.002', 'adc_il_f': '0.548', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.689', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135099488 ms)
2022-10-07 04:39:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:38:31.122637+00:00', 'runtime': '2135040.001', 'adc_vb_f': '12.695', 'adc_va_f': '0.235', 'adc_vl_f': '12.692', 'adc_ic_f': '0.005', 'adc_il_f': '0.495', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.692', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135099489 ms)
2022-10-07 04:39:33.191 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135100327 ms)
2022-10-07 04:39:33.192 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135100327 ms)
2022-10-07 04:39:33.192 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43844)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135100327 ms)
2022-10-07 04:39:36.241 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135103376 ms)
2022-10-07 04:39:36.241 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135103377 ms)
2022-10-07 04:39:36.242 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43848)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135103377 ms)
2022-10-07 04:39:36.271 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135103407 ms)
2022-10-07 04:39:36.272 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135103407 ms)
2022-10-07 04:39:36.272 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43850)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135103408 ms)
2022-10-07 04:39:38.331 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135105467 ms)
2022-10-07 04:39:38.332 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135105467 ms)
2022-10-07 04:39:38.333 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43854)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135105468 ms)
2022-10-07 04:39:43.421 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135110557 ms)
2022-10-07 04:39:43.422 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135110557 ms)
2022-10-07 04:39:43.423 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43860)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135110558 ms)
2022-10-07 04:39:44.519 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135111654 ms)
2022-10-07 04:39:44.519 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135111655 ms)
2022-10-07 04:39:44.520 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43862)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135111656 ms)
2022-10-07 04:39:44.552 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135111687 ms)
2022-10-07 04:39:44.552 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135111688 ms)
2022-10-07 04:39:44.553 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43864)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135111689 ms)
2022-10-07 04:39:52.642 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135119777 ms)
2022-10-07 04:39:52.642 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135119778 ms)
2022-10-07 04:39:52.644 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43874)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135119779 ms)
2022-10-07 04:39:55.711 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135122846 ms)
2022-10-07 04:39:55.711 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135122847 ms)
2022-10-07 04:39:55.712 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43878)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135122848 ms)
2022-10-07 04:39:59.782 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135126917 ms)
2022-10-07 04:39:59.782 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135126917 ms)
2022-10-07 04:39:59.783 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43884)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135126919 ms)
2022-10-07 04:40:08.873 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135136008 ms)
2022-10-07 04:40:08.873 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135136009 ms)
2022-10-07 04:40:08.875 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43894)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135136010 ms)
2022-10-07 04:40:12.947 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135140082 ms)
2022-10-07 04:40:12.947 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135140083 ms)
2022-10-07 04:40:12.949 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43900)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135140084 ms)
2022-10-07 04:40:14.024 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135141159 ms)
2022-10-07 04:40:14.024 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135141160 ms)
2022-10-07 04:40:14.026 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43902)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135141161 ms)
2022-10-07 04:40:16.075 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135143211 ms)
2022-10-07 04:40:16.076 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135143211 ms)
2022-10-07 04:40:16.077 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43906)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135143213 ms)
2022-10-07 04:40:18.146 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135145281 ms)
2022-10-07 04:40:18.146 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135145282 ms)
2022-10-07 04:40:18.148 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43910)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135145283 ms)
2022-10-07 04:40:32.352 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135159488 ms)
2022-10-07 04:40:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135159489 ms)
2022-10-07 04:40:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:40:31.122631+00:00', 'runtime': '2135160.001', 'adc_vb_f': '12.692', 'adc_va_f': '0.232', 'adc_vl_f': '12.671', 'adc_ic_f': '0.005', 'adc_il_f': '0.519', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.689', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135159493 ms)
2022-10-07 04:40:32.358 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:39:31.122698+00:00', 'runtime': '2135100.001', 'adc_vb_f': '12.689', 'adc_va_f': '0.235', 'adc_vl_f': '12.671', 'adc_ic_f': '0.002', 'adc_il_f': '0.548', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.689', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135159494 ms)
2022-10-07 04:40:37.258 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135164394 ms)
2022-10-07 04:40:37.258 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135164394 ms)
2022-10-07 04:40:37.259 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43930)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135164394 ms)
2022-10-07 04:40:39.326 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135166462 ms)
2022-10-07 04:40:39.326 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135166462 ms)
2022-10-07 04:40:39.327 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43934)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135166462 ms)
2022-10-07 04:40:47.379 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135174514 ms)
2022-10-07 04:40:47.379 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135174514 ms)
2022-10-07 04:40:47.380 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43946)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135174515 ms)
2022-10-07 04:40:47.417 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135174552 ms)
2022-10-07 04:40:47.417 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135174553 ms)
2022-10-07 04:40:47.418 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43948)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135174554 ms)
2022-10-07 04:40:48.464 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135175599 ms)
2022-10-07 04:40:48.464 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135175600 ms)
2022-10-07 04:40:48.465 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43950)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135175600 ms)
2022-10-07 04:40:56.547 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135183682 ms)
2022-10-07 04:40:56.547 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135183683 ms)
2022-10-07 04:40:56.549 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43960)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135183684 ms)
2022-10-07 04:41:01.637 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135188772 ms)
2022-10-07 04:41:01.637 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135188773 ms)
2022-10-07 04:41:01.639 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43966)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135188774 ms)
2022-10-07 04:41:03.687 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135190822 ms)
2022-10-07 04:41:03.687 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135190823 ms)
2022-10-07 04:41:03.689 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43972)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135190824 ms)
2022-10-07 04:41:05.735 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135192871 ms)
2022-10-07 04:41:05.735 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135192871 ms)
2022-10-07 04:41:05.736 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43980)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135192872 ms)
2022-10-07 04:41:06.797 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135193932 ms)
2022-10-07 04:41:06.797 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135193933 ms)
2022-10-07 04:41:06.798 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43982)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135193933 ms)
2022-10-07 04:41:09.886 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135197022 ms)
2022-10-07 04:41:09.887 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135197022 ms)
2022-10-07 04:41:09.888 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43990)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135197024 ms)
2022-10-07 04:41:13.956 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135201091 ms)
2022-10-07 04:41:13.956 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135201092 ms)
2022-10-07 04:41:13.957 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 43996)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135201092 ms)
2022-10-07 04:41:16.033 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135203168 ms)
2022-10-07 04:41:16.033 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135203169 ms)
2022-10-07 04:41:16.034 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44000)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135203170 ms)
2022-10-07 04:41:17.134 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135204269 ms)
2022-10-07 04:41:17.134 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135204270 ms)
2022-10-07 04:41:17.136 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44002)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135204271 ms)
2022-10-07 04:41:19.207 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135206343 ms)
2022-10-07 04:41:19.208 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135206343 ms)
2022-10-07 04:41:19.209 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44006)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135206345 ms)
2022-10-07 04:41:24.303 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135211439 ms)
2022-10-07 04:41:24.304 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135211439 ms)
2022-10-07 04:41:24.305 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44012)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135211441 ms)
2022-10-07 04:41:26.376 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135213512 ms)
2022-10-07 04:41:26.377 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135213512 ms)
2022-10-07 04:41:26.378 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44016)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135213514 ms)
2022-10-07 04:41:32.342 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135219477 ms)
2022-10-07 04:41:32.342 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135219478 ms)
2022-10-07 04:41:32.343 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:41:31.122629+00:00', 'runtime': '2135220.001', 'adc_vb_f': '12.689', 'adc_va_f': '0.235', 'adc_vl_f': '12.665', 'adc_ic_f': '0.005', 'adc_il_f': '0.51', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.686', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135219479 ms)
2022-10-07 04:41:32.344 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:40:31.122631+00:00', 'runtime': '2135160.001', 'adc_vb_f': '12.692', 'adc_va_f': '0.232', 'adc_vl_f': '12.671', 'adc_ic_f': '0.005', 'adc_il_f': '0.519', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.689', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135219479 ms)
2022-10-07 04:41:40.466 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135227601 ms)
2022-10-07 04:41:40.466 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135227602 ms)
2022-10-07 04:41:40.468 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44032)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135227603 ms)
2022-10-07 04:41:42.544 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135229680 ms)
2022-10-07 04:41:42.545 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135229680 ms)
2022-10-07 04:41:42.546 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44036)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135229681 ms)
2022-10-07 04:41:42.587 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135229723 ms)
2022-10-07 04:41:42.588 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135229723 ms)
2022-10-07 04:41:42.589 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44038)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135229725 ms)
2022-10-07 04:41:46.637 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135233772 ms)
2022-10-07 04:41:46.637 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135233773 ms)
2022-10-07 04:41:46.641 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44044)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135233777 ms)
2022-10-07 04:41:55.747 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135242883 ms)
2022-10-07 04:41:55.748 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135242883 ms)
2022-10-07 04:41:55.749 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44054)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135242885 ms)
2022-10-07 04:42:00.837 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135247972 ms)
2022-10-07 04:42:00.837 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135247973 ms)
2022-10-07 04:42:00.838 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44060)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135247974 ms)
2022-10-07 04:42:11.916 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135259051 ms)
2022-10-07 04:42:11.916 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135259052 ms)
2022-10-07 04:42:11.917 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44072)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135259052 ms)
2022-10-07 04:42:14.994 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135262129 ms)
2022-10-07 04:42:14.994 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135262129 ms)
2022-10-07 04:42:14.995 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44076)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135262131 ms)
2022-10-07 04:42:20.066 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135267201 ms)
2022-10-07 04:42:20.066 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135267201 ms)
2022-10-07 04:42:20.067 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44082)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135267203 ms)
2022-10-07 04:42:30.156 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135277291 ms)
2022-10-07 04:42:30.156 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135277292 ms)
2022-10-07 04:42:30.158 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44094)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135277293 ms)
2022-10-07 04:42:30.195 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135277330 ms)
2022-10-07 04:42:30.195 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135277331 ms)
2022-10-07 04:42:30.196 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44096)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135277332 ms)
2022-10-07 04:42:31.246 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135278381 ms)
2022-10-07 04:42:31.246 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135278382 ms)
2022-10-07 04:42:31.247 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44098)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135278382 ms)
2022-10-07 04:42:32.342 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135279478 ms)
2022-10-07 04:42:32.343 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135279478 ms)
2022-10-07 04:42:32.345 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:42:31.122605+00:00', 'runtime': '2135280.001', 'adc_vb_f': '12.683', 'adc_va_f': '0.232', 'adc_vl_f': '12.662', 'adc_ic_f': '0.002', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.686', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135279480 ms)
2022-10-07 04:42:32.345 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:41:31.122629+00:00', 'runtime': '2135220.001', 'adc_vb_f': '12.689', 'adc_va_f': '0.235', 'adc_vl_f': '12.665', 'adc_ic_f': '0.005', 'adc_il_f': '0.51', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.686', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135279481 ms)
2022-10-07 04:42:42.315 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135289450 ms)
2022-10-07 04:42:42.315 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135289450 ms)
2022-10-07 04:42:42.315 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44112)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135289451 ms)
2022-10-07 04:42:44.386 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135291521 ms)
2022-10-07 04:42:44.386 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135291522 ms)
2022-10-07 04:42:44.386 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44116)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135291522 ms)
2022-10-07 04:42:46.426 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135293561 ms)
2022-10-07 04:42:46.426 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135293562 ms)
2022-10-07 04:42:46.428 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44122)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135293563 ms)
2022-10-07 04:42:53.505 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135300640 ms)
2022-10-07 04:42:53.505 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135300641 ms)
2022-10-07 04:42:53.507 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44130)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135300642 ms)
2022-10-07 04:42:55.583 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135302718 ms)
2022-10-07 04:42:55.583 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135302719 ms)
2022-10-07 04:42:55.585 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44134)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135302720 ms)
2022-10-07 04:42:58.635 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135305771 ms)
2022-10-07 04:42:58.636 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135305771 ms)
2022-10-07 04:42:58.637 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44138)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135305773 ms)
2022-10-07 04:42:58.674 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135305810 ms)
2022-10-07 04:42:58.675 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135305810 ms)
2022-10-07 04:42:58.676 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44140)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135305811 ms)
2022-10-07 04:43:11.761 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135318897 ms)
2022-10-07 04:43:11.762 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135318897 ms)
2022-10-07 04:43:11.763 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44154)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135318899 ms)
2022-10-07 04:43:11.795 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135318931 ms)
2022-10-07 04:43:11.796 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135318931 ms)
2022-10-07 04:43:11.797 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44156)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135318933 ms)
2022-10-07 04:43:18.884 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135326020 ms)
2022-10-07 04:43:18.885 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135326020 ms)
2022-10-07 04:43:18.886 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44164)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135326022 ms)
2022-10-07 04:43:19.975 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135327110 ms)
2022-10-07 04:43:19.975 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135327111 ms)
2022-10-07 04:43:19.977 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44166)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135327112 ms)
2022-10-07 04:43:26.054 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135333189 ms)
2022-10-07 04:43:26.054 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135333190 ms)
2022-10-07 04:43:26.056 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44174)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135333191 ms)
2022-10-07 04:43:32.359 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135339494 ms)
2022-10-07 04:43:32.360 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135339495 ms)
2022-10-07 04:43:32.362 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:43:31.122602+00:00', 'runtime': '2135340.001', 'adc_vb_f': '12.683', 'adc_va_f': '0.232', 'adc_vl_f': '12.662', 'adc_ic_f': '0.002', 'adc_il_f': '0.551', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.683', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135339497 ms)
2022-10-07 04:43:32.364 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:42:31.122605+00:00', 'runtime': '2135280.001', 'adc_vb_f': '12.683', 'adc_va_f': '0.232', 'adc_vl_f': '12.662', 'adc_ic_f': '0.002', 'adc_il_f': '0.563', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.686', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '507.9', 'ahl_t': '507.9', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.5', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135339500 ms)
2022-10-07 04:43:35.115 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135342251 ms)
2022-10-07 04:43:35.116 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135342251 ms)
2022-10-07 04:43:35.117 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44184)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135342252 ms)
2022-10-07 04:43:35.154 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135342290 ms)
2022-10-07 04:43:35.155 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135342290 ms)
2022-10-07 04:43:35.156 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44186)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135342291 ms)
2022-10-07 04:43:36.223 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135343359 ms)
2022-10-07 04:43:36.224 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135343359 ms)
2022-10-07 04:43:36.225 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44188)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135343361 ms)
2022-10-07 04:43:49.332 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135356467 ms)
2022-10-07 04:43:49.332 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135356468 ms)
2022-10-07 04:43:49.335 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44202)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135356471 ms)
2022-10-07 04:43:49.375 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135356510 ms)
2022-10-07 04:43:49.375 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135356510 ms)
2022-10-07 04:43:49.376 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44204)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135356511 ms)
2022-10-07 04:43:59.433 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135366569 ms)
2022-10-07 04:43:59.434 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135366569 ms)
2022-10-07 04:43:59.435 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44216)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135366571 ms)
2022-10-07 04:44:01.503 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135368638 ms)
2022-10-07 04:44:01.503 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135368639 ms)
2022-10-07 04:44:01.504 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44220)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135368640 ms)
2022-10-07 04:44:07.591 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135374726 ms)
2022-10-07 04:44:07.591 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135374727 ms)
2022-10-07 04:44:07.593 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44228)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135374728 ms)
2022-10-07 04:44:14.683 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135381818 ms)
2022-10-07 04:44:14.683 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135381819 ms)
2022-10-07 04:44:14.685 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44236)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135381820 ms)
2022-10-07 04:44:14.724 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135381859 ms)
2022-10-07 04:44:14.724 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135381860 ms)
2022-10-07 04:44:14.725 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44238)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135381861 ms)
2022-10-07 04:44:14.764 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135381899 ms)
2022-10-07 04:44:14.764 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135381899 ms)
2022-10-07 04:44:14.765 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44240)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135381901 ms)
2022-10-07 04:44:16.841 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135383977 ms)
2022-10-07 04:44:16.842 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135383977 ms)
2022-10-07 04:44:16.843 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44244)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135383979 ms)
2022-10-07 04:44:16.882 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135384018 ms)
2022-10-07 04:44:16.883 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135384018 ms)
2022-10-07 04:44:16.884 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44246)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135384020 ms)
2022-10-07 04:44:18.953 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135386088 ms)
2022-10-07 04:44:18.953 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135386089 ms)
2022-10-07 04:44:18.955 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44250)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135386090 ms)
2022-10-07 04:44:24.044 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135391179 ms)
2022-10-07 04:44:24.044 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135391180 ms)
2022-10-07 04:44:24.046 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44256)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135391181 ms)
2022-10-07 04:44:30.113 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135397248 ms)
2022-10-07 04:44:30.113 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135397249 ms)
2022-10-07 04:44:30.114 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44264)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135397250 ms)
2022-10-07 04:44:31.204 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135398339 ms)
2022-10-07 04:44:31.204 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135398339 ms)
2022-10-07 04:44:31.205 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44266)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135398341 ms)
2022-10-07 04:44:31.244 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135398379 ms)
2022-10-07 04:44:31.244 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135398379 ms)
2022-10-07 04:44:31.245 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44268)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135398381 ms)
2022-10-07 04:44:32.302 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135399438 ms)
2022-10-07 04:44:32.303 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135399438 ms)
2022-10-07 04:44:32.304 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44272)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135399439 ms)
2022-10-07 04:44:32.356 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135399492 ms)
2022-10-07 04:44:32.358 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135399493 ms)
2022-10-07 04:44:32.361 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:44:31.122587+00:00', 'runtime': '2135400.001', 'adc_vb_f': '12.686', 'adc_va_f': '0.235', 'adc_vl_f': '12.665', 'adc_ic_f': '0.005', 'adc_il_f': '0.536', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.686', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135399497 ms)
2022-10-07 04:44:32.362 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:43:31.122602+00:00', 'runtime': '2135340.001', 'adc_vb_f': '12.683', 'adc_va_f': '0.232', 'adc_vl_f': '12.662', 'adc_ic_f': '0.002', 'adc_il_f': '0.551', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.683', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135399498 ms)
2022-10-07 04:44:37.384 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135404519 ms)
2022-10-07 04:44:37.384 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135404520 ms)
2022-10-07 04:44:37.385 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44278)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135404520 ms)
2022-10-07 04:44:37.414 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135404549 ms)
2022-10-07 04:44:37.414 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135404549 ms)
2022-10-07 04:44:37.414 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44280)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135404550 ms)
2022-10-07 04:44:39.473 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135406609 ms)
2022-10-07 04:44:39.474 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135406609 ms)
2022-10-07 04:44:39.475 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44284)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135406610 ms)
2022-10-07 04:44:43.543 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135410679 ms)
2022-10-07 04:44:43.544 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135410679 ms)
2022-10-07 04:44:43.544 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44290)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135410680 ms)
2022-10-07 04:44:44.600 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135411735 ms)
2022-10-07 04:44:44.600 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135411736 ms)
2022-10-07 04:44:44.602 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44292)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135411737 ms)
2022-10-07 04:44:49.672 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135416808 ms)
2022-10-07 04:44:49.673 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135416808 ms)
2022-10-07 04:44:49.674 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44300)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135416810 ms)
2022-10-07 04:45:02.792 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135429927 ms)
2022-10-07 04:45:02.792 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135429928 ms)
2022-10-07 04:45:02.794 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44314)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135429929 ms)
2022-10-07 04:45:15.902 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135443037 ms)
2022-10-07 04:45:15.902 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135443038 ms)
2022-10-07 04:45:15.904 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44328)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135443039 ms)
2022-10-07 04:45:23.983 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135451118 ms)
2022-10-07 04:45:23.983 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135451119 ms)
2022-10-07 04:45:23.985 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44338)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135451120 ms)
2022-10-07 04:45:27.072 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135454207 ms)
2022-10-07 04:45:27.073 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135454208 ms)
2022-10-07 04:45:27.074 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44342)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135454209 ms)
2022-10-07 04:45:31.405 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135458541 ms)
2022-10-07 04:45:31.406 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135458542 ms)
2022-10-07 04:45:31.408 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:45:31.122587+00:00', 'runtime': '2135460.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.232', 'adc_vl_f': '12.662', 'adc_ic_f': '0.002', 'adc_il_f': '0.573', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.683', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135458544 ms)
2022-10-07 04:45:31.409 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:44:31.122587+00:00', 'runtime': '2135400.001', 'adc_vb_f': '12.686', 'adc_va_f': '0.235', 'adc_vl_f': '12.665', 'adc_ic_f': '0.005', 'adc_il_f': '0.536', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.686', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135458545 ms)
2022-10-07 04:45:33.149 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135460284 ms)
2022-10-07 04:45:33.149 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135460285 ms)
2022-10-07 04:45:33.151 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44350)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135460286 ms)
2022-10-07 04:45:41.202 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135468337 ms)
2022-10-07 04:45:41.202 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135468338 ms)
2022-10-07 04:45:41.204 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44360)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135468339 ms)
2022-10-07 04:45:47.261 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135474397 ms)
2022-10-07 04:45:47.262 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135474397 ms)
2022-10-07 04:45:47.263 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44368)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135474398 ms)
2022-10-07 04:45:53.349 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135480484 ms)
2022-10-07 04:45:53.349 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135480485 ms)
2022-10-07 04:45:53.351 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44376)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135480486 ms)
2022-10-07 04:45:54.430 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135481566 ms)
2022-10-07 04:45:54.431 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135481566 ms)
2022-10-07 04:45:54.432 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44378)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135481568 ms)
2022-10-07 04:45:54.472 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135481608 ms)
2022-10-07 04:45:54.473 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135481608 ms)
2022-10-07 04:45:54.474 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44380)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135481610 ms)
2022-10-07 04:45:55.551 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135482686 ms)
2022-10-07 04:45:55.551 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135482687 ms)
2022-10-07 04:45:55.553 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44382)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135482688 ms)
2022-10-07 04:45:56.641 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135483776 ms)
2022-10-07 04:45:56.641 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135483777 ms)
2022-10-07 04:45:56.643 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44384)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135483778 ms)
2022-10-07 04:45:58.711 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135485846 ms)
2022-10-07 04:45:58.711 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135485847 ms)
2022-10-07 04:45:58.712 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44388)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135485848 ms)
2022-10-07 04:46:10.802 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135497937 ms)
2022-10-07 04:46:10.802 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135497938 ms)
2022-10-07 04:46:10.803 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44402)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135497939 ms)
2022-10-07 04:46:13.891 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135501027 ms)
2022-10-07 04:46:13.892 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135501027 ms)
2022-10-07 04:46:13.893 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44406)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135501029 ms)
2022-10-07 04:46:21.000 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135508136 ms)
2022-10-07 04:46:21.001 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135508137 ms)
2022-10-07 04:46:21.002 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44414)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135508138 ms)
2022-10-07 04:46:22.082 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135509217 ms)
2022-10-07 04:46:22.082 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135509218 ms)
2022-10-07 04:46:22.084 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44416)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135509219 ms)
2022-10-07 04:46:24.152 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135511287 ms)
2022-10-07 04:46:24.152 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135511288 ms)
2022-10-07 04:46:24.154 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44420)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135511289 ms)
2022-10-07 04:46:26.228 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135513363 ms)
2022-10-07 04:46:26.228 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135513364 ms)
2022-10-07 04:46:26.230 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44424)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135513365 ms)
2022-10-07 04:46:32.280 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135519416 ms)
2022-10-07 04:46:32.281 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135519416 ms)
2022-10-07 04:46:32.281 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44434)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135519417 ms)
2022-10-07 04:46:32.348 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135519484 ms)
2022-10-07 04:46:32.349 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135519484 ms)
2022-10-07 04:46:32.350 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:46:31.122633+00:00', 'runtime': '2135520.001', 'adc_vb_f': '12.683', 'adc_va_f': '0.235', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.531', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.683', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135519485 ms)
2022-10-07 04:46:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:45:31.122587+00:00', 'runtime': '2135460.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.232', 'adc_vl_f': '12.662', 'adc_ic_f': '0.002', 'adc_il_f': '0.573', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.683', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135519486 ms)
2022-10-07 04:46:40.359 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135527495 ms)
2022-10-07 04:46:40.360 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135527495 ms)
2022-10-07 04:46:40.360 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44446)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135527496 ms)
2022-10-07 04:46:51.460 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135538595 ms)
2022-10-07 04:46:51.460 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135538596 ms)
2022-10-07 04:46:51.462 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44460)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135538597 ms)
2022-10-07 04:46:52.550 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135539686 ms)
2022-10-07 04:46:52.551 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135539686 ms)
2022-10-07 04:46:52.552 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44462)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135539687 ms)
2022-10-07 04:46:52.591 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135539727 ms)
2022-10-07 04:46:52.592 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135539727 ms)
2022-10-07 04:46:52.593 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44464)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135539728 ms)
2022-10-07 04:46:57.660 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135544795 ms)
2022-10-07 04:46:57.661 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135544796 ms)
2022-10-07 04:46:57.662 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44470)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135544797 ms)
2022-10-07 04:47:10.749 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135557885 ms)
2022-10-07 04:47:10.750 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135557885 ms)
2022-10-07 04:47:10.751 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44484)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135557886 ms)
2022-10-07 04:47:17.821 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135564956 ms)
2022-10-07 04:47:17.821 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135564957 ms)
2022-10-07 04:47:17.823 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44492)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135564958 ms)
2022-10-07 04:47:23.901 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135571036 ms)
2022-10-07 04:47:23.901 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135571037 ms)
2022-10-07 04:47:23.902 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44500)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135571038 ms)
2022-10-07 04:47:23.940 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135571075 ms)
2022-10-07 04:47:23.940 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135571076 ms)
2022-10-07 04:47:23.941 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44502)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135571076 ms)
2022-10-07 04:47:25.029 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135572165 ms)
2022-10-07 04:47:25.030 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135572165 ms)
2022-10-07 04:47:25.031 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44504)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135572167 ms)
2022-10-07 04:47:32.351 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135579486 ms)
2022-10-07 04:47:32.351 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135579487 ms)
2022-10-07 04:47:32.352 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:47:31.122637+00:00', 'runtime': '2135580.001', 'adc_vb_f': '12.683', 'adc_va_f': '0.235', 'adc_vl_f': '12.662', 'adc_ic_f': '0.002', 'adc_il_f': '0.551', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.68', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135579488 ms)
2022-10-07 04:47:32.353 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:46:31.122633+00:00', 'runtime': '2135520.001', 'adc_vb_f': '12.683', 'adc_va_f': '0.235', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.531', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.683', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135579488 ms)
2022-10-07 04:47:41.110 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135588245 ms)
2022-10-07 04:47:41.110 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135588246 ms)
2022-10-07 04:47:41.112 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44522)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135588247 ms)
2022-10-07 04:47:41.149 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135588285 ms)
2022-10-07 04:47:41.150 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135588285 ms)
2022-10-07 04:47:41.151 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44524)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135588286 ms)
2022-10-07 04:47:49.219 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135596355 ms)
2022-10-07 04:47:49.220 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135596355 ms)
2022-10-07 04:47:49.221 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44534)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135596356 ms)
2022-10-07 04:48:02.310 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135609446 ms)
2022-10-07 04:48:02.311 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135609446 ms)
2022-10-07 04:48:02.312 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44548)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135609447 ms)
2022-10-07 04:48:14.400 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135621536 ms)
2022-10-07 04:48:14.401 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135621536 ms)
2022-10-07 04:48:14.402 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44562)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135621537 ms)
2022-10-07 04:48:16.469 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135623604 ms)
2022-10-07 04:48:16.469 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135623605 ms)
2022-10-07 04:48:16.471 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44566)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135623606 ms)
2022-10-07 04:48:26.549 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135633685 ms)
2022-10-07 04:48:26.550 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135633685 ms)
2022-10-07 04:48:26.551 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44578)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135633687 ms)
2022-10-07 04:48:27.618 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135634754 ms)
2022-10-07 04:48:27.619 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135634754 ms)
2022-10-07 04:48:27.620 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44580)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135634756 ms)
2022-10-07 04:48:32.354 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135639489 ms)
2022-10-07 04:48:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135639490 ms)
2022-10-07 04:48:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:48:31.122666+00:00', 'runtime': '2135640.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.235', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.568', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.68', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135639491 ms)
2022-10-07 04:48:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:47:31.122637+00:00', 'runtime': '2135580.001', 'adc_vb_f': '12.683', 'adc_va_f': '0.235', 'adc_vl_f': '12.662', 'adc_ic_f': '0.002', 'adc_il_f': '0.551', 't_hs': '20', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.68', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135639491 ms)
2022-10-07 04:48:39.699 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135646835 ms)
2022-10-07 04:48:39.700 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135646835 ms)
2022-10-07 04:48:39.700 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44596)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135646836 ms)
2022-10-07 04:48:41.759 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135648895 ms)
2022-10-07 04:48:41.760 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135648895 ms)
2022-10-07 04:48:41.761 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44600)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135648896 ms)
2022-10-07 04:48:47.799 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135654934 ms)
2022-10-07 04:48:47.799 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135654934 ms)
2022-10-07 04:48:47.800 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44610)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135654935 ms)
2022-10-07 04:48:48.838 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135655974 ms)
2022-10-07 04:48:48.839 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135655974 ms)
2022-10-07 04:48:48.839 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44612)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135655975 ms)
2022-10-07 04:48:49.926 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135657062 ms)
2022-10-07 04:48:49.927 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135657062 ms)
2022-10-07 04:48:49.927 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44614)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135657063 ms)
2022-10-07 04:48:49.958 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135657094 ms)
2022-10-07 04:48:49.959 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135657094 ms)
2022-10-07 04:48:49.960 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44616)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135657096 ms)
2022-10-07 04:48:51.039 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135658175 ms)
2022-10-07 04:48:51.040 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135658175 ms)
2022-10-07 04:48:51.040 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44618)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135658176 ms)
2022-10-07 04:49:17.138 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135684274 ms)
2022-10-07 04:49:17.139 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135684274 ms)
2022-10-07 04:49:17.140 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44646)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135684275 ms)
2022-10-07 04:49:21.219 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135688355 ms)
2022-10-07 04:49:21.220 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135688355 ms)
2022-10-07 04:49:21.221 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44652)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135688356 ms)
2022-10-07 04:49:32.354 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135699490 ms)
2022-10-07 04:49:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135699490 ms)
2022-10-07 04:49:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:49:31.122628+00:00', 'runtime': '2135700.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.235', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.68', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135699491 ms)
2022-10-07 04:49:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:48:31.122666+00:00', 'runtime': '2135640.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.235', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.568', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.68', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135699492 ms)
2022-10-07 04:49:34.307 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135701443 ms)
2022-10-07 04:49:34.308 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135701443 ms)
2022-10-07 04:49:34.308 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44666)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135701444 ms)
2022-10-07 04:49:34.338 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135701474 ms)
2022-10-07 04:49:34.339 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135701474 ms)
2022-10-07 04:49:34.339 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44668)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135701474 ms)
2022-10-07 04:49:34.378 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135701514 ms)
2022-10-07 04:49:34.379 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135701514 ms)
2022-10-07 04:49:34.379 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44670)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135701514 ms)
2022-10-07 04:49:43.440 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135710575 ms)
2022-10-07 04:49:43.441 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135710576 ms)
2022-10-07 04:49:43.441 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44680)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135710577 ms)
2022-10-07 04:49:51.517 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135718653 ms)
2022-10-07 04:49:51.518 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135718653 ms)
2022-10-07 04:49:51.519 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44690)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135718655 ms)
2022-10-07 04:49:52.626 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135719762 ms)
2022-10-07 04:49:52.627 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135719762 ms)
2022-10-07 04:49:52.628 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44692)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135719763 ms)
2022-10-07 04:49:53.678 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135720813 ms)
2022-10-07 04:49:53.678 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135720814 ms)
2022-10-07 04:49:53.680 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44694)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135720815 ms)
2022-10-07 04:49:57.747 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135724883 ms)
2022-10-07 04:49:57.748 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135724883 ms)
2022-10-07 04:49:57.749 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44700)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135724885 ms)
2022-10-07 04:49:59.826 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135726961 ms)
2022-10-07 04:49:59.826 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135726962 ms)
2022-10-07 04:49:59.828 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44704)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135726963 ms)
2022-10-07 04:50:03.898 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135731033 ms)
2022-10-07 04:50:03.898 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135731034 ms)
2022-10-07 04:50:03.900 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44710)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135731035 ms)
2022-10-07 04:50:31.019 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135758154 ms)
2022-10-07 04:50:31.019 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135758155 ms)
2022-10-07 04:50:31.020 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44738)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135758156 ms)
2022-10-07 04:50:31.404 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135758539 ms)
2022-10-07 04:50:31.404 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135758540 ms)
2022-10-07 04:50:31.405 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:50:31.122690+00:00', 'runtime': '2135760.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.244', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.548', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.68', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135758541 ms)
2022-10-07 04:50:31.406 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:49:31.122628+00:00', 'runtime': '2135700.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.235', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.512', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.68', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135758541 ms)
2022-10-07 04:50:35.089 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135762224 ms)
2022-10-07 04:50:35.089 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135762224 ms)
2022-10-07 04:50:35.090 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44744)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135762225 ms)
2022-10-07 04:50:43.168 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135770304 ms)
2022-10-07 04:50:43.169 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135770304 ms)
2022-10-07 04:50:43.170 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44754)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135770305 ms)
2022-10-07 04:50:52.258 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135779393 ms)
2022-10-07 04:50:52.258 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135779393 ms)
2022-10-07 04:50:52.259 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44766)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135779395 ms)
2022-10-07 04:50:52.288 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135779423 ms)
2022-10-07 04:50:52.288 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135779423 ms)
2022-10-07 04:50:52.289 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44768)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135779424 ms)
2022-10-07 04:51:08.377 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135795512 ms)
2022-10-07 04:51:08.377 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135795513 ms)
2022-10-07 04:51:08.378 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44796)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135795513 ms)
2022-10-07 04:51:18.467 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135805603 ms)
2022-10-07 04:51:18.468 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135805603 ms)
2022-10-07 04:51:18.469 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44808)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135805604 ms)
2022-10-07 04:51:19.558 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135806693 ms)
2022-10-07 04:51:19.558 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135806694 ms)
2022-10-07 04:51:19.560 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44810)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135806695 ms)
2022-10-07 04:51:21.627 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135808763 ms)
2022-10-07 04:51:21.628 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135808763 ms)
2022-10-07 04:51:21.628 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44814)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135808764 ms)
2022-10-07 04:51:23.668 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135810803 ms)
2022-10-07 04:51:23.668 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135810804 ms)
2022-10-07 04:51:23.669 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44818)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135810804 ms)
2022-10-07 04:51:27.737 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135814872 ms)
2022-10-07 04:51:27.738 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135814873 ms)
2022-10-07 04:51:27.739 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44824)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135814874 ms)
2022-10-07 04:51:32.354 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135819490 ms)
2022-10-07 04:51:32.355 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135819490 ms)
2022-10-07 04:51:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:51:31.122570+00:00', 'runtime': '2135820.001', 'adc_vb_f': '12.674', 'adc_va_f': '0.281', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.577', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.677', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135819491 ms)
2022-10-07 04:51:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:50:31.122690+00:00', 'runtime': '2135760.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.244', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.548', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.68', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135819492 ms)
2022-10-07 04:51:39.826 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135826961 ms)
2022-10-07 04:51:39.826 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135826962 ms)
2022-10-07 04:51:39.828 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44840)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135826963 ms)
2022-10-07 04:51:43.899 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135831034 ms)
2022-10-07 04:51:43.899 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135831035 ms)
2022-10-07 04:51:43.901 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44846)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135831036 ms)
2022-10-07 04:51:59.987 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135847122 ms)
2022-10-07 04:51:59.988 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135847123 ms)
2022-10-07 04:51:59.989 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44864)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135847124 ms)
2022-10-07 04:52:03.078 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135850214 ms)
2022-10-07 04:52:03.079 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135850214 ms)
2022-10-07 04:52:03.080 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44868)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135850216 ms)
2022-10-07 04:52:03.117 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135850252 ms)
2022-10-07 04:52:03.117 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135850253 ms)
2022-10-07 04:52:03.119 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44870)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135850254 ms)
2022-10-07 04:52:08.196 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135855332 ms)
2022-10-07 04:52:08.197 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135855333 ms)
2022-10-07 04:52:08.198 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44876)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135855334 ms)
2022-10-07 04:52:09.278 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135856413 ms)
2022-10-07 04:52:09.278 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135856414 ms)
2022-10-07 04:52:09.280 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44878)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135856415 ms)
2022-10-07 04:52:09.318 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135856453 ms)
2022-10-07 04:52:09.318 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135856454 ms)
2022-10-07 04:52:09.320 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44880)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135856455 ms)
2022-10-07 04:52:10.378 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135857514 ms)
2022-10-07 04:52:10.379 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135857514 ms)
2022-10-07 04:52:10.380 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44882)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135857515 ms)
2022-10-07 04:52:20.457 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135867593 ms)
2022-10-07 04:52:20.458 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135867593 ms)
2022-10-07 04:52:20.459 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44894)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135867595 ms)
2022-10-07 04:52:25.537 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135872673 ms)
2022-10-07 04:52:25.538 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135872673 ms)
2022-10-07 04:52:25.539 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44900)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135872674 ms)
2022-10-07 04:52:30.636 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135877771 ms)
2022-10-07 04:52:30.637 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135877772 ms)
2022-10-07 04:52:30.638 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44906)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135877773 ms)
2022-10-07 04:52:32.355 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135879491 ms)
2022-10-07 04:52:32.356 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135879491 ms)
2022-10-07 04:52:32.357 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:52:31.122645+00:00', 'runtime': '2135880.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.308', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.524', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.677', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135879493 ms)
2022-10-07 04:52:32.358 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:51:31.122570+00:00', 'runtime': '2135820.001', 'adc_vb_f': '12.674', 'adc_va_f': '0.281', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.577', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.677', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135879493 ms)
2022-10-07 04:52:34.693 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135881829 ms)
2022-10-07 04:52:34.694 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135881829 ms)
2022-10-07 04:52:34.695 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44912)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135881831 ms)
2022-10-07 04:52:39.783 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135886918 ms)
2022-10-07 04:52:39.783 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135886919 ms)
2022-10-07 04:52:39.785 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44918)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135886920 ms)
2022-10-07 04:52:39.817 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135886952 ms)
2022-10-07 04:52:39.817 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135886953 ms)
2022-10-07 04:52:39.819 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44920)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135886954 ms)
2022-10-07 04:52:43.905 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135891040 ms)
2022-10-07 04:52:43.905 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135891041 ms)
2022-10-07 04:52:43.907 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44926)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135891042 ms)
2022-10-07 04:52:46.956 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135894091 ms)
2022-10-07 04:52:46.956 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135894092 ms)
2022-10-07 04:52:46.957 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44930)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135894093 ms)
2022-10-07 04:53:04.056 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135911192 ms)
2022-10-07 04:53:04.057 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135911192 ms)
2022-10-07 04:53:04.058 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44950)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135911194 ms)
2022-10-07 04:53:26.136 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135933272 ms)
2022-10-07 04:53:26.137 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135933272 ms)
2022-10-07 04:53:26.138 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44974)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135933273 ms)
2022-10-07 04:53:30.206 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135937341 ms)
2022-10-07 04:53:30.206 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135937341 ms)
2022-10-07 04:53:30.207 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44980)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135937343 ms)
2022-10-07 04:53:32.353 | ERROR | Telemetry Process | plugins.state_monitor.StateMonitor | TypeError evaluating in <class 'plugins.state_monitor.StateMonitor'> on step State Monitor: '<' not supported between instances of 'str' and 'int' (T+2135939488 ms)
2022-10-07 04:53:32.354 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/mjolnir-hamma/plugins/state_monitor.py", line 124, in execute
    if (space_now < self.low_space) and (space_pre > self.low_space):
TypeError: '<' not supported between instances of 'str' and 'int' (T+2135939489 ms)
2022-10-07 04:53:32.358 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Current data: {'time': '2022-10-07 04:53:31.122647+00:00', 'runtime': '2135940.001', 'adc_vb_f': '12.677', 'adc_va_f': '0.32', 'adc_vl_f': '12.662', 'adc_ic_f': '0.002', 'adc_il_f': '0.527', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.677', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135939493 ms)
2022-10-07 04:53:32.359 | INFO | Telemetry Process | plugins.state_monitor.StateMonitor | Previous data: {'time': '2022-10-07 04:52:31.122645+00:00', 'runtime': '2135880.001', 'adc_vb_f': '12.68', 'adc_va_f': '0.308', 'adc_vl_f': '12.662', 'adc_ic_f': '0.005', 'adc_il_f': '0.524', 't_hs': '19', 't_batt': '22', 't_amb': '22', 't_rts': '25', 'charge_state': '3', 'array_fault': '0', 'vb_f': '12.677', 'vb_ref': '0.0', 'ahc_r': '621.9', 'ahc_t': '621.9', 'kwhc': '8.2', 'load_state': '1', 'load_fault': '0', 'v_lvd': '10.492', 'ahl_r': '508.0', 'ahl_t': '508.0', 'hourmeter': '12357', 'alarm': '1', 'dip_switch': '11', 'led_state': '6', 'power_out': '0.03', 'sweep_vmp': '8.447', 'sweep_pmax': '3.503', 'sweep_voc': '11.264', 'vb_min_daily': '12.674', 'vb_max_daily': '12.854', 'ahc_daily': '0.0', 'ahl_daily': '2.6', 'array_fault_daily': '0', 'load_fault_daily': '0', 'alarm_daily': '1', 'vb_min': '10.779', 'vb_max': '20.898', 'ping': '1', 'sequence_count': 'NA', 'timestamp': 'NA', 'crc_errors': 'NA', 'valid_packets': 'NA', 'bytes_read': 'NA', 'bytes_written': 'NA', 'bytes_remaining': 'NA', 'packets_sent': 'NA', 'packets_dropped': 'NA'} (T+2135939494 ms)
2022-10-07 04:53:44.303 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135951439 ms)
2022-10-07 04:53:44.304 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135951439 ms)
2022-10-07 04:53:44.305 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44996)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135951441 ms)
2022-10-07 04:53:44.335 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135951471 ms)
2022-10-07 04:53:44.336 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135951471 ms)
2022-10-07 04:53:44.337 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 44998)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135951473 ms)
2022-10-07 04:53:45.418 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135952553 ms)
2022-10-07 04:53:45.419 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135952554 ms)
2022-10-07 04:53:45.420 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 45000)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135952555 ms)
2022-10-07 04:53:52.516 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135959652 ms)
2022-10-07 04:53:52.517 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135959652 ms)
2022-10-07 04:53:52.518 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 45008)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135959654 ms)
2022-10-07 04:53:52.557 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135959693 ms)
2022-10-07 04:53:52.558 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135959693 ms)
2022-10-07 04:53:52.559 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 45010)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135959695 ms)
2022-10-07 04:53:56.627 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135963762 ms)
2022-10-07 04:53:56.627 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135963763 ms)
2022-10-07 04:53:56.629 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 45016)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135963764 ms)
2022-10-07 04:53:59.716 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135966851 ms)
2022-10-07 04:53:59.716 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tuple)
OSError: [Errno 113] No route to host (T+2135966852 ms)
2022-10-07 04:53:59.718 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Socket details: {'socket': <socket.socket fd=15, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('25.39.117.237', 45020)>, 'address': ('10.10.10.1', 8080), 'action': 'connect'} (T+2135966853 ms)
2022-10-07 04:54:05.794 | ERROR | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | OSError with socket: [Errno 113] No route to host (T+2135972930 ms)
2022-10-07 04:54:05.795 | INFO | HAMMA2 AGS Science Data Ingest Process | brokkr.utils.network | Error details:
Traceback (most recent call last):
  File "/home/pi/dev/brokkr/src/brokkr/utils/network.py", line 111, in setup_socket
    getattr(sock, action)(address_tup