Cloud Free Composite - unhandeled python exception


#1

Hi,

I recently started the L3A- composite processor and everything seems to work perfectly. The first composite outputs were produced and look amazing.

But for 5 months in my season I don’t get any output. In the monitoring tabs it seems that they are still running but in fact there are no processes running in the executor since one whole day now.

The slurm log shows the following output:

● slurmd.service - Slurm node daemon
   Loaded: loaded (/usr/lib/systemd/system/slurmd.service; enabled; vendor preset: disabled)
  Drop-In: /etc/systemd/system/slurmd.service.d
           └─override.conf
   Active: active (running) since Wed 2018-05-16 22:45:17 CEST; 2 days ago
  Process: 29144 ExecStart=/usr/sbin/slurmd $SLURMD_OPTIONS (code=exited, status=0/SUCCESS)
 Main PID: 30465 (slurmd)
   CGroup: /system.slice/slurmd.service
           └─30465 /usr/sbin/slurmd

May 17 16:19:57 vm-sen2agri python[5162]: detected unhandled Python exception in '/usr/bin/optimize_gtiff.py'
May 17 16:19:58 vm-sen2agri python[9235]: detected unhandled Python exception in '/usr/bin/optimize_gtiff.py'
May 17 16:19:59 vm-sen2agri python[10937]: detected unhandled Python exception in '/usr/bin/optimize_gtiff.py'
May 17 16:21:37 vm-sen2agri python[27458]: detected unhandled Python exception in '/usr/bin/optimize_gtiff.py'
May 17 16:21:39 vm-sen2agri python[1185]: detected unhandled Python exception in '/usr/bin/optimize_gtiff.py'
May 17 16:21:40 vm-sen2agri python[3851]: detected unhandled Python exception in '/usr/bin/optimize_gtiff.py'
May 18 15:49:34 vm-sen2agri python[25851]: detected unhandled Python exception in '/usr/bin/aggregate_tiles.py'
May 18 15:49:42 vm-sen2agri python[25851]: communication with ABRT daemon failed: timed out
May 18 15:49:42 vm-sen2agri python[25851]: error sending data to ABRT daemon: 
May 18 15:49:43 vm-sen2agri python[17680]: detected unhandled Python exception in '/usr/bin/aggregate_tiles.py'

The missing composites are in the part of the season 2017 where we have most data sets. As it’s a combination of S2A, S2B and Landsat there are many inputs-scenes (>=10) to consider. May this could be a problem?

Martin


#2

ok I updated to 1.8.1 and restarted everything and now L3-prcessor seems to work again.