L2A MACCS not running

Atmospheric Corrections Processor (MACCS)
1

L2A not running.
Below log file.
How can I force it to run again?
BR
Pedro

2018-04-11 23:56:07.793758:[2481]:Starting demmaccs
2018-04-11 23:56:07.793905:[2481]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/coruchev10/S2A_MSIL1C_20180410T112111_N0206_R037_T29SND_20180410T132753.SAFE /mnt/archive/maccs_def/coruchev10/l2a/S2A_MSIL2A_20180410T112111_N0206_R037_T29SND_20180410T132753.SAFE/ --prev-l2a-tiles 29SND --prev-l2a-products-paths /mnt/archive/maccs_def/coruchev10/l2a/S2B_MSIL2A_20180405T112109_N0206_R037_T29SND_20180405T132445.SAFE/

2018-04-11 23:56:07.929869:[2491]:working_dir = /mnt/archive/demmaccs_tmp/2491
2018-04-11 23:56:07.929931:[2491]:dem_working_dir = /mnt/archive/demmaccs_tmp/2491_DEM_TMP
2018-04-11 23:56:07.929980:[2491]:dem_output_dir = /mnt/archive/demmaccs_tmp/2491_DEM_OUT
2018-04-11 23:56:07.969214:[2491]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/2491_DEM_TMP /mnt/archive/dwn_def/s2/default/coruchev10/S2A_MSIL1C_20180410T112111_N0206_R037_T29SND_20180410T132753.SAFE /mnt/archive/demmaccs_tmp/2491_DEM_OUT
2018-04-11 23:57:18.905734:[2491]:Command finished OK (res = 0) in 0:01:10.936399 : /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/2491_DEM_TMP /mnt/archive/dwn_def/s2/default/coruchev10/S2A_MSIL1C_20180410T112111_N0206_R037_T29SND_20180410T132753.SAFE /mnt/archive/demmaccs_tmp/2491_DEM_OUT
2018-04-11 23:57:18.905854:[2491]:DEM finished in: 0:01:10.937110
2018-04-11 23:57:18.906326:[2491]:DEM output directory /mnt/archive/demmaccs_tmp/2491_DEM_OUT has DEM hdrs = [’/mnt/archive/demmaccs_tmp/2491_DEM_OUT/S2_TEST_AUX_REFDE2_29SND_20180410T112111_0001.HDR’]
2018-04-11 23:59:07.291825:[2491]:MACCS did not processed any tiles for L1C product /mnt/archive/dwn_def/s2/default/coruchev10/S2A_MSIL1C_20180410T112111_N0206_R037_T29SND_20180410T132753.SAFE
2018-04-11 23:59:07.291925:[2491]:Remove all the temporary files and directory
2018-04-11 23:59:07.463408:[2491]:Total execution 0:02:59.533302:
2018-04-11 23:59:07.473088:[2481]:Command finished NOK (res = 1) in 0:02:59.679139 : /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/coruchev10/S2A_MSIL1C_20180410T112111_N0206_R037_T29SND_20180410T132753.SAFE /mnt/archive/maccs_def/coruchev10/l2a/S2A_MSIL2A_20180410T112111_N0206_R037_T29SND_20180410T132753.SAFE/ --prev-l2a-tiles 29SND --prev-l2a-products-paths /mnt/archive/maccs_def/coruchev10/l2a/S2B_MSIL2A_20180405T112109_N0206_R037_T29SND_20180405T132445.SAFE/
2018-04-11 23:59:07.473168:[2481]:demmaccs.py script didn’t work!
2018-04-11 23:59:07.473223:[2481]:Only set the state as processed in downloader_history (no l2a tiles found after maccs) for product /mnt/archive/maccs_def/coruchev10/l2a/S2A_MSIL2A_20180410T112111_N0206_R037_T29SND_20180410T132753.SAFE/

2

Hi Pedro,

Maybe you can try this sudo systemctl restart sen2agri-demmaccs.
If it didn’t work, perhaps the donloaded raw image didn’t pass the cloud threshold. Youu can check it in the .EFF file in the /mnt/archive/maccs_def/{site_name}/l2a/... and look for “Cloud percentage” term.

See also: L2A-Error

All the best.

3

You are right for the 10 of April image. it had high clouds…
However the image of 25 of april has no clouds and even with “sudo systemctl restart sen2agri-demmaccs” , it did not run.
Any other way to force L2A?
BR
Pedro

4

Hi, can you extract the whole sen2agri-demmaccs log? You can save it by running journalctl -u sen2agri-demmaccs | tee log.txt, then compress it and either attach it here, or send it to me at lnicola@c-s.ro.

5

log.txt (2.1 MB)

6

I forced the L2A to run by changing in DB the status from aborted to dowloaded.
This forced the L2A to run.
BR
Pedro

7

Hi Pedro,

For the record, example on how to reprocess L1 products (i.e. running L2A again in case of failure) is present on the FAQ section of the Sen2-Agri website: www.esa-sen2agri.org/resources/faq/#how-can-i-reprocess-some-l1-products

Nicolas

8

I have the same problem
any downloaded S1 or L8 data are not processed by MACCS.
Please could you indicate me how to force L2A to run by changing in DB the status from aborted to dowloaded.

9

Hi!

You can try the comment of nicolas above:

Just change the “6 – processing_failed” to “4 - - aborted” in the fourth line.

All the best.

10

Wait, aborted means that the download was aborted (e.g. didn’t work). I don’t think changing the status will do anything.

Currently there is an issue where the downloader is querying SciHub, but downloads the files from Amazon. Since Amazon will often be a couple of hours or days behind, the files will often be missing. Normally, the downloader should retry them later, but it looks like it’s trying to do the retries too fast, so it fails.