MACCS output logs error

brentf · December 19, 2017, 6:59am

Hello again,

I’m thinking that MACCS automatic processing is now working due to the errors I found.

2017-12-15 16:16:08.007265:[30948]:Starting demmaccs 
2017-12-15 16:16:08.007397:[30948]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/bukidnon_first_test/S2A_MSIL1C_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE /mnt/archive/maccs_def/bukidnon_first_test/l2a/S2A_MSIL2A_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE/
2017-12-15 16:16:08.096877:[30958]:working_dir = /mnt/archive/demmaccs_tmp/30958
2017-12-15 16:16:08.096924:[30958]:dem_working_dir = /mnt/archive/demmaccs_tmp/30958_DEM_TMP
2017-12-15 16:16:08.096958:[30958]:dem_output_dir = /mnt/archive/demmaccs_tmp/30958_DEM_OUT
2017-12-15 16:16:08.097551:[30958]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/30958_DEM_TMP /mnt/archive/dwn_def/s2/default/bukidnon_first_test/S2A_MSIL1C_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE /mnt/archive/demmaccs_tmp/30958_DEM_OUT
2017-12-15 16:16:59.147322:[30958]:Command finished OK (res = 0) in 0:00:51.049705 : /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/30958_DEM_TMP /mnt/archive/dwn_def/s2/default/bukidnon_first_test/S2A_MSIL1C_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE /mnt/archive/demmaccs_tmp/30958_DEM_OUT
2017-12-15 16:16:59.147382:[30958]:DEM finished in: 0:00:51.050275
2017-12-15 16:16:59.147638:[30958]:DEM output directory /mnt/archive/demmaccs_tmp/30958_DEM_OUT has DEM hdrs = ['/mnt/archive/demmaccs_tmp/30958_DEM_OUT/S2_TEST_AUX_REFDE2_51NXJ_20170308T021341_0001.HDR']
2017-12-15 16:16:59.253562:[30958]:MACCS did not processed any tiles for L1C product /mnt/archive/dwn_def/s2/default/bukidnon_first_test/S2A_MSIL1C_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE
2017-12-15 16:16:59.253670:[30958]:Remove all the temporary files and directory
2017-12-15 16:16:59.577667:[30958]:Total execution 0:00:51.480632:
2017-12-15 16:16:59.585778:[30948]:Command finished NOK (res = 1) in 0:00:51.578376 : /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/bukidnon_first_test/S2A_MSIL1C_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE /mnt/archive/maccs_def/bukidnon_first_test/l2a/S2A_MSIL2A_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE/
2017-12-15 16:16:59.585828:[30948]:demmaccs.py script didn't work!
2017-12-15 16:16:59.585859:[30948]:Only set the state as processed in downloader_history (no l2a tiles found after maccs) for product /mnt/archive/maccs_def/bukidnon_first_test/l2a/S2A_MSIL2A_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE/

I also found another log ouput:

2017-12-15 16:16:59.154598:[31354]:Symbolic link L2SITE for tile id 51NXJ GIPP file could not be found. Searching for the common one 
2017-12-15 16:16:59.154726:[31354]:Could not find common gip tile id CMN00

I also tried to run it manually in SNAP, however, it seems that it return the same error (demmaccs.log):

2017-12-19 14:31:05.417213:[26067]:working_dir = /mnt/archive/temp/26067
2017-12-19 14:31:05.417252:[26067]:dem_working_dir = /mnt/archive/temp/26067_DEM_TMP
2017-12-19 14:31:05.417277:[26067]:dem_output_dir = /mnt/archive/temp/26067_DEM_OUT
2017-12-19 14:31:05.417604:[26067]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/temp/26067_DEM_TMP /mnt/archive/dwn_def/s2/default/bukidnon_first_test/S2A_MSIL1C_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE /mnt/archive/temp/26067_DEM_OUT
2017-12-19 14:31:45.203129:[26067]:Command finished OK (res = 0) in 0:00:39.785466 : /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/temp/26067_DEM_TMP /mnt/archive/dwn_def/s2/default/bukidnon_first_test/S2A_MSIL1C_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE /mnt/archive/temp/26067_DEM_OUT
2017-12-19 14:31:45.203200:[26067]:DEM finished in: 0:00:39.785852
2017-12-19 14:31:45.203438:[26067]:DEM output directory /mnt/archive/temp/26067_DEM_OUT has DEM hdrs = ['/mnt/archive/temp/26067_DEM_OUT/S2_TEST_AUX_REFDE2_51NXJ_20170308T021341_0001.HDR']
2017-12-19 14:31:45.308059:[26067]:MACCS did not processed any tiles for L1C product /mnt/archive/dwn_def/s2/default/bukidnon_first_test/S2A_MSIL1C_20170308T021341_N0204_R060_T51NXJ_20170308T021344.SAFE
2017-12-19 14:31:45.308134:[26067]:Total execution 0:00:39.890802:

This is another log from the manual execution of SNAP (demmaccs_51NXJ.log):

2017-12-19 14:31:45.210218:[26392]:Symbolic link L2SITE for tile id 51NXJ GIPP file could not be found. Searching for the common one 
2017-12-19 14:31:45.210315:[26392]:Could not find common gip tile id CMN00

lnicola · December 20, 2017, 3:58pm

Hi,

There should be a CMN00 file present under /mnt/archive/gipp/SENTINEL2, like below:

drwxrwxr-x. 2 sen2agri-service sen2agri-service 4.0K Nov 29  2016 S2A_TEST_GIP_L2ALBD_L_CONTINEN_50001_00000000_99999999.DBL.DIR
drwxrwxr-x. 2 sen2agri-service sen2agri-service 4.0K Nov 29  2016 S2A_TEST_GIP_L2DIFT_L_CONTINEN_50001_00000000_99999999.DBL.DIR
drwxrwxr-x. 2 sen2agri-service sen2agri-service 4.0K Nov 29  2016 S2A_TEST_GIP_L2DIRT_L_CONTINEN_50001_00000000_99999999.DBL.DIR
drwxrwxr-x. 2 sen2agri-service sen2agri-service 4.0K Nov 29  2016 S2A_TEST_GIP_L2TOCR_L_CONTINEN_50001_00000000_99999999.DBL.DIR
drwxrwxr-x. 2 sen2agri-service sen2agri-service   44 Nov 29  2016 S2A_TEST_GIP_L2WATV_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 4.2K Nov 29  2016 README
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 2.7K Nov 29  2016 S2A_TEST_GIP_CKEXTL_S_36JTT____59999_00000000_99999999.EEF
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 2.5K Nov 29  2016 S2A_TEST_GIP_CKEXTL_S_CMN00____00001_20150703_21000101.EEF
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 5.5K Nov 29  2016 S2A_TEST_GIP_CKQLTL_S_36JTT____59999_00000000_99999999.EEF
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 4.7K Nov 29  2016 S2A_TEST_GIP_CKQLTL_S_CMN00____00004_20150703_21000101.EEF
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 1.2K Nov 29  2016 S2A_TEST_GIP_L2ALBD_L_CONTINEN_50001_00000000_99999999.DBL
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 6.4K Nov 29  2016 S2A_TEST_GIP_L2ALBD_L_CONTINEN_50001_00000000_99999999.HDR
-rwxrwxr-x. 1 sen2agri-service sen2agri-service  24K Nov 29  2016 S2A_TEST_GIP_L2COMM_L_ALLSITES_10007_20150703_21000101.EEF
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 5.0K Nov 29  2016 S2A_TEST_GIP_L2DIFT_L_CONTINEN_50001_00000000_99999999.DBL
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 6.5K Nov 29  2016 S2A_TEST_GIP_L2DIFT_L_CONTINEN_50001_00000000_99999999.HDR
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 5.6K Nov 29  2016 S2A_TEST_GIP_L2DIRT_L_CONTINEN_50001_00000000_99999999.DBL
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 6.5K Nov 29  2016 S2A_TEST_GIP_L2DIRT_L_CONTINEN_50001_00000000_99999999.HDR
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 8.9K Nov 29  2016 S2A_TEST_GIP_L2SMAC_L_ALLSITES_50001_00000000_99999999.EEF
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 1.1M Nov 29  2016 S2A_TEST_GIP_L2TOCR_L_CONTINEN_50001_00000000_99999999.DBL
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 7.1K Nov 29  2016 S2A_TEST_GIP_L2TOCR_L_CONTINEN_50001_00000000_99999999.HDR
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 6.9K Nov 29  2016 S2A_TEST_GIP_L2WATV_L_CONTINEN_50001_00000000_99999999.DBL
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 2.9K Nov 29  2016 S2A_TEST_GIP_L2WATV_L_CONTINEN_50001_00000000_99999999.HDR
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 2.5K Nov 29  2016 S2__TEST_GIP_L2SITE_S_36JTT____50001_00000000_99999999.EEF
-rwxrwxr-x. 1 sen2agri-service sen2agri-service 2.3K Nov 29  2016 S2__TEST_GIP_L2SITE_S_CMN00____00001_20150703_21000101.EEF

These files contain configuration data for MACCS. Please check whether they are present and accessible. If not, they should be available in the Sen2Agri package.

brentf · December 22, 2017, 4:14am

Hello,

This is the contents of my /home/archive/gipp/SENTINEL2

-rw-r--r-- 1 root root    4273 Dec 13 20:54 README
-rw-r--r-- 1 root root    2711 Dec 13 20:54 S2A_TEST_GIP_CKEXTL_S_36JTT____59999_00000000_99999999.EEF
-rw-r--r-- 1 root root    2529 Dec 13 20:54 S2A_TEST_GIP_CKEXTL_S_CMN00____00001_20150703_21000101.EEF
-rw-r--r-- 1 root root    5554 Dec 13 20:54 S2A_TEST_GIP_CKQLTL_S_36JTT____59999_00000000_99999999.EEF
-rw-r--r-- 1 root root    4759 Dec 13 20:54 S2A_TEST_GIP_CKQLTL_S_CMN00____00004_20150703_21000101.EEF
-rw-r--r-- 1 root root    1215 Dec 13 20:54 S2A_TEST_GIP_L2ALBD_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54 S2A_TEST_GIP_L2ALBD_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    6512 Dec 13 20:54 S2A_TEST_GIP_L2ALBD_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root   23855 Dec 13 20:54 S2A_TEST_GIP_L2COMM_L_ALLSITES_10007_20150703_21000101.EEF
-rw-r--r-- 1 root root    5115 Dec 13 20:54 S2A_TEST_GIP_L2DIFT_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54 S2A_TEST_GIP_L2DIFT_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    6641 Dec 13 20:54 S2A_TEST_GIP_L2DIFT_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root    5703 Dec 13 20:54 S2A_TEST_GIP_L2DIRT_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54 S2A_TEST_GIP_L2DIRT_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    6638 Dec 13 20:54 S2A_TEST_GIP_L2DIRT_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root    9062 Dec 13 20:54 S2A_TEST_GIP_L2SMAC_L_ALLSITES_50001_00000000_99999999.EEF
-rw-r--r-- 1 root root 1105201 Dec 13 20:54 S2A_TEST_GIP_L2TOCR_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54 S2A_TEST_GIP_L2TOCR_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    7182 Dec 13 20:54 S2A_TEST_GIP_L2TOCR_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root    7024 Dec 13 20:54 S2A_TEST_GIP_L2WATV_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54 S2A_TEST_GIP_L2WATV_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    2893 Dec 13 20:54 S2A_TEST_GIP_L2WATV_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root    2711 Dec 13 20:54 S2B_TEST_GIP_CKEXTL_S_36JTT____59999_00000000_99999999.EEF
-rw-r--r-- 1 root root    2529 Dec 13 20:54 S2B_TEST_GIP_CKEXTL_S_CMN00____00001_20150703_21000101.EEF
-rw-r--r-- 1 root root    5554 Dec 13 20:54 S2B_TEST_GIP_CKQLTL_S_36JTT____59999_00000000_99999999.EEF
-rw-r--r-- 1 root root    4759 Dec 13 20:54 S2B_TEST_GIP_CKQLTL_S_CMN00____00004_20150703_21000101.EEF
-rw-r--r-- 1 root root    1184 Dec 13 20:54 S2B_TEST_GIP_L2ALBD_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54 S2B_TEST_GIP_L2ALBD_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    6512 Dec 13 20:54 S2B_TEST_GIP_L2ALBD_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root   23855 Dec 13 20:54 S2B_TEST_GIP_L2COMM_L_ALLSITES_10007_20150703_21000101.EEF
-rw-r--r-- 1 root root    5032 Dec 13 20:54 S2B_TEST_GIP_L2DIFT_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54S2B_TEST_GIP_L2DIFT_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    6641 Dec 13 20:54 S2B_TEST_GIP_L2DIFT_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root    5667 Dec 13 20:54 S2B_TEST_GIP_L2DIRT_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54 S2B_TEST_GIP_L2DIRT_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    6638 Dec 13 20:54 S2B_TEST_GIP_L2DIRT_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root    9062 Dec 13 20:54 S2B_TEST_GIP_L2SMAC_L_ALLSITES_50001_00000000_99999999.EEF
-rw-r--r-- 1 root root 1105090 Dec 13 20:54 S2B_TEST_GIP_L2TOCR_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54 S2B_TEST_GIP_L2TOCR_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    7182 Dec 13 20:54 S2B_TEST_GIP_L2TOCR_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root    7007 Dec 13 20:54 S2B_TEST_GIP_L2WATV_L_CONTINEN_50001_00000000_99999999.DBL
drwx------ 2 root root    4096 Dec 13 20:54 S2B_TEST_GIP_L2WATV_L_CONTINEN_50001_00000000_99999999.DBL.DIR
-rw-r--r-- 1 root root    2893 Dec 13 20:54 S2B_TEST_GIP_L2WATV_L_CONTINEN_50001_00000000_99999999.HDR
-rw-r--r-- 1 root root    2507 Dec 13 20:54 S2__TEST_GIP_L2SITE_S_36JTT____50001_00000000_99999999.EEF
-rw-r--r-- 1 root root    2271 Dec 13 20:54 S2__TEST_GIP_L2SITE_S_CMN00____00001_20150703_21000101.EEF

Perhaps, I need to change the permissions and ownership of each files located in the said directory?

Much thanks.

lnicola · December 22, 2017, 12:53pm

Hi,

Even if you’ve created a symlink from /mnt/archive to /home/archive, you still need to make sure the files are readable. To check, try

ls -ld /home/archive
ls -ld /home/archive/gipp
ls -ld /home/archive/SENTINEL2

Even in your output, the subdirectories are inaccessible by other users. You should at least try to change their owner to sen2agri-service:

sudo chmod -R sen2agri-service:sen2agri-service /home/archive

But that will only work in the automated mode. For manual jobs you’ll need to chmod 777 everything, or to run the processors under the sen2agri-service user.

brentf · December 22, 2017, 1:29pm

Actually I have a symbolic link for from /mnt/archive to /home/mnt/archive.
Here are the results of the commands you’ve suggested:

drwxrwxrwx 10 root root 4096 Dec 22 20:45 /home/mnt/archive
drwx------ 4 root root 4096 Dec 22 15:34 /home/mnt/archive/gipp
drwx------ 12 root root 4096 Dec 22 15:34 /home/mnt/archive/gipp/SENTINEL2

However the result of sudo chmod -R sen2agri-service:sen2agri-service /home/mnt/archive:

chmod: invalid mode: ‘sen2agri-service:sen2agri-service’
Try 'chmod --help' for more information.

It seemed that the slurm and sen2agri user is not present, what are the steps that I will take to make sure that specific folders should be owned by sen2agri and not the other local users?
It’s been two months that I installed sen2agri but I can’t initiate any automatic processing like L2A because of the user/permission/ownership issues.

lnicola · December 22, 2017, 1:54pm

Sorry, that should have been chown -R sen2agri-service:sen2agri-service /home/mnt/archive

It seemed that the slurm and sen2agri user is not present, what are the steps that I will take to make sure that specific folders should be owned by sen2agri and not the other local users?

sen2agri-service is supposed to be used; do you mean it wasn’t created by the installer? You previously mentioned that you manually installed the system, but I’m not sure what that meant.

It’s been two months that I installed sen2agri but I can’t initiate any automatic processing like L2A because of the user/permission/ownership issues.

Sorry, we should have had some basic permission checks in the website, or a troubleshooting tool for this.

brentf · December 22, 2017, 2:10pm

Hello,

I already applied the correct chown command.

What I mean is that slurm and sen2agri-service folders are not present in my home directory (’/home/’)
whereas user names are usually found. Is it ok?

[brentf@ESSCGeo-Sen2Agri home]$ ls
andresi  ariela  brentf  devel  esscgeo  lost+found  mnt  sheras

lnicola · December 22, 2017, 2:19pm

I see. They should have been there, but the home paths are not really used, as far as I know.

You can check the configured locations with getent passwd slurm sen2agri-service.

brentf · December 22, 2017, 2:29pm

This is the ouput:

drwx------ 4 sen2agri-service sen2agri-service 4096 Dec 22 15:34 /mnt/archive/gipp/

I’ll try to create another site to test whether L2A will go on with the processing.

brentf · June 20, 2018, 4:22am

Hello,

Can you try and see what will be the result of this command?

ls -ld /mnt/archive/

In creating symbolic link, your mnt folder in your root directory / should look like below as the links point to another folder (e.g. /home/mnt, which should have enough space for the maccss processing).

Screenshot%20at%202018-06-20%2010-29-15

You can also try this commands sudo chown -R sen2agri-service:sen2agri-service /home/mnt/archive (in case your symlink points to /home/mnt/... directory)

lnicola · July 24, 2018, 10:53am

Hi, and sorry for the late reply. If you still haven’t fixed this, can you try running that command manually (ln -s ...), preferably under the sen2agri-service account? You can do that with sudo -u sen2agri-service ln -s .... There are two possible explanations:

the service account doesn’t have write permissions to the directory where the symlink is created (the last argument of ln)
your file system does not support symlinks; if you’re using a Virtual Box shared folder or CIFS share, please take a look at the FAQ.

pmallas · September 6, 2018, 4:48pm

I had to copy some files from within my distribution to /mnt/archive/gipp/SENTINEL2

cp ~/Sen2AgriDistribution/gipp/SENTINEL2/* /mnt/archive/gipp/SENTINEL2/

and this fixed things for me

resnow92 · October 2, 2018, 11:33am

Hi,
I have an issue with maccs process for my data on the 1.8.3 new version of sen2agri. Data are well downloaded but the DEM generation fails.
Here is the log output:

2018-10-02 13:25:02.625253:[26298]:Starting demmaccs
2018-10-02 13:25:02.625458:[26298]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/test_wall/S2A_MSIL1C_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE /mnt/archive/maccs_def/test_wall/l2a/S2A_MSIL2A_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE/
2018-10-02 13:25:03.151139:[26311]:working_dir = /mnt/archive/demmaccs_tmp/26311
2018-10-02 13:25:03.151248:[26311]:dem_working_dir = /mnt/archive/demmaccs_tmp/26311_DEM_TMP
2018-10-02 13:25:03.151327:[26311]:dem_output_dir = /mnt/archive/demmaccs_tmp/26311_DEM_OUT
2018-10-02 13:25:03.152793:[26311]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/26311_DEM_TMP /mnt/archive/dwn_def/s2/default/test_wall/S2A_MSIL1C_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE /mnt/archive/demmaccs_tmp/26311_DEM_OUT
2018-10-02 13:25:04.419647:[26311]:Command finished NOK (res = 1) in 0:00:01.266298 : /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/26311_DEM_TMP /mnt/archive/dwn_def/s2/default/test_wall/S2A_MSIL1C_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE /mnt/archive/demmaccs_tmp/26311_DEM_OUT
2018-10-02 13:25:04.419773:[26311]:DEM failed
2018-10-02 13:25:04.432607:[26298]:Command finished NOK (res = 255) in 0:00:01.807076 : /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/test_wall/S2A_MSIL1C_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE /mnt/archive/maccs_def/test_wall/l2a/S2A_MSIL2A_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE/
2018-10-02 13:25:04.432736:[26298]:demmaccs.py script didn’t work!
2018-10-02 13:25:04.432830:[26298]:Only set the state as processed in downloader_history (no l2a tiles found after maccs) for product /mnt/archive/maccs_def/test_wall/l2a/S2A_MSIL2A_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE/

Thanks for your help

resnow92 · October 3, 2018, 7:40am

When I try to launch the command line demmacs.py, I understand that the error come from OTB library : libgeos

/usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/test_wall/S2A_MSIL1C_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE /mnt/archive/maccs_def/test_wall/l2a/S2A_MSIL2A_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE/

the error message:

2018-10-02 13:38:04.310773:[3063]:working_dir = /mnt/archive/demmaccs_tmp/3063
2018-10-02 13:38:04.322833:[3063]:dem_working_dir = /mnt/archive/demmaccs_tmp/3063_DEM_TMP
2018-10-02 13:38:04.322959:[3063]:dem_output_dir = /mnt/archive/demmaccs_tmp/3063_DEM_OUT
Creating DEMs for /mnt/archive/dwn_def/s2/default/test_wall/S2A_MSIL1C_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE
2018-10-02 13:38:04.324089:[3063]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/3063_DEM_TMP /mnt/archive/dwn_def/s2/default/test_wall/S2A_MSIL1C_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE /mnt/archive/demmaccs_tmp/3063_DEM_OUT
bounding box 5 55 10 45
2018-10-02 13:38:04.596041:[3069]:Starting command: gdalbuildvrt -q /mnt/archive/demmaccs_tmp/3063_DEM_TMP/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/dem.vrt /mnt/archive/srtm/srtm_38_03.tif /mnt/archive/srtm/srtm_38_02.tif
2018-10-02 13:38:04.696631:[3069]:Command finished OK (res = 0) in 0:00:00.100602 : gdalbuildvrt -q /mnt/archive/demmaccs_tmp/3063_DEM_TMP/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/dem.vrt /mnt/archive/srtm/srtm_38_03.tif /mnt/archive/srtm/srtm_38_02.tif
2018-10-02 13:38:04.696813:[3069]:Starting command: otbcli_BandMath -il /mnt/archive/demmaccs_tmp/3063_DEM_TMP/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/dem.vrt -out /mnt/archive/demmaccs_tmp/3063_DEM_TMP/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/dem.tif -exp ‘im1b1 == -32768 ? 0 : im1b1’ -progress false
/bin/otbApplicationLauncherCommandLine: error while loading shared libraries: libgeos-3.5.0.so: cannot open shared object file: No such file or directory
2018-10-02 13:38:04.804074:[3069]:Command finished NOK (res = 127) in 0:00:00.107270 : otbcli_BandMath -il /mnt/archive/demmaccs_tmp/3063_DEM_TMP/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/dem.vrt -out /mnt/archive/demmaccs_tmp/3063_DEM_TMP/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/dem.tif -exp ‘im1b1 == -32768 ? 0 : im1b1’ -progress false
2018-10-02 13:38:04.804262:[3069]:Starting command: gdalwarp -q -overwrite -multi -r cubic -t_srs EPSG:32631 -tr 10.0 -10.0 -te 699960.0 5490240.0 809760.0 5600040.0 /mnt/archive/demmaccs_tmp/3063_DEM_TMP/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/dem.tif /mnt/archive/demmaccs_tmp/3063_DEM_OUT/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/S2_TEST_AUX_REFDE2_31UGR_0001_ALT_R1.TIF
ERROR 4: /mnt/archive/demmaccs_tmp/3063_DEM_TMP/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/dem.tif' does not exist in the file system, and is not recognised as a supported dataset name. 2018-10-02 13:38:04.892017:[3069]:Command finished NOK (res = 1) in 0:00:00.087766 : gdalwarp -q -overwrite -multi -r cubic -t_srs EPSG:32631 -tr 10.0 -10.0 -te 699960.0 5490240.0 809760.0 5600040.0 /mnt/archive/demmaccs_tmp/3063_DEM_TMP/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/dem.tif /mnt/archive/demmaccs_tmp/3063_DEM_OUT/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/S2_TEST_AUX_REFDE2_31UGR_0001_ALT_R1.TIF /mnt/archive/demmaccs_tmp/3063_DEM_OUT/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/S2_TEST_AUX_REFDE2_31UGR_0001_ALT_R1.TIF|/mnt/archive/demmaccs_tmp/3063_DEM_OUT/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/S2_TEST_AUX_REFDE2_31UGR_0001_ALT_R2.TIF|20|-20 ERROR 4:/mnt/archive/demmaccs_tmp/3063_DEM_OUT/S2_TEST_AUX_REFDE2_31UGR_20161204T104422_0001.DBL.DIR/S2_TEST_AUX_REFDE2_31UGR_0001_ALT_R1.TIF’ does not exist in the file system,
and is not recognised as a supported dataset name.
Traceback (most recent call last):
File “/usr/share/sen2agri/sen2agri-demmaccs/dem.py”, line 520, in
res.get(1)
File “/usr/lib64/python2.7/multiprocessing/pool.py”, line 554, in get
raise self._value
AttributeError: ‘NoneType’ object has no attribute ‘RasterXSize’
2018-10-02 13:38:05.234488:[3063]:Command finished NOK (res = 1) in 0:00:00.910377 : /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/3063_DEM_TMP /mnt/archive/dwn_def/s2/default/test_wall/S2A_MSIL1C_20161204T104422_N0204_R008_T31UGR_20161204T104538.SAFE /mnt/archive/demmaccs_tmp/3063_DEM_OUT
2018-10-02 13:38:05.235041:[3063]:DEM failed

Any idea to solve this ?