Problem with demmaccs automation

Hi,

I am using sen2agri for agriculture but I have some troubles.

I am able to have command line processor work as demmaccs processor and lai_retrieve_processing.py such as:

/usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/test/S2A_OPER_PRD_MSIL1C_PDMC_20161006T193242_R022_V20161006T101022_20161006T101328.SAFE /mnt/archive/maccs_def/test/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161006T193242_R022_V20161006T101022_20161006T101328.SAFE/

But I have problems with automation.

I thought was permission problem on mounted folder so I ran as \"root\" and as \"sen2agri-service\" user the command line process but it can works.

Please check the log file of demmacs process as detailed below:

###

demmaccs.log

###

2017-11-24 18:34:52.280416:[2035]:Starting demmaccs

2017-11-24 18:34:52.300969:[2035]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/testsite1/S2A_OPER_PRD_MSIL1C_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE/

2017-11-24 18:34:52.424684:[9605]:working_dir = /mnt/archive/demmaccs_tmp/9605

2017-11-24 18:34:52.449945:[9605]:dem_working_dir = /mnt/archive/demmaccs_tmp/9605_DEM_TMP

2017-11-24 18:34:52.470209:[9605]:dem_output_dir = /mnt/archive/demmaccs_tmp/9605_DEM_OUT

2017-11-24 18:34:52.530205:[9605]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/9605_DEM_TMP /mnt/archive/dwn_def/s2/default/testsite1/S2A_OPER_PRD_MSIL1C_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE /mnt/archive/demmaccs_tmp/9605_DEM_OUT

2017-11-24 18:41:59.234154:[9605]:Command finished OK (res = 0) in 0:07:06.689075 : /usr/share/sen2agri/sen2agri-demmaccs/dem.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd -p 20 -w /mnt/archive/demmaccs_tmp/9605_DEM_TMP /mnt/archive/dwn_def/s2/default/testsite1/S2A_OPER_PRD_MSIL1C_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE /mnt/archive/demmaccs_tmp/9605_DEM_OUT

2017-11-24 18:41:59.255170:[9605]:DEM finished in: 0:07:06.742830

2017-11-24 18:41:59.286549:[9605]:DEM output directory /mnt/archive/demmaccs_tmp/9605_DEM_OUT has DEM hdrs = [\'/mnt/archive/demmaccs_tmp/9605_DEM_OUT/S2_TEST_AUX_REFDE2_32TQQ_20161018T104919_0001.HDR\']

2017-11-24 18:42:01.726127:[9605]:MACCS did not processed any tiles for L1C product /mnt/archive/dwn_def/s2/default/testsite1/S2A_OPER_PRD_MSIL1C_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE

2017-11-24 18:42:01.746976:[9605]:Remove all the temporary files and directory

2017-11-24 18:42:02.721016:[9605]:Total execution 0:07:10.220004:

2017-11-24 18:42:02.757915:[2035]:Command finished NOK (res = 1) in 0:07:10.452171 : /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/testsite1/S2A_OPER_PRD_MSIL1C_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE/

2017-11-24 18:42:02.781136:[2035]:demmaccs.py script didn\'t work!

2017-11-24 18:42:02.802361:[2035]:Only set the state as processed in downloader_history (no l2a tiles found after maccs) for product /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE/

###

demmaccs_32TQQ.log

###

2017-11-24 18:42:00.180958:[11059]:Symbolic link L2SITE for tile id 32TQQ GIPP file could not be found. Searching for the common one

2017-11-24 18:42:00.320233:[11059]:Copied /mnt/archive/gipp//SENTINEL2/S2__TEST_GIP_L2SITE_S_CMN00____00001_20150703_21000101.EEF to /mnt/archive/demmaccs_tmp/9605/32TQQ/S2__TEST_GIP_L2SITE_S_32TQQ____00001_20150703_21000101.EEF

2017-11-24 18:42:00.345135:[11059]:Symbolic link CKEXTL for tile id 32TQQ GIPP file could not be found. Searching for the common one

2017-11-24 18:42:00.487288:[11059]:Copied /mnt/archive/gipp//SENTINEL2/S2A_TEST_GIP_CKEXTL_S_CMN00____00001_20150703_21000101.EEF to /mnt/archive/demmaccs_tmp/9605/32TQQ/S2A_TEST_GIP_CKEXTL_S_32TQQ____00001_20150703_21000101.EEF

2017-11-24 18:42:00.522371:[11059]:Symbolic link CKQLTL for tile id 32TQQ GIPP file could not be found. Searching for the common one

2017-11-24 18:42:00.591050:[11059]:Copied /mnt/archive/gipp//SENTINEL2/S2A_TEST_GIP_CKQLTL_S_CMN00____00004_20150703_21000101.EEF to /mnt/archive/demmaccs_tmp/9605/32TQQ/S2A_TEST_GIP_CKQLTL_S_32TQQ____00004_20150703_21000101.EEF

2017-11-24 18:42:00.711962:[11059]:No previous processed l2a tile found for 32TQQ in product S2A_OPER_PRD_MSIL1C_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE. Running MACCS in L2INIT mode

2017-11-24 18:42:00.736718:[11059]:sat_id = 1 | acq_date = 20161016T101022

2017-11-24 18:42:00.757762:[11059]:Starting MACCS in L2INIT for /mnt/archive/dwn_def/s2/default/testsite1/S2A_OPER_PRD_MSIL1C_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE | TileID: 32TQQ

2017-11-24 18:42:00.778438:[11059]:MACCS_COMMAND: [\'/opt/maccs/core/5.1/bin/maccs\', \'--input\', \'/mnt/archive/demmaccs_tmp/9605/32TQQ\', \'--TileId\', \'32TQQ\', \'--output\', \'/mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE//maccs_32TQQ\', \'--mode\', \'L2INIT\', \'--loglevel\', \'DEBUG\', \'--enableTest\', \'false\', \'--CheckXMLFilesWithSchema\', \'false\', \'--conf\', \'/usr/share/sen2agri/sen2agri-demmaccs/UserConfiguration\']

2017-11-24 18:42:00.800168:[11059]:Starting command: /opt/maccs/core/5.1/bin/maccs --input /mnt/archive/demmaccs_tmp/9605/32TQQ --TileId 32TQQ --output /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE//maccs_32TQQ --mode L2INIT --loglevel DEBUG --enableTest false --CheckXMLFilesWithSchema false --conf /usr/share/sen2agri/sen2agri-demmaccs/UserConfiguration

2017-11-24 18:42:01.497980:[11059]:Command finished NOK (res = 133) in 0:00:00.693463 : /opt/maccs/core/5.1/bin/maccs --input /mnt/archive/demmaccs_tmp/9605/32TQQ --TileId 32TQQ --output /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE//maccs_32TQQ --mode L2INIT --loglevel DEBUG --enableTest false --CheckXMLFilesWithSchema false --conf /usr/share/sen2agri/sen2agri-demmaccs/UserConfiguration

2017-11-24 18:42:01.521387:[11059]:MACCS mode L2INIT didn\'t work for /mnt/archive/dwn_def/s2/default/testsite1/S2A_OPER_PRD_MSIL1C_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE | TileID: 32TQQ. Location /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE/

2017-11-24 18:42:01.555903:[11059]:Searching for report maccs files (REPT) in: /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE//maccs_32TQQ

2017-11-24 18:42:01.577352:[11059]:No report maccs files (REPT) found in: /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE//maccs_32TQQ.

2017-11-24 18:42:01.602716:[11059]:Searching for valid products in MACCS working dir: /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE//maccs_32TQQ. Following is the content of this dir: [\'/mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE//maccs_32TQQ/PMC_LxREPT.EEF\']

2017-11-24 18:42:01.627793:[11059]:No valid products (VALD status) found in: /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE//maccs_32TQQ.

2017-11-24 18:42:01.649650:[11059]:Deleting MACCS working directory: rmtree: /mnt/archive/maccs_def/testsite1/l2a/S2A_OPER_PRD_MSIL2A_PDMC_20161018T104919_R022_V20161016T101022_20161016T101019.SAFE//maccs_32TQQ

▒Could you please provide me some help.

▒Thanks in advanced

 

The problem was in mount cifs.

in /etc/fstab the following line works for me:

//ip-address/ /mnt/upload/ cifs username=,password=,mfsymlinks,rw,noperm,file_mode=0777,dir_mode=0777,auto 0 0