Hi,
I’m using sen2agri system in autometed mode. I’ve configurate a virtual machine Centos 7 64 bit with 300 GB of Hard disk and 16 GB of RAM. I would get L2A product of a small area, about 100 square kilometers . The processor results are only the data download, but the L2A are not produced, I verified that the cloud coverage is smaller than 90. Best regards Caterina
Hi,
Can you check the system logs with journalctl -u sen2agri-demmaccs?
Hi,
thanks for your quick reply. I check the system logs with journalctl -u sen2agri-demmaccs and it seems correct. However, I attach part of logs file:
May 02 22:36:03 localhost.localdomain systemd[1]: Starting Runs MACCS on L1C products…
May 02 22:37:03 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
May 02 22:37:03 localhost.localdomain systemd[1]: Starting Runs MACCS on L1C products…
May 02 22:38:03 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
May 02 22:38:03 localhost.localdomain systemd[1]: Starting Runs MACCS on L1C products…
May 02 22:39:03 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
May 02 22:39:03 localhost.localdomain systemd[1]: Starting Runs MACCS on L1C products…
May 02 22:40:01 localhost.localdomain systemd[1]: Started Runs MACCS on L1C products.
May 02 22:40:01 localhost.localdomain systemd[1]: Starting Runs MACCS on L1C products…
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02.157448:[29671]:Starting demmaccs
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02.172787:[29671]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/arch
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02.290746:[29684]:working_dir = /mnt/archive/demmaccs_tmp/29684
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02.297656:[29684]:dem_working_dir = /mnt/archive/demmaccs_tmp/29684_DEM_TMP
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02.301923:[29684]:dem_output_dir = /mnt/archive/demmaccs_tmp/29684_DEM_OUT
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02.318694:[29684]:Starting command: /usr/share/sen2agri/sen2agri-demmaccs/…/l8_alignment/l8_align.py -i /mnt/archive/dwn_def/l
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02,395 l8_align INFO - ######## MANAGING ARGUMENTS ########
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: INFO:l8_align:######## MANAGING ARGUMENTS ########
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02,395 l8_align DEBUG - Checking arguments
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: DEBUG:l8_align:Checking arguments
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02,397 l8_align DEBUG - 11
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: DEBUG:l8_align:11
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02,399 l8_align DEBUG - Arguments ok
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: DEBUG:l8_align:Arguments ok
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02,399 l8_align DEBUG - Managing output directories
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: DEBUG:l8_align:Managing output directories
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02,401 l8_align DEBUG - Output directories ok
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: DEBUG:l8_align:Output directories ok
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02,404 DEM gdal Tools DEBUG - 188
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: DEBUG:DEM gdal Tools:188
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02,404 DEM gdal Tools DEBUG - 32
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: DEBUG:DEM gdal Tools:32
May 02 22:40:02 localhost.localdomain demmaccs_launcher.py[29651]: 2018-05-02 22:40:02,404 DEM gdal Tools DEBUG - <type ‘int’>
Best regards Caterina
Can you attach the whole output? E.g. journalctl -u sen2agri-demmaccs | tee log.txt, then make an archive of that and attach it here, or send it to me over email at lnicola@c-s.ro.
Sorry for the late reply. There are some errors like:
ln: failed to create symbolic link ‘/mnt/archive/demmaccs_tmp/10576/189032/LC08_L1TP_189032_20180217_20180307_01_T1’: Read-only file system
Is there anything special with that location, like being on a network share or VirtualBox shared folder?
Hi,
I shared mnt/archive with a folder of my host machine in order to increase space. Could be there aren’t writing permissions on demmaccs_tmp folder. How can I solve the problem?
Hi,
I created a network shared folder (CIFS) and I have assegnated ALL permission and the owner the user sen2agri-service.
drwxrwxrwx. 2 sen2agri-service root 0 May 16 12:42 .
drwxr-xr-x. 4 root root 35 May 15 15:03 …
drwxrwxrwx. 2 sen2agri-service root 0 May 16 15:27 demmaccs_tmp
drwxrwxrwx. 2 sen2agri-service root 0 May 16 12:36 dwn_def
drwxrwxrwx. 2 sen2agri-service root 0 May 16 10:39 gipp
drwxrwxrwx. 2 sen2agri-service root 0 May 16 15:06 maccs_def
drwxrwxrwx. 2 sen2agri-service root 0 May 16 10:21 pippo
drwxrwxrwx. 2 sen2agri-service root 0 May 16 12:04 srtm
drwxrwxrwx. 2 sen2agri-service root 0 May 16 12:20 swbd
But, the process failed caused by
May 16 15:19:31 localhost.localdomain demmaccs_launcher.py[17451]: 2018-05-16 15:19:31.937073:[18129]:Starting command: ln -s /mnt/archive/dwn_def/s2/default/sito_8/S2A_MSIL1C_20170505T094031_N0205_R036_T33TWE_20170505T094858.SAFE /mnt/archive/demmaccs_tmp/17483/33TWE
May 16 15:19:31 localhost.localdomain demmaccs_launcher.py[17451]: ln: failed to create symbolic link ‘/mnt/archive/demmaccs_tmp/17483/33TWE/S2A_MSIL1C_20170505T094031_N0205_R036_T33TWE_20170505T094858.SAFE’: Operation not supported
May 16 15:19:31 localhost.localdomain demmaccs_launcher.py[17451]: 2018-05-16 15:19:31.972872:[18129]:Command finished NOK (res = 1) in 0:00:00.035851 : ln -s /mnt/archive/dwn_def/s2/default/sito_8/S2A_MSIL1C_20170505T094031_N0205_R036_T33TWE_20170505T094858.SAFE /mnt/archive/demmaccs_tmp/17483/33TWE
May 16 15:19:31 localhost.localdomain demmaccs_launcher.py[17451]: 2018-05-16 15:19:31.972918:[18129]:Could not create sym links for /mnt/archive/dwn_def/s2/default/sito_8/S2A_MSIL1C_20170505T094031_N0205_R036_T33TWE_20170505T094858.SAFE
May 16 15:19:32 localhost.localdomain demmaccs_launcher.py[17451]: 2018-05-16 15:19:32.062796:[17483]:MACCS did not processed any tiles for L1C product /mnt/archive/dwn_def/s2/default/sito_8/S2A_MSIL1C_20170505T094031_N0205_R036_T33TWE_20170505T094858.SAFE
May 16 15:19:32 localhost.localdomain demmaccs_launcher.py[17451]: 2018-05-16 15:19:32.071173:[17483]:Remove all the temporary files and directory
May 16 15:19:32 localhost.localdomain demmaccs_launcher.py[17451]: 2018-05-16 15:19:32.277126:[17483]:Total execution 0:12:41.001984:
May 16 15:19:32 localhost.localdomain demmaccs_launcher.py[17451]: 2018-05-16 15:19:32.292214:[17461]:Command finished NOK (res = 1) in 0:12:41.357073 : /usr/share/sen2agri/sen2agri-demmaccs/demmaccs.py --srtm /mnt/archive/srtm --swbd /mnt/archive/swbd --processes-number-dem 20 --processes-number-maccs 2 --gipp-dir /mnt/archive/gipp/ --working-dir /mnt/archive/demmaccs_tmp/ --maccs-launcher /opt/maccs/core/5.1/bin/maccs --delete-temp True /mnt/archive/dwn_def/s2/default/sito_8/S2A_MSIL1C_20170505T094031_N0205_R036_T33TWE_20170505T094858.SAFE /mnt/archive/maccs_def/sito_8/l2a/S2A_MSIL2A_20170505T094031_N0205_R036_T33TWE_20170505T094858.SAFE/
May 16 15:19:32 localhost.localdomain demmaccs_launcher.py[17451]: 2018-05-16 15:19:32.300548:[17461]:demmaccs.py script didn’t work!
May 16 15:19:32 localhost.localdomain demmaccs_launcher.py[17451]: 2018-05-16 15:19:32.306228:[17461]:Only set the state as processed in downloader_history (no l2a tiles found after maccs) for product /mnt/archive/maccs_def/sito_8/l2a/S2A_MSIL2A_20170505T094031_N0205_R036_T33TWE_20170505T094858.SAFE/
What is the output of mount?
I solved the problem adding “mfsymlinks” on mount.
“sudo mount -t cifs -o username=myusername, dir_mode=0777, file_mode=0777, mfsymlinks, uid=sen2agri-service //ip address/folder_shared /mnt/archive”
1 Like