No L3A or L3B products

I have installed 2.0 version of Sen2Agri. The system is generating L2 products. I have 2 sites, where I have enabled automatic generation of L3A and L3B products.The Jobs are visible in the user interface, but no products are generated. In monitoring I can see some of processes was submited and some of them has Error status. What kind of infromation/logs do you need to find where is problem.
Thank you in advance.

Kind regards

Jan

Hi Jan,
please provide us the output for:

  • sudo journalctl -u sen2agri-executor
  • sudo journalctl -u sen2agri-orchestrator.

regards,
Florin

Hi Florin,

thank you, see attached logs.

Kind regrads

Jan

executor.txt (20.5 KB)
orchestrator.txt (31.6 KB)

Hi Jan,
please execute and provide the outputs for the following commands:
sudo su -l sen2agri-service

  1. sinfo -a
  2. /usr/bin/otbcli
  3. sbatch --job-name TSKID_474_STEPNAME_MaskHandler_0 --qos qoscomposite /tmp/sen2agri-executor.B31731

regards,
Florin

Hi Florin,

I am not very skilled in linux, but something is wrong - here is output of terminal window:

Kind regards

Jan

Dear Jan,
please unzip and copy the attached script in the install_script folder from Sen2AgriDistribution.
After install please try again previous commands.
install_slurm_only.zip (7.2 KB)
regards,
Florin

Hi Florin,

I tried install the script, but there was some errors - see atatched file. sen2agri.log (8.8 KB)

After installation was the result was absolutely same like on the screenshot before.

Kidn regards

Jan

Dear Jan,
There is something wrong on your system’s OS.
Please execute the following and give us the result:
sudo find / -name “sbatch”
sudo su -l sen2agri-service
echo $PATH
ls -l /usr/sbatch
which sbatch

regards,
Florin

Dear Florin,

sorry for delay I was on vacation. The system installed for Sen2Agri is completely fresh install. And the Sen2Agri is 2.0 installation on this system. See attached results of your command:

sen2agri

Rgds

Jan

Similar issue here.
L2A products have been generated, sen2agri-services status is ‘active running’, executor and orchestrator seems also to be fine; on the webinterface the job is launched and status ‘submitted’, however… system seems to be stuck somehow.
Thoughts?!
BTW, I noticed the keys 'processor.l3b.mono_date_lai’, 'processor.l3b.lai.use_inra_version’ and 'processor.l3b.lai.link_l3c_to_l3b’ within config table were all set as 0. I updated them to 1, but still no progress. Help!!! (using version 2.0.1)

Hi Jan,

Your package should have a rpm_binaries/slurm directory. Can you try installing those RPMs manually? It looks like there was an issue with that.

yum -y install slurm-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-devel-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-munge-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-perlapi-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-pam_slurm-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-plugins-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-sjobexit-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-sjstat-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-slurmdbd-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-slurmdb-direct-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-sql-15.08.7-1.el7.centos.x86_64.rpm \
               slurm-torque-15.08.7-1.el7.centos.x86_64.rpm

Hi Incola,

unfortunately the packages was not found in repository:

[root@localhost ~]# yum -y install slurm-15.08.7-1.el7.centos.x86_64.rpm \

           slurm-devel-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-munge-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-perlapi-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-pam_slurm-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-plugins-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-sjobexit-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-sjstat-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-slurmdbd-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-slurmdb-direct-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-sql-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-torque-15.08.7-1.el7.centos.x86_64.rpm

Loaded plugins: fastestmirror, langpacks
Loading mirror speeds from cached hostfile

  • base: mirror.hosting90.cz
  • epel: mirror.hosting90.cz
  • extras: mirror.hosting90.cz
  • updates: mirror.hosting90.cz
    No package slurm-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-devel-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-munge-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-perlapi-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-pam_slurm-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-plugins-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-sjobexit-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-sjstat-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-slurmdbd-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-slurmdb-direct-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-sql-15.08.7-1.el7.centos.x86_64.rpm available.
    No package slurm-torque-15.08.7-1.el7.centos.x86_64.rpm available.
    Error: Nothing to do

Any suggestion?

Jan

Hi Jan. Those files are (or should be) part of the sen2agri installation package. You’ll need to go to that directory using cd, then run the command above. If you run it in the wrong directory, yum will not find the files.

Hi Incola, sorry I am not very familiar with linux, but I don´t think that it helped, it seems, that all the packages are installed:

yum -y install slurm-15.08.7-1.el7.centos.x86_64.rpm \

           slurm-devel-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-munge-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-perlapi-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-pam_slurm-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-plugins-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-sjobexit-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-sjstat-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-slurmdbd-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-slurmdb-direct-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-sql-15.08.7-1.el7.centos.x86_64.rpm \
           slurm-torque-15.08.7-1.el7.centos.x86_64.rpm

Loaded plugins: fastestmirror, langpacks
Examining slurm-15.08.7-1.el7.centos.x86_64.rpm: slurm-15.08.7-1.el7.centos.x86_ 64
slurm-15.08.7-1.el7.centos.x86_64.rpm: does not update installed package.
Examining slurm-devel-15.08.7-1.el7.centos.x86_64.rpm: slurm-devel-15.08.7-1.el7 .centos.x86_64
slurm-devel-15.08.7-1.el7.centos.x86_64.rpm: does not update installed package.
Examining slurm-munge-15.08.7-1.el7.centos.x86_64.rpm: slurm-munge-15.08.7-1.el7 .centos.x86_64
slurm-munge-15.08.7-1.el7.centos.x86_64.rpm: does not update installed package.
Examining slurm-perlapi-15.08.7-1.el7.centos.x86_64.rpm: slurm-perlapi-15.08.7-1 .el7.centos.x86_64
slurm-perlapi-15.08.7-1.el7.centos.x86_64.rpm: does not update installed package .
Examining slurm-pam_slurm-15.08.7-1.el7.centos.x86_64.rpm: slurm-pam_slurm-15.08 .7-1.el7.centos.x86_64
slurm-pam_slurm-15.08.7-1.el7.centos.x86_64.rpm: does not update installed packa ge.
Examining slurm-plugins-15.08.7-1.el7.centos.x86_64.rpm: slurm-plugins-15.08.7-1 .el7.centos.x86_64
slurm-plugins-15.08.7-1.el7.centos.x86_64.rpm: does not update installed package .
Examining slurm-sjobexit-15.08.7-1.el7.centos.x86_64.rpm: slurm-sjobexit-15.08.7 -1.el7.centos.x86_64
slurm-sjobexit-15.08.7-1.el7.centos.x86_64.rpm: does not update installed packag e.
Examining slurm-sjstat-15.08.7-1.el7.centos.x86_64.rpm: slurm-sjstat-15.08.7-1.e l7.centos.x86_64
slurm-sjstat-15.08.7-1.el7.centos.x86_64.rpm: does not update installed package.
Examining slurm-slurmdbd-15.08.7-1.el7.centos.x86_64.rpm: slurm-slurmdbd-15.08.7 -1.el7.centos.x86_64
slurm-slurmdbd-15.08.7-1.el7.centos.x86_64.rpm: does not update installed packag e.
Examining slurm-slurmdb-direct-15.08.7-1.el7.centos.x86_64.rpm: slurm-slurmdb-di rect-15.08.7-1.el7.centos.x86_64
slurm-slurmdb-direct-15.08.7-1.el7.centos.x86_64.rpm: does not update installed package.
Examining slurm-sql-15.08.7-1.el7.centos.x86_64.rpm: slurm-sql-15.08.7-1.el7.cen tos.x86_64
slurm-sql-15.08.7-1.el7.centos.x86_64.rpm: does not update installed package.
Examining slurm-torque-15.08.7-1.el7.centos.x86_64.rpm: slurm-torque-15.08.7-1.e l7.centos.x86_64
slurm-torque-15.08.7-1.el7.centos.x86_64.rpm: does not update installed package.
Error: Nothing to do