L3A generation error

I’m using web-based interface.
Data downloading seems normal. Atmospheric correction also (L2A). But processing stopped at L3A (compositing) step.

I’m using soft symbolic link to store data to a large partitioning. But it should not be an issue, because downloading script already used successfully this link.

Hi, can you attach any logs, either as displayed in the web site on the bottom of the “monitoring” page, or as outputted by journalctl?

What is the path to journalctl?

You can run sudo journalctl or sudo journalctl --since "2018-05-11" and it will output all of the log messages. Add | tee log.txt to save them to a file.

BTW, after installation of Sen2Agri I cretade symbolic link to data storage. I moved data around and folder “SRTM” is empty currently. I don’t know if it was empty just after installation

No, it certainly shouldn’t be empty. You should be able to find the data for /mnt/archive/{reference_data,swbd,srtm} in the installation package.

Got log, tried to upload but got error “new users can not upload attachments”

Can I just unzip “srtm.zip” into srtm directory? No need to need to perform installation?

Got log, tried to upload but got error “new users can not upload attachments”

Ah, sorry. Well, you should fix the other things first anyway.

Can I just unzip “srtm.zip” into srtm directory? No need to need to perform installation?

Yes, and also the others I mentioned.

Ok- working on it. I will let you know if processing will resume afterwards.

Note that you’ll need to update their database status. Pasting an entry from the FAQ:

How can I reprocess some L1 products?

The status of L1 products is stored in the downloader_history table. You can check it with the following command:

sudo -u postgres psql sen2agri -c \
    "select product_name, status_id, status_description \
     from downloader_history \
     inner join downloader_status \
        on downloader_status.id = status_id;"

If you want to e.g. reprocess the failed products, you can change their status:

sudo -u postgres psql sen2agri -c \
    "update downloader_history \
     set status_id = 2 -- downloaded
     where status_id = 6; -- processing_failed"

I updated the 3 direcories. Checked status- all failed. Updated status as suggested. But I don’t see any sign that processing of L3A resumed.

What does

sudo journalctl -ef -u sen2agri-demmaccs

output?

It runs once a minute, so make sure to wait a little.

dsat8L1ImageFileReader.txx:Read:589]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.026932 proc-s2a maccs-processing 05.01 [000000029082] [D] Read the band index ‘3’ for the band name ‘B3’ [vnsLandsat8L1ImageFileReader.txx:Read:589]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.026938 proc-s2a maccs-processing 05.01 [000000029082] [D] Read the band index ‘4’ for the band name ‘B4’ [vnsLandsat8L1ImageFileReader.txx:Read:589]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.026943 proc-s2a maccs-processing 05.01 [000000029082] [D] Read the band index ‘5’ for the band name ‘B5’ [vnsLandsat8L1ImageFileReader.txx:Read:589]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.026950 proc-s2a maccs-processing 05.01 [000000029082] [D] Read the band index ‘6’ for the band name ‘B6’ [vnsLandsat8L1ImageFileReader.txx:Read:589]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.026956 proc-s2a maccs-processing 05.01 [000000029082] [D] Read the band index ‘7’ for the band name ‘B7’ [vnsLandsat8L1ImageFileReader.txx:Read:589]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027045 proc-s2a maccs-processing 05.01 [000000029082] [D] Ratio estimated between L2CoarseResolution and L2 Resolution for QL caching Nb stripped. Spacing L2Coarse: 240 and L2Coarse Spacing: 30 -> ratio: 8 [vnsLandsat8L1ImageFileReader.txx:Read:626]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027056 proc-s2a maccs-processing 05.01 [000000029082] [D] Setting padding and resampling for IPEDGSubSubsampleFilter… [vnsLandsat8L1ImageFileReader.txx:Read:631]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027069 proc-s2a maccs-processing 05.01 [000000029082] [D] l_NonConstinputPointer->UpdateOutputInformation()… [vnsPadAndResampleImageFilter.txx:UpdateWithCaching:85]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027099 proc-s2a maccs-processing 05.01 [000000029082] [D] l_NonConstinputPointer->UpdateOutputInformation() done (time is 0.011 MS). [vnsPadAndResampleImageFilter.txx:UpdateWithCaching:85]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027121 proc-s2a maccs-processing 05.01 [000000029082] [D] ResamplerHelper: It’s a ‘SUB’ sampling processing (input spacing=[30;-30] and out spacing=[240;-240]) [vnsResamplerHelper.h:CheckSpacingAndGetIsSubSamplingCondition:287]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027130 proc-s2a maccs-processing 05.01 [000000029082] [D] ‘SUB’ sampling Factor computed : 8 (real=8) [vnsResamplerHelper.h:ComputeInterpolatorRadius:313]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027137 proc-s2a maccs-processing 05.01 [000000029082] [D] ResamplerHelper::ComputeInterpolatorRadius: Radius computed: 8 [vnsResamplerHelper.h:ComputeInterpolatorRadius:402]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027144 proc-s2a maccs-processing 05.01 [000000029082] [D] RB_INTERPOLATOR_LINEAR_WITH_RADIUS - Radius = 8 [vnsPadAndResampleImageFilter.txx:UpdateWithCaching:122]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027165 proc-s2a maccs-processing 05.01 [000000029082] [D] PadAndResampleImageFilter - Pad value : [4, 4] [vnsPadAndResampleImageFilter.txx:UpdateWithCaching:167]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027183 proc-s2a maccs-processing 05.01 [000000029082] [D] Setting padding and resampling for IPEDGSubSubsampleFilter done. [vnsLandsat8L1ImageFileReader.txx:Read:631]
май 11 18:10:45 proc-s2a demmaccs_launcher.py[25400]: 2018-05-11T18:10:45.027296 proc-s2a maccs-processing 05.01 [000000029082] [D] vnsCachingMacro Proceed caching… with file name vns_caching_SubsamplingIPEDGSub0.tif (ModeStreamDivisions=1; NumberOfStreamDivisions=62). [vnsLandsat8L1ImageFileReader.txx:Read:635]

Copied few last lines. I think work is in progress to download data for my another site- which In fact I turned off.

That means it’s still running. It should have finished by now. Downloads and L2A processing shouldn’t interact with each other.

I just realized we’re talking about L2As while your thread title mentions L3As.

I got L2A- not problem.
Problem is that folders L3a and L4b are empty!

I got L2A- not problem.

Without the SRTM dataset you shouldn’t have been able to obtain the L2As. And now you’re reprocessing them anyway.

Problem is that folders L3a and L4b are empty!

Do you see any jobs at the bottom of the “monitoring” page of the web interface?

L3B vegetation status Error -multiple such messages, no single message with success

Do you see anything if you click the [output] link?