Hi,
I noticed that MACCS reprocesses files which were already processed before. Is that on purpose or not as intended?
Here’s an example logfile, which shows that the maccs process was started multiple times after it had already finished with res OK:
cat /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs_175055.log
2018-02-18 01:50:57.619018:[24725]:Symbolic link L2SITE for tile id 175055 GIPP file could not be found. Searching for the common one
2018-02-18 01:50:57.630761:[24725]:Copied /mnt/archive/gipp//LANDSAT8/L8_TEST_GIP_L2SITE_S_EUCMN00000A00B_00001_00000000_99999999.EEF to /mnt/archive/demmaccs_tmp/5537/175055/L8_TEST_GIP_L2SITE_S_EU17505500A00B_00001_00000000_99999999.EEF
2018-02-18 01:50:57.633894:[24725]:Symbolic link CKEXTL for tile id 175055 GIPP file could not be found. Searching for the common one
2018-02-18 01:50:57.642950:[24725]:Copied /mnt/archive/gipp//LANDSAT8/L8_TEST_GIP_CKEXTL_S_EUCMN00000A00B_00001_00000000_99999999.EEF to /mnt/archive/demmaccs_tmp/5537/175055/L8_TEST_GIP_CKEXTL_S_EU17505500A00B_00001_00000000_99999999.EEF
2018-02-18 01:50:57.646669:[24725]:Symbolic link CKQLTL for tile id 175055 GIPP file could not be found. Searching for the common one
2018-02-18 01:50:57.657073:[24725]:Copied /mnt/archive/gipp//LANDSAT8/L8_TEST_GIP_CKQLTL_S_EUCMN00000A00B_00001_00000000_99999999.EEF to /mnt/archive/demmaccs_tmp/5537/175055/L8_TEST_GIP_CKQLTL_S_EU17505500A00B_00001_00000000_99999999.EEF
2018-02-18 01:50:57.790623:[24725]:Creating sym links for NOMINAL MACCS mode: l2a prev tiles ['/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs_175055.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/log.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/mosaic.jpg', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_PMC_L2REPT_175055___20170604.EEF', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR']
2018-02-18 01:50:57.849509:[24725]:Created sym links for NOMINAL MACCS mode for ['/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs_175055.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/log.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/mosaic.jpg', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_PMC_L2REPT_175055___20170604.EEF', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR']
2018-02-18 01:50:57.854035:[24725]:sat_id = 2 | acq_date = 20170604T000000
2018-02-18 01:50:57.857466:[24725]:Starting MACCS in L2NOMINAL for /mnt/archive/demmaccs_tmp/5537/LC08_L1TP_175055_20170604_20170616_01_T1 | TileID: 175055
2018-02-18 01:50:57.859778:[24725]:MACCS_COMMAND: ['/opt/maccs/core/5.1/bin/maccs', '--input', '/mnt/archive/demmaccs_tmp/5537/175055', '--TileId', '175055', '--output', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055', '--mode', 'L2NOMINAL', '--loglevel', 'DEBUG', '--enableTest', 'false', '--CheckXMLFilesWithSchema', 'false']
2018-02-18 01:50:57.861529:[24725]:Starting command: /opt/maccs/core/5.1/bin/maccs --input /mnt/archive/demmaccs_tmp/5537/175055 --TileId 175055 --output /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055 --mode L2NOMINAL --loglevel DEBUG --enableTest false --CheckXMLFilesWithSchema false
2018-02-18 02:32:31.240981:[24725]:Command finished OK (res = 0) in 0:41:33.372470 : /opt/maccs/core/5.1/bin/maccs --input /mnt/archive/demmaccs_tmp/5537/175055 --TileId 175055 --output /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055 --mode L2NOMINAL --loglevel DEBUG --enableTest false --CheckXMLFilesWithSchema false
2018-02-18 02:32:31.258973:[24725]:MACCS mode L2NOMINAL for /mnt/archive/demmaccs_tmp/5537/LC08_L1TP_175055_20170604_20170616_01_T1 tile 175055 finished in: 0:41:33.585144. Location: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1/
2018-02-18 02:32:31.302800:[24725]:Searching for report maccs files (REPT) in: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055
2018-02-18 02:32:31.305490:[24725]:Report maccs files (REPT) found in: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055 : ['/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_PMC_L2REPT_175055___20170604.EEF']
2018-02-18 02:32:31.308443:[24725]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_PMC_L2REPT_175055___20170604.EEF to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_PMC_L2REPT_175055___20170604.EEF
2018-02-18 02:32:31.316203:[24725]:Searching for valid products in MACCS working dir: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055. Following is the content of this dir: ['/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.DBL', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_QCK_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR']
2018-02-18 02:32:31.318672:[24725]:Found valid tile id 175055 in /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055. Move all files to destination
2018-02-18 02:32:31.321544:[24725]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR
2018-02-18 02:32:31.325673:[24725]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.DBL to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_L8C_L2VALD_175055_20170604.DBL
2018-02-18 02:32:31.330771:[24725]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.HDR to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_L8C_L2VALD_175055_20170604.HDR
2018-02-18 02:32:31.337110:[24725]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_QCK_L2VALD_175055_20170604.HDR to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_QCK_L2VALD_175055_20170604.HDR
2018-02-18 02:32:31.364924:[24725]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR
2018-02-18 02:32:31.369380:[24725]:Deleting MACCS working directory: rmtree: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055
2018-02-23 10:57:38.354943:[6678]:Symbolic link L2SITE for tile id 175055 GIPP file could not be found. Searching for the common one
2018-02-23 10:57:38.370259:[6678]:Copied /mnt/archive/gipp//LANDSAT8/L8_TEST_GIP_L2SITE_S_EUCMN00000A00B_00001_00000000_99999999.EEF to /mnt/archive/demmaccs_tmp/20151/175055/L8_TEST_GIP_L2SITE_S_EU17505500A00B_00001_00000000_99999999.EEF
2018-02-23 10:57:38.375955:[6678]:Symbolic link CKEXTL for tile id 175055 GIPP file could not be found. Searching for the common one
2018-02-23 10:57:38.392301:[6678]:Copied /mnt/archive/gipp//LANDSAT8/L8_TEST_GIP_CKEXTL_S_EUCMN00000A00B_00001_00000000_99999999.EEF to /mnt/archive/demmaccs_tmp/20151/175055/L8_TEST_GIP_CKEXTL_S_EU17505500A00B_00001_00000000_99999999.EEF
2018-02-23 10:57:38.401225:[6678]:Symbolic link CKQLTL for tile id 175055 GIPP file could not be found. Searching for the common one
2018-02-23 10:57:38.411930:[6678]:Copied /mnt/archive/gipp//LANDSAT8/L8_TEST_GIP_CKQLTL_S_EUCMN00000A00B_00001_00000000_99999999.EEF to /mnt/archive/demmaccs_tmp/20151/175055/L8_TEST_GIP_CKQLTL_S_EU17505500A00B_00001_00000000_99999999.EEF
2018-02-23 10:57:38.434646:[6678]:Creating sym links for NOMINAL MACCS mode: l2a prev tiles ['/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs_175055.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/log.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/mosaic.jpg', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_PMC_L2REPT_175055___20170604.EEF', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR']
2018-02-23 10:57:38.523614:[6678]:Created sym links for NOMINAL MACCS mode for ['/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs_175055.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/log.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/mosaic.jpg', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_PMC_L2REPT_175055___20170604.EEF', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR']
2018-02-23 10:57:38.531181:[6678]:sat_id = 2 | acq_date = 20170604T000000
2018-02-23 10:57:38.533263:[6678]:Starting MACCS in L2NOMINAL for /mnt/archive/demmaccs_tmp/20151/LC08_L1TP_175055_20170604_20170616_01_T1 | TileID: 175055
2018-02-23 10:57:38.535551:[6678]:MACCS_COMMAND: ['/opt/maccs/core/5.1/bin/maccs', '--input', '/mnt/archive/demmaccs_tmp/20151/175055', '--TileId', '175055', '--output', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055', '--mode', 'L2NOMINAL', '--loglevel', 'DEBUG', '--enableTest', 'false', '--CheckXMLFilesWithSchema', 'false']
2018-02-23 10:57:38.548734:[6678]:Starting command: /opt/maccs/core/5.1/bin/maccs --input /mnt/archive/demmaccs_tmp/20151/175055 --TileId 175055 --output /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055 --mode L2NOMINAL --loglevel DEBUG --enableTest false --CheckXMLFilesWithSchema false
2018-02-23 11:53:15.662151:[6678]:Command finished OK (res = 0) in 0:55:37.067673 : /opt/maccs/core/5.1/bin/maccs --input /mnt/archive/demmaccs_tmp/20151/175055 --TileId 175055 --output /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055 --mode L2NOMINAL --loglevel DEBUG --enableTest false --CheckXMLFilesWithSchema false
2018-02-23 11:53:15.678621:[6678]:MACCS mode L2NOMINAL for /mnt/archive/demmaccs_tmp/20151/LC08_L1TP_175055_20170604_20170616_01_T1 tile 175055 finished in: 0:55:37.242333. Location: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1/
2018-02-23 11:53:15.734279:[6678]:Searching for report maccs files (REPT) in: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055
2018-02-23 11:53:15.744114:[6678]:Report maccs files (REPT) found in: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055 : ['/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_PMC_L2REPT_175055___20170604.EEF']
2018-02-23 11:53:15.777199:[6678]:The file /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_PMC_L2REPT_175055___20170604.EEF already exists. Trying to delete it in order to move the new created file by MACCS
2018-02-23 11:53:15.809301:[6678]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_PMC_L2REPT_175055___20170604.EEF to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_PMC_L2REPT_175055___20170604.EEF
2018-02-23 11:53:15.903811:[6678]:Searching for valid products in MACCS working dir: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055. Following is the content of this dir: ['/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.DBL', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_QCK_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR']
2018-02-23 11:53:15.905576:[6678]:Found valid tile id 175055 in /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055. Move all files to destination
2018-02-23 11:53:15.907950:[6678]:The directory /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR already exists. Trying to delete it in order to move the new created directory by MACCS
2018-02-23 11:53:15.965706:[6678]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR
2018-02-23 11:53:15.971274:[6678]:The file /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_L8C_L2VALD_175055_20170604.DBL already exists. Trying to delete it in order to move the new created file by MACCS
2018-02-23 11:53:15.975756:[6678]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.DBL to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_L8C_L2VALD_175055_20170604.DBL
2018-02-23 11:53:15.982278:[6678]:The file /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_L8C_L2VALD_175055_20170604.HDR already exists. Trying to delete it in order to move the new created file by MACCS
2018-02-23 11:53:15.986421:[6678]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.HDR to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_L8C_L2VALD_175055_20170604.HDR
2018-02-23 11:53:15.994824:[6678]:The file /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_QCK_L2VALD_175055_20170604.HDR already exists. Trying to delete it in order to move the new created file by MACCS
2018-02-23 11:53:16.000407:[6678]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_QCK_L2VALD_175055_20170604.HDR to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_QCK_L2VALD_175055_20170604.HDR
2018-02-23 11:53:16.010650:[6678]:The directory /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR already exists. Trying to delete it in order to move the new created directory by MACCS
2018-02-23 11:53:16.768107:[6678]:Moving /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR to /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR
2018-02-23 11:53:16.774740:[6678]:Deleting MACCS working directory: rmtree: /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055
2018-02-28 10:04:21.756705:[583]:Symbolic link L2SITE for tile id 175055 GIPP file could not be found. Searching for the common one
2018-02-28 10:04:21.779164:[583]:Copied /mnt/archive/gipp//LANDSAT8/L8_TEST_GIP_L2SITE_S_EUCMN00000A00B_00001_00000000_99999999.EEF to /mnt/archive/demmaccs_tmp/20165/175055/L8_TEST_GIP_L2SITE_S_EU17505500A00B_00001_00000000_99999999.EEF
2018-02-28 10:04:21.781543:[583]:Symbolic link CKEXTL for tile id 175055 GIPP file could not be found. Searching for the common one
2018-02-28 10:04:21.787586:[583]:Copied /mnt/archive/gipp//LANDSAT8/L8_TEST_GIP_CKEXTL_S_EUCMN00000A00B_00001_00000000_99999999.EEF to /mnt/archive/demmaccs_tmp/20165/175055/L8_TEST_GIP_CKEXTL_S_EU17505500A00B_00001_00000000_99999999.EEF
2018-02-28 10:04:21.790459:[583]:Symbolic link CKQLTL for tile id 175055 GIPP file could not be found. Searching for the common one
2018-02-28 10:04:21.796474:[583]:Copied /mnt/archive/gipp//LANDSAT8/L8_TEST_GIP_CKQLTL_S_EUCMN00000A00B_00001_00000000_99999999.EEF to /mnt/archive/demmaccs_tmp/20165/175055/L8_TEST_GIP_CKQLTL_S_EU17505500A00B_00001_00000000_99999999.EEF
2018-02-28 10:04:21.826535:[583]:Creating sym links for NOMINAL MACCS mode: l2a prev tiles ['/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs_175055.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/log.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/mosaic.jpg', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_PMC_L2REPT_175055___20170604.EEF', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR']
2018-02-28 10:04:21.907847:[583]:Created sym links for NOMINAL MACCS mode for ['/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.DBL.DIR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/demmaccs_175055.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/log.log', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/mosaic.jpg', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_PMC_L2REPT_175055___20170604.EEF', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_QCK_L2VALD_175055_20170604.HDR', '/mnt/archive/maccs_def/southsudan_northbahreghazal_warrap/l2a/LC08_L2A_175055_20170604_20170616_01_T1/L8_TEST_L8C_L2VALD_175055_20170604.DBL.DIR']
2018-02-28 10:04:21.910240:[583]:sat_id = 2 | acq_date = 20170604T000000
2018-02-28 10:04:21.912077:[583]:Starting MACCS in L2NOMINAL for /mnt/archive/demmaccs_tmp/20165/LC08_L1TP_175055_20170604_20170616_01_T1 | TileID: 175055
2018-02-28 10:04:21.913663:[583]:MACCS_COMMAND: ['/opt/maccs/core/5.1/bin/maccs', '--input', '/mnt/archive/demmaccs_tmp/20165/175055', '--TileId', '175055', '--output', '/mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055', '--mode', 'L2NOMINAL', '--loglevel', 'DEBUG', '--enableTest', 'false', '--CheckXMLFilesWithSchema', 'false']
2018-02-28 10:04:21.915446:[583]:Starting command: /opt/maccs/core/5.1/bin/maccs --input /mnt/archive/demmaccs_tmp/20165/175055 --TileId 175055 --output /mnt/archive/maccs_def/lspth175/l2a/LC08_L2A_175055_20170604_20170616_01_T1//maccs_175055 --mode L2NOMINAL --loglevel DEBUG --enableTest false --CheckXMLFilesWithSchema false
There’s a corresponding entry in the product database table (in this case even two, which might be from migrating the VM at some point):
name | created_timestamp | site_id
-----------------------------------------+------------------------+-------------------------------
LC08_L2A_175055_20170604_20170616_01_T1 | 2017-06-04 00:00:00+00 | 2018-01-31 14:08:59.016186+00
LC08_L2A_175055_20170604_20170616_01_T1 | 2017-06-04 00:00:00+00 | 2018-02-18 02:32:40.423307+00
However, the downloader_history database table doesn’t show it as processed:
product_name | site_id | status_id
------------------------------------------+---------+-----------
LC08_L1TP_175055_20170604_20170616_01_T1 | 6 | 2
(1 row)
EDIT:
I checked the status_id in downloader_history for each L8 product in the product table, and there seems to be a sizable amount of 2 … without knowing why, can I just set them to 5?
Best