Deleting .log files in dwn_def folder


#1

Hello,

Is it ok to delete .log files in the downloads folder of /mnt/archive?
I’m worrying that the file itself keeps getting bigger, so I decided also to disable the sen2agri-{sentinel,landsat}-downloader.{timer,service}

Regards.


#2

Hi,

How big are the files? Is the Landsat one larger? What does tail -f output for each of them?

You can delete them safely, but I’m not sure if the disk space will be reclaimed without restarting the downloaders.


#3

hello,

The sentinel .log files are bigger, they ranged from 4.5 to 419 MB, anyway here are the results of tail -f command:

sentinel_download.log:

2018-02-23 09:37:21.585397:[398]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170830T021339_N0205_R060_T51PXK_20170830T021339.SAFE
2018-02-23 09:37:21.585435:[398]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51PXK_20170919T021333.SAFE
2018-02-23 09:37:21.585472:[398]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51PYK_20170919T021333.SAFE
2018-02-23 09:37:21.585511:[398]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51NYJ_20170919T021333.SAFE
2018-02-23 09:37:21.585548:[398]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51NXJ_20170919T021333.SAFE
2018-02-23 09:37:21.585588:[398]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51NXJ_20170924T021340.SAFE
2018-02-23 09:37:21.585628:[398]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51PXK_20170924T021340.SAFE
2018-02-23 09:37:21.585668:[398]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51NYJ_20170924T021340.SAFE
2018-02-23 09:37:21.585708:[398]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51PYK_20170924T021340.SAFE
2018-02-23 09:37:21.585738:[398]:Total products: 56

sentinel_download.log_20180117110801

    2018-01-17 11:07:13.233852:[817]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51PXK_20170919T021333.SAFE
    2018-01-17 11:07:13.233884:[817]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51PYK_20170919T021333.SAFE
    2018-01-17 11:07:13.233916:[817]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51NYJ_20170919T021333.SAFE
    2018-01-17 11:07:13.233947:[817]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51NXJ_20170919T021333.SAFE
    2018-01-17 11:07:13.233981:[817]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51NXJ_20170924T021340.SAFE
    2018-01-17 11:07:13.234014:[817]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51PXK_20170924T021340.SAFE
    2018-01-17 11:07:13.234051:[817]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51NYJ_20170924T021340.SAFE
    2018-01-17 11:07:13.234085:[817]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51PYK_20170924T021340.SAFE
    2018-01-17 11:07:13.234110:[817]:Total products: 56
    2018-01-17 11:08:01.164933:[915]:Performing download for season start: 2016-10-01 end: 2017-12-31

sentinel_download.log_20180213112502

2018-02-13 11:24:34.038167:[22210]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51PXK_20170919T021333.SAFE
2018-02-13 11:24:34.038210:[22210]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51PYK_20170919T021333.SAFE
2018-02-13 11:24:34.038245:[22210]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51NYJ_20170919T021333.SAFE
2018-02-13 11:24:34.038283:[22210]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2B_MSIL1C_20170919T021339_N0205_R060_T51NXJ_20170919T021333.SAFE
2018-02-13 11:24:34.038320:[22210]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51NXJ_20170924T021340.SAFE
2018-02-13 11:24:34.038360:[22210]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51PXK_20170924T021340.SAFE
2018-02-13 11:24:34.038397:[22210]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51NYJ_20170924T021340.SAFE
2018-02-13 11:24:34.038436:[22210]:FILE ALREADY DOWNLOADED or ABORTED, SKIP IT! S2A_MSIL1C_20170924T021341_N0205_R060_T51PYK_20170924T021340.SAFE
2018-02-13 11:24:34.038462:[22210]:Total products: 56
2018-02-13 11:25:02.762191:[22243]:Performing download for season start: 2015-07-01 end: 2015-12-31

landsat_download.log

2018-02-23 09:38:38.389347:[29617]:Trying to download LC81120542016336LGN01
2018-02-23 09:40:18.644811:[29617]:URL Error for file LC81120542016336LGN01.tgz . Reason: [Errno 101] Network is unreachable. Url: https://earthexplorer.usgs.gov/download/4923/LC81120542016336LGN01/STANDARD/EE
2018-02-23 09:40:18.648574:[29617]:Trying to download LC81120542016336LGN02
2018-02-23 09:41:58.932976:[29617]:URL Error for file LC81120542016336LGN02.tgz . Reason: [Errno 101] Network is unreachable. Url: https://earthexplorer.usgs.gov/download/12864/LC81120542016336LGN02/STANDARD/EE
2018-02-23 09:41:58.935137:[29617]:Trying to download LC81120542016336LGN02
2018-02-23 09:43:39.142446:[29617]:URL Error for file LC81120542016336LGN02.tgz . Reason: [Errno 101] Network is unreachable. Url: https://earthexplorer.usgs.gov/download/4923/LC81120542016336LGN02/STANDARD/EE
2018-02-23 09:43:39.145406:[29617]:Searching for images on (julian date): 2016352...
2018-02-23 09:43:39.145803:[29617]:Trying to download LC81120542016352LGN00
2018-02-23 09:45:19.338433:[29617]:URL Error for file LC81120542016352LGN00.tgz . Reason: [Errno 101] Network is unreachable. Url: https://earthexplorer.usgs.gov/download/12864/LC81120542016352LGN00/STANDARD/EE
2018-02-23 09:45:19.340449:[29617]:Trying to download LC81120542016352LGN00

Regards.


#4

It’s fine to delete them. However, it looks like you have an issue accessing https://earthexplorer.usgs.gov.


#5

Hello! How can I delete them ? I have the same question and I can’t manage to access to database