Dev 20240517 to main #89
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Unfortunately doesn't work yet.
-fix for #86 -removed the backup on S3 INT option with rclone
Script to add properties to existing GEE assets. #79
feat: Add processing pipeline for daily LandSurface mosaics over Switzerland with step0_processor_msg_lst.py - Introduced a new script to access and upload LandSurface (LST) data over Switzerland to Google Earth Engine (GEE). - Utilized CMS SAF data provided by MeteoSwiss via s3 on data.geo.admin.ch to store as SATROMO assets and to calculate VCI, TCI, and VHI. - Added functionality to retrieve and process NetCDF files, extracting relevant attributes and dimensions. - Implemented the export of NetCDF bands to GeoTIFF format and scaling operations using Rasterio. - Added functions to generate LST mosaics for specific dates and handle the upload process to Google Cloud Storage and GEE. - Ensured proper error handling and cleanup of temporary files and datasets. - added in dev_config a new PRODUCT_MSG which configs the LST - moved util_addproperties to main_functions
-Update dependencies in requirements.txt for LST METEOSWISS processor - removed unnecessary mount point to google cloud
MSG LST and MSG LST CLIMA can be calculated with the step0 function as the otehr products. They won't have a step1. This eases reprocessing -satromo processor: added PRODUCT_MSG_CLIMA and PRODUCT_MSG exit points -dev_config: added RODUCT_MSG_CLIMA and PRODUCT_MSG new -step0_processor_msg_lst.py -step0_processor_msg_lst_clima.py
we can now reprocess a specific date from command line 'python satromo_processor.py prod_config.py 2024-06-12', the config file is a must when us with date option
#56 - outside of the swiss perimeter is nan, inside, but in the swiss perimeter but outside the flightpath is zero. - line 605 in step0_processor_s2_sr.py is causing issues.
Added Description for Single Scene Processing via Command Line
Fix for #56
Thumbnail:
Fixed aspect ratio for VHI and S2 SR.
Updated background to accommodate new S2 SR tiles cut to the effective path.
Changed no data values accordingly.
util_listassets.py:
Added functionality to list all assets of a collection.
util_moveassets_terrainshadow.py:
Script to initialize Google Earth Engine (GEE) and Google Drive authentication.
Converts Day-Of-Year (DOY) to datetime strings.
Manages the copying and updating of assets within Google Earth Engine.
satromo_publish.py:
Added detection for VHI cases to use the Swiss buffer.
step0_processor_s2_sr.py:
Replaced swisswalti with swisssurface.
Set terrainShadowDetectionPrecalculated to True to use pre-calculated shadows.
step1_processor_vhi.py:
Updated to use T235959 time format instead of 240000 as per definitions with BAFU and MeteoSwiss.
set certifi to latest
fix missing slash at the end of the shadow terrain collection
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adding