Simply reprojecting GOES-17 Data

Post Reply
pjordan
Posts: 3
Joined: Mon Jun 08, 2020 11:38 am

Simply reprojecting GOES-17 Data

Post by pjordan »

Hi

I'm not very familiar with either Linux or geostationary projections, and I simply want to reproject GOES data to WGS84 grid such that it can be ingested into other software.

It is perhaps too simplistic, but after reading the documentation I tried this:

$GEO2GRID_HOME/bin/geo2grid.sh -r abi_l1b -w geotiff -g wgs84_fit -f OR_ABI-L1b-RadF-M6C01_G17_s20200080000371_e20200080009438_c20200080009488.nc


It came up with as an error, with the following log file:

Code: Select all

[2020-06-10 18:45:06,670] : PID  10005 : DEBUG    : abi_l1b_geotiff : main : Starting script with arguments: /home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/polar2grid/glue.py -r abi_l1b -w geotiff -g wgs84_fit -f OR_ABI-L1b-RadF-M6C01_G17_s20200080000371_e20200080009438_c20200080009488.nc -vv
[2020-06-10 18:45:06,676] : PID  10005 : INFO     : abi_l1b_geotiff : main : Sorting and reading input files...
[2020-06-10 18:45:06,677] : PID  10005 : DEBUG    : satpy.scene : __init__ : Setting 'PPP_CONFIG_DIR' to '/home/ucfaurr/DATA/geo2grid_v_1_0_1/etc/satpy'
[2020-06-10 18:45:06,680] : PID  10005 : DEBUG    : satpy.readers : read_reader_config : Reading ['/data/store05/students/masters/2019/data/ucfaurr/geo2grid_v_1_0_1/lib/python3.7/site-packages/satpy/etc/readers/abi_l1b.yaml']
[2020-06-10 18:45:06,813] : PID  10005 : DEBUG    : satpy.readers.yaml_reader : create_filehandlers : Assigning to abi_l1b: ['OR_ABI-L1b-RadF-M6C01_G17_s20200080000371_e20200080009438_c20200080009488.nc']
[2020-06-10 18:45:06,912] : PID  10005 : DEBUG    : satpy.composites : load_sensor_composites : Looking for composites config file abi.yaml
[2020-06-10 18:45:06,957] : PID  10005 : DEBUG    : satpy.composites : load_sensor_composites : Looking for composites config file visir.yaml
[2020-06-10 18:45:07,010] : PID  10005 : DEBUG    : polar2grid.core.script_utils : rename_log_file : Log renamed from '/data/store05/students/masters/2019/data/ucfaurr/test/abi_l1b_geotiff_fail.log' to 'abi_l1b_geotiff_20200108_000037.log'
[2020-06-10 18:45:07,027] : PID  10005 : INFO     : abi_l1b_geotiff : main : Using default product list: ['C01', 'C02', 'C03', 'C04', 'C05', 'C06', 'C07', 'C08', 'C09', 'C10', 'C11', 'C12', 'C13', 'C14', 'C15', 'C16', 'true_color', 'natural_color']
[2020-06-10 18:45:07,027] : PID  10005 : INFO     : abi_l1b_geotiff : main : Loading product metadata from files...
[2020-06-10 18:45:07,033] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-10 18:45:07,037] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-10 18:45:07,041] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-10 18:45:07,048] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_azimuth_angle: Unknown dataset satellite_azimuth_angle
[2020-06-10 18:45:07,050] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_zenith_angle: Unknown dataset satellite_zenith_angle
[2020-06-10 18:45:07,052] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_azimuth_angle: Unknown dataset solar_azimuth_angle
[2020-06-10 18:45:07,054] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-10 18:45:07,059] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-10 18:45:07,063] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_azimuth_angle: Unknown dataset satellite_azimuth_angle
[2020-06-10 18:45:07,066] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_zenith_angle: Unknown dataset satellite_zenith_angle
[2020-06-10 18:45:07,068] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_azimuth_angle: Unknown dataset solar_azimuth_angle
[2020-06-10 18:45:07,070] : PID  10005 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-10 18:45:07,073] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c13' not found or loaded for 'C13'
[2020-06-10 18:45:07,073] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c16' not found or loaded for 'C16'
[2020-06-10 18:45:07,073] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c08' not found or loaded for 'C08'
[2020-06-10 18:45:07,073] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c04' not found or loaded for 'C04'
[2020-06-10 18:45:07,073] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c09' not found or loaded for 'C09'
[2020-06-10 18:45:07,074] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c11' not found or loaded for 'C11'
[2020-06-10 18:45:07,074] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c14' not found or loaded for 'C14'
[2020-06-10 18:45:07,074] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c02' not found or loaded for 'C02'
[2020-06-10 18:45:07,074] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c07' not found or loaded for 'C07'
[2020-06-10 18:45:07,074] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c03' not found or loaded for 'C03'
[2020-06-10 18:45:07,074] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c05' not found or loaded for 'C05'
[2020-06-10 18:45:07,074] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c12' not found or loaded for 'C12'
[2020-06-10 18:45:07,074] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c06' not found or loaded for 'C06'
[2020-06-10 18:45:07,074] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c10' not found or loaded for 'C10'
[2020-06-10 18:45:07,083] : PID  10005 : DEBUG    : satpy.readers.abi_l1b : get_dataset : Reading in get_dataset C01.
[2020-06-10 18:45:07,093] : PID  10005 : DEBUG    : satpy.readers.abi_l1b : get_dataset : Calibrating to reflectances
[2020-06-10 18:45:07,129] : PID  10005 : WARNING  : satpy.readers.yaml_reader : _get_file_handlers : Required file type 'c15' not found or loaded for 'C15'
[2020-06-10 18:45:07,129] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=())'
[2020-06-10 18:45:07,129] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))'
[2020-06-10 18:45:07,130] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='true_color', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))'
[2020-06-10 18:45:07,130] : PID  10005 : DEBUG    : satpy.composites : __call__ : Applying sun zen correction
[2020-06-10 18:45:07,130] : PID  10005 : DEBUG    : satpy.composites : __call__ : Computing sun zenith angles.
[2020-06-10 18:45:07,288] : PID  10005 : DEBUG    : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)]
[2020-06-10 18:45:07,302] : PID  10005 : DEBUG    : satpy.composites : __call__ : Sun-zenith correction applied. Computation time:   0.2 (sec)
[2020-06-10 18:45:07,303] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=())'
[2020-06-10 18:45:07,303] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))'
[2020-06-10 18:45:07,303] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='green', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)': 'DatasetID(name='C01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))'
[2020-06-10 18:45:07,303] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=())'
[2020-06-10 18:45:07,303] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))'
[2020-06-10 18:45:07,303] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=())'
[2020-06-10 18:45:07,304] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))'
[2020-06-10 18:45:07,304] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C05', wavelength=(1.58, 1.61, 1.64), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))': 'DatasetID(name='C05', wavelength=(1.58, 1.61, 1.64), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=())'
[2020-06-10 18:45:07,304] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C05', wavelength=(1.58, 1.61, 1.64), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))': 'DatasetID(name='C05', wavelength=(1.58, 1.61, 1.64), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=())'
[2020-06-10 18:45:07,304] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='natural_color', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)': 'DatasetID(name='C05', wavelength=(1.58, 1.61, 1.64), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))'
[2020-06-10 18:45:07,304] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))': 'DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=())'
[2020-06-10 18:45:07,304] : PID  10005 : DEBUG    : satpy.scene : _get_prereq_datasets : Missing prerequisite for 'DatasetID(name='C03', wavelength=(0.8455, 0.865, 0.8845), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))': 'DatasetID(name='C03', wavelength=(0.8455, 0.865, 0.8845), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=())'
[2020-06-10 18:45:07,305] : PID  10005 : WARNING  : satpy.scene : load : The following datasets were not created and may require resampling to be generated: DatasetID(name='C16', wavelength=(13.0, 13.3, 13.6), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=()), DatasetID(name='C08', wavelength=(5.77, 6.185, 6.6), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=()), DatasetID(name='C04', wavelength=(1.3705, 1.378, 1.3855), resolution=2000, polarization=None, calibration='reflectance', level=None, modifiers=()), DatasetID(name='C09', wavelength=(6.75, 6.95, 7.15), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=()), DatasetID(name='C11', wavelength=(8.3, 8.5, 8.7), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=()), DatasetID(name='C02', wavelength=(0.59, 0.64, 0.69), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=()), DatasetID(name='C07', wavelength=(3.8, 3.9, 4.0), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=()), DatasetID(name='C05', wavelength=(1.58, 1.61, 1.64), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=()), DatasetID(name='C06', wavelength=(2.225, 2.25, 2.275), resolution=2000, polarization=None, calibration='reflectance', level=None, modifiers=()), DatasetID(name='C10', wavelength=(7.24, 7.34, 7.44), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=()), DatasetID(name='C15', wavelength=(11.8, 12.3, 12.8), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=()), DatasetID(name='C13', wavelength=(10.1, 10.35, 10.6), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=()), DatasetID(name='true_color', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None), DatasetID(name='C14', wavelength=(10.8, 11.2, 11.6), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=()), DatasetID(name='natural_color', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None), DatasetID(name='C03', wavelength=(0.8455, 0.865, 0.8845), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=()), DatasetID(name='C12', wavelength=(9.42, 9.61, 9.8), resolution=2000, polarization=None, calibration='brightness_temperature', level=None, modifiers=())
[2020-06-10 18:45:07,305] : PID  10005 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='C01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-10 18:45:07,309] : PID  10005 : DEBUG    : polar2grid.grids.manager : __init__ : Using default grid configuration: 'grids.conf' 
[2020-06-10 18:45:07,309] : PID  10005 : DEBUG    : polar2grid.grids.manager : __init__ : Loading grid configuration 'grids.conf'
[2020-06-10 18:45:07,607] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid 'dwd_germany' origin from (lon: -2.000000, lat: 56.000000) to (x: -755570.370463, y: -3554679.114710)
[2020-06-10 18:45:07,614] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid 'australia' origin from (lon: 105.000000, lat: 5.000000) to (x: -3896182.177765, y: 557305.257275)
[2020-06-10 18:45:07,621] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid 'australia2' origin from (lon: 105.000000, lat: 5.000000) to (x: -3896182.177765, y: 557305.257275)
[2020-06-10 18:45:07,628] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211e' origin from (lon: -123.044000, lat: 59.844000) to (x: -1950510.636800, y: 4368587.226913)
[2020-06-10 18:45:07,636] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211e_10km' origin from (lon: -123.044000, lat: 59.844000) to (x: -1950510.636800, y: 4368587.226913)
[2020-06-10 18:45:07,643] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211e_hi' origin from (lon: -123.044000, lat: 59.844000) to (x: -1950510.636800, y: 4368587.226913)
[2020-06-10 18:45:07,650] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211w' origin from (lon: -152.855000, lat: 54.536000) to (x: -4226045.730436, y: 4368634.765713)
[2020-06-10 18:45:07,658] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211w_10km' origin from (lon: -152.855000, lat: 54.536000) to (x: -4226045.730436, y: 4368634.765713)
[2020-06-10 18:45:07,666] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '203' origin from (lon: 115.601000, lat: 44.646000) to (x: -4952960.856044, y: 381022.610378)
[2020-06-10 18:45:07,674] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '203_10km' origin from (lon: 115.601000, lat: 44.646000) to (x: -4952960.856044, y: 381022.610378)
[2020-06-10 18:45:07,681] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '204' origin from (lon: 110.000000, lat: 60.644000) to (x: -7314463.252793, y: 8020503.279488)
[2020-06-10 18:45:07,688] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '204_10km' origin from (lon: 110.000000, lat: 60.644000) to (x: -7314463.252793, y: 8020503.279488)
[2020-06-10 18:45:07,695] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '205' origin from (lon: -115.304000, lat: 36.257000) to (x: -4952924.911284, y: -3429056.260492)
[2020-06-10 18:45:07,702] : PID  10005 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '210' origin from (lon: -77.000000, lat: 26.422000) to (x: 0.000000, y: 2864298.891608)
[2020-06-10 18:45:07,703] : PID  10005 : DEBUG    : abi_l1b_geotiff : main : Products to preserve resolution for: set()
[2020-06-10 18:45:07,703] : PID  10005 : DEBUG    : abi_l1b_geotiff : main : Products to use new resolution for: {DatasetID(name='C01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=())}
[2020-06-10 18:45:39,378] : PID  10005 : DEBUG    : abi_l1b_geotiff : main : Setting default resampling to 'nearest' for grid 'wgs84_fit'
[2020-06-10 18:45:39,378] : PID  10005 : INFO     : abi_l1b_geotiff : main : Resampling data to 'wgs84_fit'
[2020-06-10 18:45:39,379] : PID  10005 : DEBUG    : satpy.scene : __init__ : Setting 'PPP_CONFIG_DIR' to '/home/ucfaurr/DATA/geo2grid_v_1_0_1/etc/satpy'
[2020-06-10 18:45:39,384] : PID  10005 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='C01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=())
[2020-06-10 18:46:28,470] : PID  10005 : DEBUG    : numpy : write : Warning: invalid value encountered in subtract

[2020-06-10 18:46:28,522] : PID  10005 : DEBUG    : satpy.resample : _check_numpy_cache : Check if ./resample_lut-5346f76c1eec7033f4279b68f4bdd639a591607e.npz exists
[2020-06-10 18:46:28,523] : PID  10005 : DEBUG    : satpy.resample : precompute : Computing kd-tree parameters
[2020-06-10 18:46:28,749] : PID  10005 : DEBUG    : satpy.resample : compute : Resampling None
[2020-06-10 18:46:28,792] : PID  10005 : DEBUG    : satpy.writers : read_writer_config : Reading ['/data/store05/students/masters/2019/data/ucfaurr/geo2grid_v_1_0_1/lib/python3.7/site-packages/satpy/etc/writers/geotiff.yaml']
[2020-06-10 18:46:29,005] : PID  10005 : DEBUG    : satpy.writers : apply : Enhancement configuration options: [{'name': 'linear_stretch', 'method': <function stretch at 0x7fde4b6ec200>, 'kwargs': {'stretch': 'crude', 'min_stretch': 0.0, 'max_stretch': 100.0}}, {'name': 'gamma', 'method': <function gamma at 0x7fde4b6a8d40>, 'kwargs': {'gamma': 2.0}}]
[2020-06-10 18:46:29,005] : PID  10005 : DEBUG    : trollimage.xrimage : stretch : Applying stretch crude with parameters {'min_stretch': 0.0, 'max_stretch': 100.0}
[2020-06-10 18:46:29,007] : PID  10005 : DEBUG    : trollimage.xrimage : gamma : Applying gamma 2.0
[2020-06-10 18:46:29,097] : PID  10005 : INFO     : abi_l1b_geotiff : main : Computing products and saving data to writers...
[2020-06-10 18:51:22,291] : PID  10005 : ERROR    : abi_l1b_geotiff : exc_handler : Unexpected error. Enable debug messages (-vvv) or see log file for details.
[2020-06-10 18:51:22,293] : PID  10005 : DEBUG    : abi_l1b_geotiff : exc_handler : Unexpected error exception: 
Traceback (most recent call last):
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/polar2grid/glue.py", line 436, in <module>
    sys.exit(main())
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/polar2grid/glue.py", line 430, in main
    compute_writer_results(to_save)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/satpy/writers/__init__.py", line 553, in compute_writer_results
    da.compute(delayeds)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/base.py", line 436, in compute
    results = schedule(dsk, keys, **kwargs)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/threaded.py", line 81, in get
    **kwargs
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/local.py", line 486, in get_async
    raise_exception(exc, tb)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/local.py", line 316, in reraise
    raise exc
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/local.py", line 222, in execute_task
    result = _execute_task(task, data)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 119, in _execute_task
    return func(*args2)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/optimization.py", line 982, in __call__
    return core.get(self.dsk, self.outkey, dict(zip(self.inkeys, args)))
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 149, in get
    result = _execute_task(task, cache)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 118, in _execute_task
    args2 = [_execute_task(a, cache) for a in args]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 118, in <listcomp>
    args2 = [_execute_task(a, cache) for a in args]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 118, in _execute_task
    args2 = [_execute_task(a, cache) for a in args]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 118, in <listcomp>
    args2 = [_execute_task(a, cache) for a in args]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 115, in _execute_task
    return [_execute_task(a, cache) for a in arg]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 115, in <listcomp>
    return [_execute_task(a, cache) for a in arg]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 115, in _execute_task
    return [_execute_task(a, cache) for a in arg]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 115, in <listcomp>
    return [_execute_task(a, cache) for a in arg]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 122, in _execute_task
    elif arg in cache:
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/pyproj/crs/crs.py", line 869, in __hash__
    return hash(self.to_wkt())
  File "pyproj/_crs.pyx", line 451, in pyproj._crs.Base.to_wkt
  File "pyproj/_crs.pyx", line 120, in pyproj._crs._to_wkt
  File "pyproj/_crs.pyx", line 24, in pyproj._crs.cstrdecode
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/pyproj/compat.py", line 21, in pystrdecode
    return cstr.decode("utf-8")
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb9 in position 2: invalid start byte
[2020-06-10 18:51:22,312] : PID  10005 : ERROR    : traceback : exc_handler : 'utf-8' codec can't decode byte 0xb9 in position 2: invalid start byte
Traceback (most recent call last):
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/polar2grid/glue.py", line 436, in <module>
    sys.exit(main())
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/polar2grid/glue.py", line 430, in main
    compute_writer_results(to_save)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/satpy/writers/__init__.py", line 553, in compute_writer_results
    da.compute(delayeds)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/base.py", line 436, in compute
    results = schedule(dsk, keys, **kwargs)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/threaded.py", line 81, in get
    **kwargs
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/local.py", line 486, in get_async
    raise_exception(exc, tb)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/local.py", line 316, in reraise
    raise exc
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/local.py", line 222, in execute_task
    result = _execute_task(task, data)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 119, in _execute_task
    return func(*args2)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/optimization.py", line 982, in __call__
    return core.get(self.dsk, self.outkey, dict(zip(self.inkeys, args)))
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 149, in get
    result = _execute_task(task, cache)
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 118, in _execute_task
    args2 = [_execute_task(a, cache) for a in args]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 118, in <listcomp>
    args2 = [_execute_task(a, cache) for a in args]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 118, in _execute_task
    args2 = [_execute_task(a, cache) for a in args]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 118, in <listcomp>
    args2 = [_execute_task(a, cache) for a in args]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 115, in _execute_task
    return [_execute_task(a, cache) for a in arg]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 115, in <listcomp>
    return [_execute_task(a, cache) for a in arg]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 115, in _execute_task
    return [_execute_task(a, cache) for a in arg]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 115, in <listcomp>
    return [_execute_task(a, cache) for a in arg]
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/dask/core.py", line 122, in _execute_task
    elif arg in cache:
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/pyproj/crs/crs.py", line 869, in __hash__
    return hash(self.to_wkt())
  File "pyproj/_crs.pyx", line 451, in pyproj._crs.Base.to_wkt
  File "pyproj/_crs.pyx", line 120, in pyproj._crs._to_wkt
  File "pyproj/_crs.pyx", line 24, in pyproj._crs.cstrdecode
  File "/home/ucfaurr/DATA/geo2grid_v_1_0_1/lib/python3.7/site-packages/pyproj/compat.py", line 21, in pystrdecode
    return cstr.decode("utf-8")
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xb9 in position 2: invalid start byte
And a TIF file that had large squares missing from it.

Is there a better way of doing this? Many thanks.
davidh
Posts: 116
Joined: Tue Jun 04, 2013 11:19 am

Re: Simply reprojecting GOES-17 Data

Post by davidh »

Hi,

This is actually a bug in Geo2Grid. It is very rare and we had a lot of trouble tracking it down, so congratulations?

The good news is it should be fixed in a patch release of Geo2Grid that we haven't released yet (due to so few users running into this issue). If you could try downloading this geo2grid tarball (1.0.2) and using it instead of the one you downloaded from the CSPP website (1.0.1), you should have better luck:

ftp://ftp.ssec.wisc.edu/pub/davidh/geo2 ... 2b0.tar.gz

Let us know how it goes.

Dave
pjordan
Posts: 3
Joined: Mon Jun 08, 2020 11:38 am

Re: Simply reprojecting GOES-17 Data

Post by pjordan »

Hi Dave,

Sorry for the delay, I missed your reply. Interesting that it's a rare bug; thanks for the new tarball, I'll have a look at it soon.

Also, I don't suppose there's any way for this geo2grid work on Level 2 data?
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: Simply reprojecting GOES-17 Data

Post by kathys »

Geo2Grid does not currently support Level 2 products. We plan to add support for some products in future releases.

Kathy
Post Reply