Geo2Grid v 1.0.1 Sunz and Rayleigh Correction

Post Reply
torresrodyvito
Posts: 25
Joined: Wed Apr 03, 2019 10:21 pm

Geo2Grid v 1.0.1 Sunz and Rayleigh Correction

Post by torresrodyvito »

Good Day, once again I would like to ask questions regarding the correction of ahi bands using Geo2Grid.
Specifically, are there any big changes regarding this from the previous version (v. 1.0.0)? Because when I tried to process some bands, the resulting processed tiff images have zero values for water pixels.

Here is the log file:

Code: Select all

[2020-06-04 23:50:19,175] : PID    102 : DEBUG    : ahi_hsd_geotiff : main : Starting script with arguments: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/lib/python3.7/site-packages/polar2grid/glue.py -r ahi_hsd -w geotiff -p B01C B02C B03C B04C B05C B06C -f count2bb --progress -vv
[2020-06-04 23:50:19,186] : PID    102 : INFO     : ahi_hsd_geotiff : main : Sorting and reading input files...
[2020-06-04 23:50:19,187] : PID    102 : DEBUG    : satpy.scene : __init__ : Setting 'PPP_CONFIG_DIR' to '/mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/etc/satpy'
[2020-06-04 23:50:19,189] : PID    102 : DEBUG    : satpy.readers : read_reader_config : Reading ['/mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/lib/python3.7/site-packages/satpy/etc/readers/ahi_hsd.yaml']
[2020-06-04 23:50:19,385] : PID    102 : DEBUG    : satpy.readers.yaml_reader : create_filehandlers : Assigning to ahi_hsd: ['count2bb/HS_H08_20190301_0100_B01_FLDK_R10_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B02_FLDK_R10_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B03_FLDK_R05_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B04_FLDK_R10_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B05_FLDK_R20_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B06_FLDK_R20_S0410.DAT']
[2020-06-04 23:50:19,416] : PID    102 : DEBUG    : satpy.composites : load_sensor_composites : Looking for composites config file ahi.yaml
[2020-06-04 23:50:19,485] : PID    102 : DEBUG    : satpy.composites : load_sensor_composites : Looking for composites config file visir.yaml
[2020-06-04 23:50:19,555] : PID    102 : DEBUG    : polar2grid.core.script_utils : rename_log_file : Log renamed from '/ahi_hsd_geotiff_fail.log' to 'ahi_hsd_geotiff_20190301_010237.log'
[2020-06-04 23:50:19,555] : PID    102 : INFO     : ahi_hsd_geotiff : main : Loading product metadata from files...
[2020-06-04 23:50:19,565] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-04 23:50:19,577] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-04 23:50:19,585] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-04 23:50:19,588] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_azimuth_angle: Unknown dataset satellite_azimuth_angle
[2020-06-04 23:50:19,591] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_zenith_angle: Unknown dataset satellite_zenith_angle
[2020-06-04 23:50:19,594] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_azimuth_angle: Unknown dataset solar_azimuth_angle
[2020-06-04 23:50:19,598] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-04 23:50:19,615] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-04 23:50:19,629] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-04 23:50:19,636] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_azimuth_angle: Unknown dataset satellite_azimuth_angle
[2020-06-04 23:50:19,642] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_zenith_angle: Unknown dataset satellite_zenith_angle
[2020-06-04 23:50:19,648] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_azimuth_angle: Unknown dataset solar_azimuth_angle
[2020-06-04 23:50:19,654] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-04 23:50:19,669] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-04 23:50:19,684] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_azimuth_angle: Unknown dataset satellite_azimuth_angle
[2020-06-04 23:50:19,687] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_zenith_angle: Unknown dataset satellite_zenith_angle
[2020-06-04 23:50:19,691] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_azimuth_angle: Unknown dataset solar_azimuth_angle
[2020-06-04 23:50:19,694] : PID    102 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-04 23:50:19,705] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 5
[2020-06-04 23:50:19,711] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 6
[2020-06-04 23:50:19,719] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 7
[2020-06-04 23:50:19,727] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 8
[2020-06-04 23:50:19,736] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 9
[2020-06-04 23:50:19,744] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 10
[2020-06-04 23:50:19,760] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 3 to full disk.
[2020-06-04 23:50:19,766] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 2 to full disk.
[2020-06-04 23:50:19,772] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 1 to full disk.
[2020-06-04 23:50:19,855] : PID    102 : DEBUG    : ahi_hsd : _read_header : Band number = 5
[2020-06-04 23:50:19,855] : PID    102 : DEBUG    : ahi_hsd : _read_header : Time_interval: 2019-03-01 01:02:38.435552 - 2019-03-01 01:04:04.705948
[2020-06-04 23:50:19,866] : PID    102 : DEBUG    : ahi_hsd : read_band : Reading time 0:00:00.011882
[2020-06-04 23:50:19,874] : PID    102 : DEBUG    : ahi_hsd : calibrate : Calibration time 0:00:00.008149
[2020-06-04 23:50:19,957] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 5
[2020-06-04 23:50:19,964] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 6
[2020-06-04 23:50:19,972] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 7
[2020-06-04 23:50:19,979] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 8
[2020-06-04 23:50:19,989] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 9
[2020-06-04 23:50:19,999] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 10
[2020-06-04 23:50:20,013] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 3 to full disk.
[2020-06-04 23:50:20,019] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 2 to full disk.
[2020-06-04 23:50:20,024] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 1 to full disk.
[2020-06-04 23:50:20,101] : PID    102 : DEBUG    : ahi_hsd : _read_header : Band number = 1
[2020-06-04 23:50:20,101] : PID    102 : DEBUG    : ahi_hsd : _read_header : Time_interval: 2019-03-01 01:02:37.913267 - 2019-03-01 01:04:04.183659
[2020-06-04 23:50:20,109] : PID    102 : DEBUG    : ahi_hsd : read_band : Reading time 0:00:00.008800
[2020-06-04 23:50:20,121] : PID    102 : DEBUG    : ahi_hsd : calibrate : Calibration time 0:00:00.011158
[2020-06-04 23:50:20,196] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 5
[2020-06-04 23:50:20,202] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 6
[2020-06-04 23:50:20,209] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 7
[2020-06-04 23:50:20,216] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 8
[2020-06-04 23:50:20,223] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 9
[2020-06-04 23:50:20,232] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 10
[2020-06-04 23:50:20,245] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 3 to full disk.
[2020-06-04 23:50:20,250] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 2 to full disk.
[2020-06-04 23:50:20,257] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 1 to full disk.
[2020-06-04 23:50:20,336] : PID    102 : DEBUG    : ahi_hsd : _read_header : Band number = 3
[2020-06-04 23:50:20,336] : PID    102 : DEBUG    : ahi_hsd : _read_header : Time_interval: 2019-03-01 01:02:37.652123 - 2019-03-01 01:04:03.922518
[2020-06-04 23:50:20,346] : PID    102 : DEBUG    : ahi_hsd : read_band : Reading time 0:00:00.010689
[2020-06-04 23:50:20,352] : PID    102 : DEBUG    : ahi_hsd : calibrate : Calibration time 0:00:00.005935
[2020-06-04 23:50:20,417] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 5
[2020-06-04 23:50:20,424] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 6
[2020-06-04 23:50:20,431] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 7
[2020-06-04 23:50:20,439] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 8
[2020-06-04 23:50:20,446] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 9
[2020-06-04 23:50:20,454] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 10
[2020-06-04 23:50:20,468] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 3 to full disk.
[2020-06-04 23:50:20,474] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 2 to full disk.
[2020-06-04 23:50:20,480] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 1 to full disk.
[2020-06-04 23:50:20,561] : PID    102 : DEBUG    : ahi_hsd : _read_header : Band number = 4
[2020-06-04 23:50:20,562] : PID    102 : DEBUG    : ahi_hsd : _read_header : Time_interval: 2019-03-01 01:02:37.313895 - 2019-03-01 01:04:03.584287
[2020-06-04 23:50:20,568] : PID    102 : DEBUG    : ahi_hsd : read_band : Reading time 0:00:00.007592
[2020-06-04 23:50:20,574] : PID    102 : DEBUG    : ahi_hsd : calibrate : Calibration time 0:00:00.005963
[2020-06-04 23:50:20,638] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 5
[2020-06-04 23:50:20,647] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 6
[2020-06-04 23:50:20,655] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 7
[2020-06-04 23:50:20,663] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 8
[2020-06-04 23:50:20,672] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 9
[2020-06-04 23:50:20,679] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 10
[2020-06-04 23:50:20,694] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 3 to full disk.
[2020-06-04 23:50:20,700] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 2 to full disk.
[2020-06-04 23:50:20,707] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 1 to full disk.
[2020-06-04 23:50:20,783] : PID    102 : DEBUG    : ahi_hsd : _read_header : Band number = 6
[2020-06-04 23:50:20,784] : PID    102 : DEBUG    : ahi_hsd : _read_header : Time_interval: 2019-03-01 01:02:37.003725 - 2019-03-01 01:04:03.274116
[2020-06-04 23:50:20,792] : PID    102 : DEBUG    : ahi_hsd : read_band : Reading time 0:00:00.009515
[2020-06-04 23:50:20,801] : PID    102 : DEBUG    : ahi_hsd : calibrate : Calibration time 0:00:00.008696
[2020-06-04 23:50:20,875] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 5
[2020-06-04 23:50:20,883] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 6
[2020-06-04 23:50:20,890] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 7
[2020-06-04 23:50:20,898] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 8
[2020-06-04 23:50:20,906] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 9
[2020-06-04 23:50:20,914] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 10
[2020-06-04 23:50:20,930] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 3 to full disk.
[2020-06-04 23:50:20,938] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 2 to full disk.
[2020-06-04 23:50:20,944] : PID    102 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 1 to full disk.
[2020-06-04 23:50:21,028] : PID    102 : DEBUG    : ahi_hsd : _read_header : Band number = 2
[2020-06-04 23:50:21,029] : PID    102 : DEBUG    : ahi_hsd : _read_header : Time_interval: 2019-03-01 01:02:38.162392 - 2019-03-01 01:04:04.432784
[2020-06-04 23:50:21,038] : PID    102 : DEBUG    : ahi_hsd : read_band : Reading time 0:00:00.010286
[2020-06-04 23:50:21,048] : PID    102 : DEBUG    : ahi_hsd : calibrate : Calibration time 0:00:00.009765
[2020-06-04 23:50:21,116] : PID    102 : DEBUG    : satpy.composites : __call__ : Applying sun zen correction
[2020-06-04 23:50:21,116] : PID    102 : DEBUG    : satpy.composites : __call__ : Computing sun zenith angles.
[2020-06-04 23:50:21,179] : PID    102 : DEBUG    : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)]
[2020-06-04 23:50:21,210] : PID    102 : DEBUG    : satpy.composites : __call__ : Sun-zenith correction applied. Computation time:   0.1 (sec)
[2020-06-04 23:50:21,215] : PID    102 : DEBUG    : satpy.composites : __call__ : Applying sun zen correction
[2020-06-04 23:50:21,215] : PID    102 : DEBUG    : satpy.composites : __call__ : Computing sun zenith angles.
[2020-06-04 23:50:21,271] : PID    102 : DEBUG    : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)]
[2020-06-04 23:50:21,295] : PID    102 : DEBUG    : satpy.composites : __call__ : Sun-zenith correction applied. Computation time:   0.1 (sec)
[2020-06-04 23:50:21,300] : PID    102 : DEBUG    : satpy.composites : __call__ : Applying sun zen correction
[2020-06-04 23:50:21,300] : PID    102 : DEBUG    : satpy.composites : __call__ : Computing sun zenith angles.
[2020-06-04 23:50:21,411] : PID    102 : DEBUG    : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)]
[2020-06-04 23:50:21,434] : PID    102 : DEBUG    : satpy.composites : __call__ : Sun-zenith correction applied. Computation time:   0.1 (sec)
[2020-06-04 23:50:21,960] : PID    102 : INFO     : satpy.composites : __call__ : Removing Rayleigh scattering with atmosphere 'us-standard' and aerosol type 'marine_clean_aerosol' for 'B03'
[2020-06-04 23:50:21,963] : PID    102 : INFO     : pyspectral.rayleigh : __init__ : Atmosphere chosen: us-standard
[2020-06-04 23:50:21,966] : PID    102 : DEBUG    : pyspectral.rayleigh : __init__ : LUT filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/marine_clean_aerosol/rayleigh_lut_us-standard.h5
[2020-06-04 23:50:21,968] : PID    102 : DEBUG    : pyspectral.rsr_reader : _get_filename : Filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/rsr_ahi_Himawari-8.h5
[2020-06-04 23:50:21,969] : PID    102 : DEBUG    : pyspectral.rsr_reader : __init__ : Filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/rsr_ahi_Himawari-8.h5
[2020-06-04 23:50:21,984] : PID    102 : DEBUG    : pyspectral.rsr_reader : load : No detectors found - assume only one...
[2020-06-04 23:50:22,019] : PID    102 : DEBUG    : pyspectral.rayleigh : get_effective_wavelength : Band name: ch3  Effective wavelength: 0.635378
[2020-06-04 23:50:22,138] : PID    102 : DEBUG    : pyspectral.rayleigh : get_reflectance : Time - Interpolation: 0.090619
[2020-06-04 23:50:22,151] : PID    102 : DEBUG    : satpy.composites : __call__ : Applying sun zen correction
[2020-06-04 23:50:22,151] : PID    102 : DEBUG    : satpy.composites : __call__ : Computing sun zenith angles.
[2020-06-04 23:50:22,216] : PID    102 : DEBUG    : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)]
[2020-06-04 23:50:22,247] : PID    102 : DEBUG    : satpy.composites : __call__ : Sun-zenith correction applied. Computation time:   0.1 (sec)
[2020-06-04 23:50:22,249] : PID    102 : DEBUG    : satpy.scene : _generate_composite : Delaying generation of DatasetID(name='B02', wavelength=(0.49, 0.51, 0.53), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected')) because of incompatible areas
[2020-06-04 23:50:22,250] : PID    102 : DEBUG    : satpy.scene : _get_prereq_datasets : Delaying generation of DatasetID(name='B02C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None) because of dependency's delayed generation: DatasetID(name='B02', wavelength=(0.49, 0.51, 0.53), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))
[2020-06-04 23:50:22,250] : PID    102 : DEBUG    : satpy.scene : _get_prereq_datasets : Delayed prerequisite for 'DatasetID(name='B02C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)': 'DatasetID(name='B02', wavelength=(0.49, 0.51, 0.53), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))'
[2020-06-04 23:50:22,257] : PID    102 : DEBUG    : satpy.composites : __call__ : Applying sun zen correction
[2020-06-04 23:50:22,257] : PID    102 : DEBUG    : satpy.composites : __call__ : Computing sun zenith angles.
[2020-06-04 23:50:22,326] : PID    102 : DEBUG    : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)]
[2020-06-04 23:50:22,349] : PID    102 : DEBUG    : satpy.composites : __call__ : Sun-zenith correction applied. Computation time:   0.1 (sec)
[2020-06-04 23:50:22,351] : PID    102 : DEBUG    : satpy.scene : _generate_composite : Delaying generation of DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected')) because of incompatible areas
[2020-06-04 23:50:22,352] : PID    102 : DEBUG    : satpy.scene : _get_prereq_datasets : Delaying generation of DatasetID(name='B01C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None) because of dependency's delayed generation: DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))
[2020-06-04 23:50:22,352] : PID    102 : DEBUG    : satpy.scene : _get_prereq_datasets : Delayed prerequisite for 'DatasetID(name='B01C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)': 'DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))'
[2020-06-04 23:50:22,354] : PID    102 : DEBUG    : satpy.scene : _generate_composite : Delaying generation of DatasetID(name='B02', wavelength=(0.49, 0.51, 0.53), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected')) because of incompatible areas
[2020-06-04 23:50:22,357] : PID    102 : DEBUG    : satpy.scene : _generate_composite : Delaying generation of DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected')) because of incompatible areas
[2020-06-04 23:50:22,360] : PID    102 : DEBUG    : satpy.composites : __call__ : Applying sun zen correction
[2020-06-04 23:50:22,360] : PID    102 : DEBUG    : satpy.composites : __call__ : Computing sun zenith angles.
[2020-06-04 23:50:22,418] : PID    102 : DEBUG    : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)]
[2020-06-04 23:50:22,442] : PID    102 : DEBUG    : satpy.composites : __call__ : Sun-zenith correction applied. Computation time:   0.1 (sec)
[2020-06-04 23:50:22,455] : PID    102 : WARNING  : satpy.scene : load : The following datasets were not created and may require resampling to be generated: DatasetID(name='B01C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None), DatasetID(name='B02C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)
[2020-06-04 23:50:22,455] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B05', wavelength=(1.5, 1.6, 1.7), resolution=2000, polarization=None, calibration='reflectance', level=None, modifiers=())
[2020-06-04 23:50:22,456] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=())
[2020-06-04 23:50:22,457] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B03', wavelength=(0.62, 0.64, 0.66), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=())
[2020-06-04 23:50:22,457] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B04', wavelength=(0.83, 0.85, 0.87), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=())
[2020-06-04 23:50:22,457] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B06', wavelength=(2.2, 2.3, 2.4), resolution=2000, polarization=None, calibration='reflectance', level=None, modifiers=())
[2020-06-04 23:50:22,457] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B02', wavelength=(0.49, 0.51, 0.53), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=())
[2020-06-04 23:50:22,458] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B05', wavelength=(1.5, 1.6, 1.7), resolution=2000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-04 23:50:22,458] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B04', wavelength=(0.83, 0.85, 0.87), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-04 23:50:22,458] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B03', wavelength=(0.62, 0.64, 0.66), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))
[2020-06-04 23:50:22,458] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B06', wavelength=(2.2, 2.3, 2.4), resolution=2000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-04 23:50:22,471] : PID    102 : DEBUG    : polar2grid.grids.manager : __init__ : Using default grid configuration: 'grids.conf' 
[2020-06-04 23:50:22,471] : PID    102 : DEBUG    : polar2grid.grids.manager : __init__ : Loading grid configuration 'grids.conf'
[2020-06-04 23:50:22,815] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid 'dwd_germany' origin from (lon: -2.000000, lat: 56.000000) to (x: -755570.370463, y: -3554679.114710)
[2020-06-04 23:50:22,823] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid 'australia' origin from (lon: 105.000000, lat: 5.000000) to (x: -3896182.177765, y: 557305.257275)
[2020-06-04 23:50:22,831] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid 'australia2' origin from (lon: 105.000000, lat: 5.000000) to (x: -3896182.177765, y: 557305.257275)
[2020-06-04 23:50:22,839] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211e' origin from (lon: -123.044000, lat: 59.844000) to (x: -1950510.636800, y: 4368587.226913)
[2020-06-04 23:50:22,847] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211e_10km' origin from (lon: -123.044000, lat: 59.844000) to (x: -1950510.636800, y: 4368587.226913)
[2020-06-04 23:50:22,855] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211e_hi' origin from (lon: -123.044000, lat: 59.844000) to (x: -1950510.636800, y: 4368587.226913)
[2020-06-04 23:50:22,863] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211w' origin from (lon: -152.855000, lat: 54.536000) to (x: -4226045.730436, y: 4368634.765713)
[2020-06-04 23:50:22,873] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211w_10km' origin from (lon: -152.855000, lat: 54.536000) to (x: -4226045.730436, y: 4368634.765713)
[2020-06-04 23:50:22,881] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '203' origin from (lon: 115.601000, lat: 44.646000) to (x: -4952960.856044, y: 381022.610378)
[2020-06-04 23:50:22,890] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '203_10km' origin from (lon: 115.601000, lat: 44.646000) to (x: -4952960.856044, y: 381022.610378)
[2020-06-04 23:50:22,901] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '204' origin from (lon: 110.000000, lat: 60.644000) to (x: -7314463.252793, y: 8020503.279488)
[2020-06-04 23:50:22,909] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '204_10km' origin from (lon: 110.000000, lat: 60.644000) to (x: -7314463.252793, y: 8020503.279488)
[2020-06-04 23:50:22,917] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '205' origin from (lon: -115.304000, lat: 36.257000) to (x: -4952924.911284, y: -3429056.260492)
[2020-06-04 23:50:22,926] : PID    102 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '210' origin from (lon: -77.000000, lat: 26.422000) to (x: 0.000000, y: 2864298.891608)
[2020-06-04 23:50:22,928] : PID    102 : DEBUG    : satpy.writers : read_writer_config : Reading ['/mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/lib/python3.7/site-packages/satpy/etc/writers/geotiff.yaml']
[2020-06-04 23:50:23,339] : PID    102 : DEBUG    : satpy.writers : apply : Enhancement configuration options: [{'name': 'stretch', 'method': <function stretch at 0x7fd692f7cb00>, 'kwargs': {'stretch': 'linear'}}]
[2020-06-04 23:50:23,340] : PID    102 : DEBUG    : trollimage.xrimage : stretch : Applying stretch linear with parameters {}
[2020-06-04 23:50:23,340] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Perform a linear contrast stretch.
[2020-06-04 23:50:23,340] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Calculate the histogram quantiles: 
[2020-06-04 23:50:23,340] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Left and right quantiles: 0.005 0.005
[2020-06-04 23:50:23,549] : PID    102 : DEBUG    : satpy.writers : apply : Enhancement configuration options: [{'name': 'stretch', 'method': <function stretch at 0x7fd692f7cb00>, 'kwargs': {'stretch': 'linear'}}]
[2020-06-04 23:50:23,549] : PID    102 : DEBUG    : trollimage.xrimage : stretch : Applying stretch linear with parameters {}
[2020-06-04 23:50:23,549] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Perform a linear contrast stretch.
[2020-06-04 23:50:23,550] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Calculate the histogram quantiles: 
[2020-06-04 23:50:23,550] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Left and right quantiles: 0.005 0.005
[2020-06-04 23:50:23,632] : PID    102 : DEBUG    : satpy.writers : apply : Enhancement configuration options: [{'name': 'stretch', 'method': <function stretch at 0x7fd692f7cb00>, 'kwargs': {'stretch': 'linear'}}]
[2020-06-04 23:50:23,633] : PID    102 : DEBUG    : trollimage.xrimage : stretch : Applying stretch linear with parameters {}
[2020-06-04 23:50:23,633] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Perform a linear contrast stretch.
[2020-06-04 23:50:23,633] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Calculate the histogram quantiles: 
[2020-06-04 23:50:23,633] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Left and right quantiles: 0.005 0.005
[2020-06-04 23:50:23,696] : PID    102 : DEBUG    : satpy.writers : apply : Enhancement configuration options: [{'name': 'stretch', 'method': <function stretch at 0x7fd692f7cb00>, 'kwargs': {'stretch': 'linear'}}]
[2020-06-04 23:50:23,696] : PID    102 : DEBUG    : trollimage.xrimage : stretch : Applying stretch linear with parameters {}
[2020-06-04 23:50:23,697] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Perform a linear contrast stretch.
[2020-06-04 23:50:23,697] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Calculate the histogram quantiles: 
[2020-06-04 23:50:23,697] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Left and right quantiles: 0.005 0.005
[2020-06-04 23:50:23,751] : PID    102 : DEBUG    : ahi_hsd_geotiff : main : Products to preserve resolution for: {DatasetID(name='B05C', wavelength=None, resolution=2000, polarization=None, calibration=None, level=None, modifiers=None), DatasetID(name='B03C', wavelength=None, resolution=500, polarization=None, calibration=None, level=None, modifiers=None), DatasetID(name='B04C', wavelength=None, resolution=1000, polarization=None, calibration=None, level=None, modifiers=None), DatasetID(name='B06C', wavelength=None, resolution=2000, polarization=None, calibration=None, level=None, modifiers=None)}
[2020-06-04 23:50:23,751] : PID    102 : DEBUG    : ahi_hsd_geotiff : main : Products to use new resolution for: {DatasetID(name='B01C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None), DatasetID(name='B02C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)}
[2020-06-04 23:50:23,751] : PID    102 : DEBUG    : ahi_hsd_geotiff : main : Setting default resampling to 'native' for grid 'MAX'
[2020-06-04 23:50:23,752] : PID    102 : INFO     : ahi_hsd_geotiff : main : Resampling data to 'MAX'
[2020-06-04 23:50:23,752] : PID    102 : DEBUG    : satpy.scene : __init__ : Setting 'PPP_CONFIG_DIR' to '/mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/etc/satpy'
[2020-06-04 23:50:23,754] : PID    102 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='B04C', wavelength=None, resolution=1000, polarization=None, calibration=None, level=None, modifiers=None)
[2020-06-04 23:50:23,754] : PID    102 : DEBUG    : pyresample.geometry : get_area_slices : Projections for data and slice areas are identical: +proj=geos +lon_0=140.7 +h=35785863 +x_0=0 +y_0=0 +a=6378137 +b=6356752.3 +units=m +no_defs +type=crs
[2020-06-04 23:50:23,918] : PID    102 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='B03', wavelength=(0.62, 0.64, 0.66), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-04 23:50:23,918] : PID    102 : DEBUG    : pyresample.geometry : get_area_slices : Projections for data and slice areas are identical: +proj=geos +lon_0=140.7 +h=35785863 +x_0=0 +y_0=0 +a=6378137 +b=6356752.3 +units=m +no_defs +type=crs
[2020-06-04 23:50:23,933] : PID    102 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='B02', wavelength=(0.49, 0.51, 0.53), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-04 23:50:24,005] : PID    102 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-04 23:50:24,088] : PID    102 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='B05C', wavelength=None, resolution=2000, polarization=None, calibration=None, level=None, modifiers=None)
[2020-06-04 23:50:24,088] : PID    102 : DEBUG    : pyresample.geometry : get_area_slices : Projections for data and slice areas are identical: +proj=geos +lon_0=140.7 +h=35785863 +x_0=0 +y_0=0 +a=6378137 +b=6356752.3 +units=m +no_defs +type=crs
[2020-06-04 23:50:24,337] : PID    102 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='B06C', wavelength=None, resolution=2000, polarization=None, calibration=None, level=None, modifiers=None)
[2020-06-04 23:50:24,624] : PID    102 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='B03C', wavelength=None, resolution=500, polarization=None, calibration=None, level=None, modifiers=None)
[2020-06-04 23:50:24,807] : PID    102 : INFO     : satpy.composites : __call__ : Removing Rayleigh scattering with atmosphere 'us-standard' and aerosol type 'marine_clean_aerosol' for 'B01'
[2020-06-04 23:50:24,810] : PID    102 : INFO     : pyspectral.rayleigh : __init__ : Atmosphere chosen: us-standard
[2020-06-04 23:50:24,811] : PID    102 : DEBUG    : pyspectral.rayleigh : __init__ : LUT filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/marine_clean_aerosol/rayleigh_lut_us-standard.h5
[2020-06-04 23:50:24,814] : PID    102 : DEBUG    : pyspectral.rsr_reader : _get_filename : Filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/rsr_ahi_Himawari-8.h5
[2020-06-04 23:50:24,815] : PID    102 : DEBUG    : pyspectral.rsr_reader : __init__ : Filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/rsr_ahi_Himawari-8.h5
[2020-06-04 23:50:24,816] : PID    102 : DEBUG    : pyspectral.rsr_reader : load : No detectors found - assume only one...
[2020-06-04 23:50:24,850] : PID    102 : DEBUG    : pyspectral.rayleigh : get_effective_wavelength : Band name: ch1  Effective wavelength: 0.469333
[2020-06-04 23:50:24,953] : PID    102 : DEBUG    : pyspectral.rayleigh : get_reflectance : Time - Interpolation: 0.077244
[2020-06-04 23:50:25,125] : PID    102 : INFO     : satpy.composites : __call__ : Removing Rayleigh scattering with atmosphere 'us-standard' and aerosol type 'marine_clean_aerosol' for 'B02'
[2020-06-04 23:50:25,127] : PID    102 : INFO     : pyspectral.rayleigh : __init__ : Atmosphere chosen: us-standard
[2020-06-04 23:50:25,128] : PID    102 : DEBUG    : pyspectral.rayleigh : __init__ : LUT filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/marine_clean_aerosol/rayleigh_lut_us-standard.h5
[2020-06-04 23:50:25,132] : PID    102 : DEBUG    : pyspectral.rsr_reader : _get_filename : Filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/rsr_ahi_Himawari-8.h5
[2020-06-04 23:50:25,132] : PID    102 : DEBUG    : pyspectral.rsr_reader : __init__ : Filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/rsr_ahi_Himawari-8.h5
[2020-06-04 23:50:25,134] : PID    102 : DEBUG    : pyspectral.rsr_reader : load : No detectors found - assume only one...
[2020-06-04 23:50:25,174] : PID    102 : DEBUG    : pyspectral.rayleigh : get_effective_wavelength : Band name: ch2  Effective wavelength: 0.509195
[2020-06-04 23:50:25,283] : PID    102 : DEBUG    : pyspectral.rayleigh : get_reflectance : Time - Interpolation: 0.079994
[2020-06-04 23:50:25,299] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B03', wavelength=(0.62, 0.64, 0.66), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-04 23:50:25,300] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B02', wavelength=(0.49, 0.51, 0.53), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-04 23:50:25,300] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-04 23:50:25,300] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))
[2020-06-04 23:50:25,300] : PID    102 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B02', wavelength=(0.49, 0.51, 0.53), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))
[2020-06-04 23:50:25,302] : PID    102 : DEBUG    : satpy.writers : read_writer_config : Reading ['/mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/lib/python3.7/site-packages/satpy/etc/writers/geotiff.yaml']
[2020-06-04 23:50:25,658] : PID    102 : DEBUG    : satpy.writers : apply : Enhancement configuration options: [{'name': 'stretch', 'method': <function stretch at 0x7fd692f7cb00>, 'kwargs': {'stretch': 'linear'}}]
[2020-06-04 23:50:25,658] : PID    102 : DEBUG    : trollimage.xrimage : stretch : Applying stretch linear with parameters {}
[2020-06-04 23:50:25,659] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Perform a linear contrast stretch.
[2020-06-04 23:50:25,659] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Calculate the histogram quantiles: 
[2020-06-04 23:50:25,659] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Left and right quantiles: 0.005 0.005
[2020-06-04 23:50:25,733] : PID    102 : DEBUG    : satpy.writers : apply : Enhancement configuration options: [{'name': 'stretch', 'method': <function stretch at 0x7fd692f7cb00>, 'kwargs': {'stretch': 'linear'}}]
[2020-06-04 23:50:25,734] : PID    102 : DEBUG    : trollimage.xrimage : stretch : Applying stretch linear with parameters {}
[2020-06-04 23:50:25,734] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Perform a linear contrast stretch.
[2020-06-04 23:50:25,734] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Calculate the histogram quantiles: 
[2020-06-04 23:50:25,734] : PID    102 : DEBUG    : trollimage.xrimage : stretch_linear : Left and right quantiles: 0.005 0.005
[2020-06-04 23:50:25,816] : PID    102 : INFO     : ahi_hsd_geotiff : main : Computing products and saving data to writers...
[2020-06-05 00:00:09,476] : PID    148 : DEBUG    : ahi_hsd_geotiff : main : Starting script with arguments: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/lib/python3.7/site-packages/polar2grid/glue.py -r ahi_hsd -w geotiff -p B01C -f count2bb --progress -vv
[2020-06-05 00:00:09,487] : PID    148 : INFO     : ahi_hsd_geotiff : main : Sorting and reading input files...
[2020-06-05 00:00:09,487] : PID    148 : DEBUG    : satpy.scene : __init__ : Setting 'PPP_CONFIG_DIR' to '/mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/etc/satpy'
[2020-06-05 00:00:09,491] : PID    148 : DEBUG    : satpy.readers : read_reader_config : Reading ['/mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/lib/python3.7/site-packages/satpy/etc/readers/ahi_hsd.yaml']
[2020-06-05 00:00:09,664] : PID    148 : DEBUG    : satpy.readers.yaml_reader : create_filehandlers : Assigning to ahi_hsd: ['count2bb/HS_H08_20190301_0100_B01_FLDK_R10_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B02_FLDK_R10_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B03_FLDK_R05_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B04_FLDK_R10_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B05_FLDK_R20_S0410.DAT', 'count2bb/HS_H08_20190301_0100_B06_FLDK_R20_S0410.DAT']
[2020-06-05 00:00:09,752] : PID    148 : DEBUG    : satpy.composites : load_sensor_composites : Looking for composites config file ahi.yaml
[2020-06-05 00:00:09,824] : PID    148 : DEBUG    : satpy.composites : load_sensor_composites : Looking for composites config file visir.yaml
[2020-06-05 00:00:09,901] : PID    148 : DEBUG    : polar2grid.core.script_utils : rename_log_file : Log renamed from '/ahi_hsd_geotiff_fail.log' to 'ahi_hsd_geotiff_20190301_010237.log'
[2020-06-05 00:00:09,901] : PID    148 : INFO     : ahi_hsd_geotiff : main : Loading product metadata from files...
[2020-06-05 00:00:09,910] : PID    148 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-05 00:00:09,919] : PID    148 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-05 00:00:09,922] : PID    148 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_azimuth_angle: Unknown dataset satellite_azimuth_angle
[2020-06-05 00:00:09,925] : PID    148 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional satellite_zenith_angle: Unknown dataset satellite_zenith_angle
[2020-06-05 00:00:09,927] : PID    148 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_azimuth_angle: Unknown dataset solar_azimuth_angle
[2020-06-05 00:00:09,930] : PID    148 : DEBUG    : satpy.node : _get_compositor_prereqs : Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle
[2020-06-05 00:00:09,945] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 5
[2020-06-05 00:00:09,952] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 6
[2020-06-05 00:00:09,960] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 7
[2020-06-05 00:00:09,967] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 8
[2020-06-05 00:00:09,974] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 9
[2020-06-05 00:00:09,981] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 10
[2020-06-05 00:00:09,993] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 3 to full disk.
[2020-06-05 00:00:09,999] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 2 to full disk.
[2020-06-05 00:00:10,004] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 1 to full disk.
[2020-06-05 00:00:10,093] : PID    148 : DEBUG    : ahi_hsd : _read_header : Band number = 1
[2020-06-05 00:00:10,094] : PID    148 : DEBUG    : ahi_hsd : _read_header : Time_interval: 2019-03-01 01:02:37.913267 - 2019-03-01 01:04:04.183659
[2020-06-05 00:00:10,114] : PID    148 : DEBUG    : ahi_hsd : read_band : Reading time 0:00:00.021635
[2020-06-05 00:00:10,129] : PID    148 : DEBUG    : ahi_hsd : calibrate : Calibration time 0:00:00.014380
[2020-06-05 00:00:10,280] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 5
[2020-06-05 00:00:10,286] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 6
[2020-06-05 00:00:10,294] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 7
[2020-06-05 00:00:10,303] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 8
[2020-06-05 00:00:10,310] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 9
[2020-06-05 00:00:10,317] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_later_segments_area : Padding to full disk with segment nr. 10
[2020-06-05 00:00:10,330] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 3 to full disk.
[2020-06-05 00:00:10,336] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 2 to full disk.
[2020-06-05 00:00:10,342] : PID    148 : DEBUG    : satpy.readers.yaml_reader : _pad_earlier_segments_area : Padding segment 1 to full disk.
[2020-06-05 00:00:10,418] : PID    148 : DEBUG    : ahi_hsd : _read_header : Band number = 3
[2020-06-05 00:00:10,418] : PID    148 : DEBUG    : ahi_hsd : _read_header : Time_interval: 2019-03-01 01:02:37.652123 - 2019-03-01 01:04:03.922518
[2020-06-05 00:00:10,428] : PID    148 : DEBUG    : ahi_hsd : read_band : Reading time 0:00:00.011333
[2020-06-05 00:00:10,435] : PID    148 : DEBUG    : ahi_hsd : calibrate : Calibration time 0:00:00.006762
[2020-06-05 00:00:10,499] : PID    148 : DEBUG    : satpy.composites : __call__ : Applying sun zen correction
[2020-06-05 00:00:10,499] : PID    148 : DEBUG    : satpy.composites : __call__ : Computing sun zenith angles.
[2020-06-05 00:00:10,596] : PID    148 : DEBUG    : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)]
[2020-06-05 00:00:10,641] : PID    148 : DEBUG    : satpy.composites : __call__ : Sun-zenith correction applied. Computation time:   0.1 (sec)
[2020-06-05 00:00:10,645] : PID    148 : DEBUG    : satpy.composites : __call__ : Applying sun zen correction
[2020-06-05 00:00:10,645] : PID    148 : DEBUG    : satpy.composites : __call__ : Computing sun zenith angles.
[2020-06-05 00:00:10,760] : PID    148 : DEBUG    : satpy.composites : _apply_correction : Apply the standard sun-zenith correction [1/cos(sunz)]
[2020-06-05 00:00:10,781] : PID    148 : DEBUG    : satpy.composites : __call__ : Sun-zenith correction applied. Computation time:   0.1 (sec)
[2020-06-05 00:00:11,407] : PID    148 : DEBUG    : satpy.scene : _generate_composite : Delaying generation of DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected')) because of incompatible areas
[2020-06-05 00:00:11,407] : PID    148 : DEBUG    : satpy.scene : _get_prereq_datasets : Delaying generation of DatasetID(name='B01C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None) because of dependency's delayed generation: DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))
[2020-06-05 00:00:11,408] : PID    148 : DEBUG    : satpy.scene : _get_prereq_datasets : Delayed prerequisite for 'DatasetID(name='B01C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)': 'DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))'
[2020-06-05 00:00:11,408] : PID    148 : WARNING  : satpy.scene : load : The following datasets were not created and may require resampling to be generated: DatasetID(name='B01C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)
[2020-06-05 00:00:11,408] : PID    148 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=())
[2020-06-05 00:00:11,409] : PID    148 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B03', wavelength=(0.62, 0.64, 0.66), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=())
[2020-06-05 00:00:11,427] : PID    148 : DEBUG    : polar2grid.grids.manager : __init__ : Using default grid configuration: 'grids.conf' 
[2020-06-05 00:00:11,427] : PID    148 : DEBUG    : polar2grid.grids.manager : __init__ : Loading grid configuration 'grids.conf'
[2020-06-05 00:00:11,763] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid 'dwd_germany' origin from (lon: -2.000000, lat: 56.000000) to (x: -755570.370463, y: -3554679.114710)
[2020-06-05 00:00:11,771] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid 'australia' origin from (lon: 105.000000, lat: 5.000000) to (x: -3896182.177765, y: 557305.257275)
[2020-06-05 00:00:11,780] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid 'australia2' origin from (lon: 105.000000, lat: 5.000000) to (x: -3896182.177765, y: 557305.257275)
[2020-06-05 00:00:11,790] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211e' origin from (lon: -123.044000, lat: 59.844000) to (x: -1950510.636800, y: 4368587.226913)
[2020-06-05 00:00:11,798] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211e_10km' origin from (lon: -123.044000, lat: 59.844000) to (x: -1950510.636800, y: 4368587.226913)
[2020-06-05 00:00:11,806] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211e_hi' origin from (lon: -123.044000, lat: 59.844000) to (x: -1950510.636800, y: 4368587.226913)
[2020-06-05 00:00:11,815] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211w' origin from (lon: -152.855000, lat: 54.536000) to (x: -4226045.730436, y: 4368634.765713)
[2020-06-05 00:00:11,823] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '211w_10km' origin from (lon: -152.855000, lat: 54.536000) to (x: -4226045.730436, y: 4368634.765713)
[2020-06-05 00:00:11,831] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '203' origin from (lon: 115.601000, lat: 44.646000) to (x: -4952960.856044, y: 381022.610378)
[2020-06-05 00:00:11,839] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '203_10km' origin from (lon: 115.601000, lat: 44.646000) to (x: -4952960.856044, y: 381022.610378)
[2020-06-05 00:00:11,848] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '204' origin from (lon: 110.000000, lat: 60.644000) to (x: -7314463.252793, y: 8020503.279488)
[2020-06-05 00:00:11,856] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '204_10km' origin from (lon: 110.000000, lat: 60.644000) to (x: -7314463.252793, y: 8020503.279488)
[2020-06-05 00:00:11,864] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '205' origin from (lon: -115.304000, lat: 36.257000) to (x: -4952924.911284, y: -3429056.260492)
[2020-06-05 00:00:11,872] : PID    148 : DEBUG    : polar2grid.grids.manager : parse_proj4_config_line : Converted grid '210' origin from (lon: -77.000000, lat: 26.422000) to (x: 0.000000, y: 2864298.891608)
[2020-06-05 00:00:11,873] : PID    148 : DEBUG    : ahi_hsd_geotiff : main : Products to preserve resolution for: set()
[2020-06-05 00:00:11,873] : PID    148 : DEBUG    : ahi_hsd_geotiff : main : Products to use new resolution for: {DatasetID(name='B01C', wavelength=None, resolution=None, polarization=None, calibration=None, level=None, modifiers=None)}
[2020-06-05 00:00:11,873] : PID    148 : DEBUG    : ahi_hsd_geotiff : main : Setting default resampling to 'native' for grid 'MAX'
[2020-06-05 00:00:11,874] : PID    148 : INFO     : ahi_hsd_geotiff : main : Resampling data to 'MAX'
[2020-06-05 00:00:11,874] : PID    148 : DEBUG    : satpy.scene : __init__ : Setting 'PPP_CONFIG_DIR' to '/mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/etc/satpy'
[2020-06-05 00:00:11,875] : PID    148 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-05 00:00:11,878] : PID    148 : DEBUG    : pyresample.geometry : get_area_slices : Projections for data and slice areas are identical: +proj=geos +lon_0=140.7 +h=35785863 +x_0=0 +y_0=0 +a=6378137 +b=6356752.3 +units=m +no_defs +type=crs
[2020-06-05 00:00:11,964] : PID    148 : DEBUG    : satpy.scene : _resampled_scene : Resampling DatasetID(name='B03', wavelength=(0.62, 0.64, 0.66), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-05 00:00:11,964] : PID    148 : DEBUG    : pyresample.geometry : get_area_slices : Projections for data and slice areas are identical: +proj=geos +lon_0=140.7 +h=35785863 +x_0=0 +y_0=0 +a=6378137 +b=6356752.3 +units=m +no_defs +type=crs
[2020-06-05 00:00:12,201] : PID    148 : INFO     : satpy.composites : __call__ : Removing Rayleigh scattering with atmosphere 'us-standard' and aerosol type 'marine_clean_aerosol' for 'B01'
[2020-06-05 00:00:12,205] : PID    148 : INFO     : pyspectral.rayleigh : __init__ : Atmosphere chosen: us-standard
[2020-06-05 00:00:12,210] : PID    148 : DEBUG    : pyspectral.rayleigh : __init__ : LUT filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/marine_clean_aerosol/rayleigh_lut_us-standard.h5
[2020-06-05 00:00:12,215] : PID    148 : DEBUG    : pyspectral.rsr_reader : _get_filename : Filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/rsr_ahi_Himawari-8.h5
[2020-06-05 00:00:12,219] : PID    148 : DEBUG    : pyspectral.rsr_reader : __init__ : Filename: /mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/pyspectral_data/rsr_ahi_Himawari-8.h5
[2020-06-05 00:00:12,279] : PID    148 : DEBUG    : pyspectral.rsr_reader : load : No detectors found - assume only one...
[2020-06-05 00:00:12,340] : PID    148 : DEBUG    : pyspectral.rayleigh : get_effective_wavelength : Band name: ch1  Effective wavelength: 0.469333
[2020-06-05 00:00:12,478] : PID    148 : DEBUG    : pyspectral.rayleigh : get_reflectance : Time - Interpolation: 0.103192
[2020-06-05 00:00:12,492] : PID    148 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-05 00:00:12,492] : PID    148 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B03', wavelength=(0.62, 0.64, 0.66), resolution=500, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected',))
[2020-06-05 00:00:12,492] : PID    148 : DEBUG    : satpy.scene : unload : Unloading dataset: DatasetID(name='B01', wavelength=(0.45, 0.47, 0.49), resolution=1000, polarization=None, calibration='reflectance', level=None, modifiers=('sunz_corrected', 'rayleigh_corrected'))
[2020-06-05 00:00:12,494] : PID    148 : DEBUG    : satpy.writers : read_writer_config : Reading ['/mnt/c/Users/Julian/Desktop/himwget/geo2grid_v_1_0_1/lib/python3.7/site-packages/satpy/etc/writers/geotiff.yaml']
[2020-06-05 00:00:12,906] : PID    148 : DEBUG    : satpy.writers : apply : Enhancement configuration options: [{'name': 'stretch', 'method': <function stretch at 0x7fc5106740e0>, 'kwargs': {'stretch': 'linear'}}]
[2020-06-05 00:00:12,907] : PID    148 : DEBUG    : trollimage.xrimage : stretch : Applying stretch linear with parameters {}
[2020-06-05 00:00:12,907] : PID    148 : DEBUG    : trollimage.xrimage : stretch_linear : Perform a linear contrast stretch.
[2020-06-05 00:00:12,907] : PID    148 : DEBUG    : trollimage.xrimage : stretch_linear : Calculate the histogram quantiles: 
[2020-06-05 00:00:12,907] : PID    148 : DEBUG    : trollimage.xrimage : stretch_linear : Left and right quantiles: 0.005 0.005
[2020-06-05 00:00:13,526] : PID    148 : INFO     : ahi_hsd_geotiff : main : Computing products and saving data to writers...
[2020-06-05 00:09:17,468] : PID    148 : DEBUG    : trollimage.xrimage : _compute_quantile : Interval: left=<xarray.DataArray (bands: 1)>
array([-100.])
Coordinates:
    quantile  float64 0.005
Dimensions without coordinates: bands, right=<xarray.DataArray (bands: 1)>
array([100.75489123])
Coordinates:
    quantile  float64 0.995
Dimensions without coordinates: bands
[2020-06-05 00:09:33,035] : PID    148 : INFO     : ahi_hsd_geotiff : main : SUCCESS
Top
davidh
Posts: 116
Joined: Tue Jun 04, 2013 11:19 am

Re: Geo2Grid v 1.0.1 Sunz and Rayleigh Correction

Post by davidh »

As far as I remember there were no intentional changes to the sunz or rayleigh corrections in Satpy. One thing I'm noticing is the portion of your log that says:
[2020-06-05 00:00:12,906] : PID 148 : DEBUG : satpy.writers : apply : Enhancement configuration options: [{'name': 'stretch', 'method': <function stretch at 0x7fc5106740e0>, 'kwargs': {'stretch': 'linear'}}]
This is usually not what you want as an enhancement for reflectance bands. This is a dynamic linear scaling between the min and max of the data which changes for every image. Since it looks like you've made quite a few customizations to your installation, is it possible you did not copy one or more of your custom YAML files to the new installation directory? Most likely YAML files that are under `enhancements`.
Top
torresrodyvito
Posts: 25
Joined: Wed Apr 03, 2019 10:21 pm

Re: Geo2Grid v 1.0.1 Sunz and Rayleigh Correction

Post by torresrodyvito »

I only change the content of ahi yaml file in the composites folder to this and did not change the others.
I don't think I changed anything about the enhancments. Can I used commands to directly implement the needed stretch to perform?
Thank you in advance.

Code: Select all

sensor_name: visir/ahi

composites:
  true_color_night:
    compositor: !!python/name:satpy.composites.DayNightCompositor
    prerequisites:
      - true_color
      - B14
    standard_name: day_night_mix
  B01C:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
      - name: B01
        modifiers: [sunz_corrected, rayleigh_corrected]
    standard_name: B01C
  B02C:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
      - name: B02
        modifiers: [sunz_corrected, rayleigh_corrected]
    standard_name: B02C
  B03C:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
      - name: B03
        modifiers: [sunz_corrected, rayleigh_corrected]
    standard_name: B03C
  B04C:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
      - name: B04
        modifiers: [sunz_corrected]
    standard_name: B04C
  B05C:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
      - name: B05
        modifiers: [sunz_corrected]
    standard_name: B05C
  B06C:
    compositor: !!python/name:satpy.composites.GenericCompositor
    prerequisites:
      - name: B06
        modifiers: [sunz_corrected]
    standard_name: B06C
Top
torresrodyvito
Posts: 25
Joined: Wed Apr 03, 2019 10:21 pm

Re: Geo2Grid v 1.0.1 Sunz and Rayleigh Correction

Post by torresrodyvito »

Follow up this is what's in the ahi yaml file in enhancement which I did not change.

Code: Select all

enhancements:
  true_color_crefl:
    sensor: ahi
    standard_name: true_color
    operations:
      - name: crefl_scaling
        method: !!python/name:satpy.enhancements.crefl_scaling
        kwargs:
          #       Polar2Grid's scaling: "Preferred".
          idx: [0., 25., 55., 100., 255.]
          sc: [0., 90., 140., 175., 255.]
  #       Ralph Kuehn's new scaling: Looks darker.
  #       idx: [0., 30., 60., 120., 190., 255.]
  #       sc: [0., 100., 128., 188., 223., 255.]
  #       Ralph Kuehn's old scaling: Looks brighter.
  #       idx: [0., 30., 60., 120., 190., 255.]
  #       sc: [0, 110, 160, 210, 240, 255]
  channel_8_default:
    name: B08
    operations:
      - name: linear
        method: !!python/name:satpy.enhancements.stretch
        kwargs: {stretch: 'crude', min_stretch: 280., max_stretch: 180.}
  channel_9_default:
    name: B09
    operations:
      - name: linear
        method: !!python/name:satpy.enhancements.stretch
        kwargs: {stretch: 'crude', min_stretch: 280., max_stretch: 180.}
  channel_10_default:
    name: B10
    operations:
      - name: linear
        method: !!python/name:satpy.enhancements.stretch
        kwargs: {stretch: 'crude', min_stretch: 280., max_stretch: 180.}
Top
davidh
Posts: 116
Joined: Tue Jun 04, 2013 11:19 am

Re: Geo2Grid v 1.0.1 Sunz and Rayleigh Correction

Post by davidh »

In your composites config, you have standard_names like:
standard_name: B01C
Did you change these? I'm guessing these used to be `toa_bidirectional_reflectance`. Most enhancements are configured by standard_name. This way it is easy to say "all reflectances should be enhanced this way, all brightness temperatures should be enhanced this way". If you use a standard_name that isn't configured then G2G (Satpy) will fallback to the default enhancement which is this dynamic linear stretch we see in your log. Try changing your standard names to "toa_bidirectional_reflectance" and see if the results are more what you are looking for.
Top
torresrodyvito
Posts: 25
Joined: Wed Apr 03, 2019 10:21 pm

Re: Geo2Grid v 1.0.1 Sunz and Rayleigh Correction

Post by torresrodyvito »

Yeah, I guess I changed it way back when I used the previous version. I think it works fine now. Last question, if I used the "--dtype float32 --no-enhance", the wrong standard name shouldn't affect the process right?
Top
davidh
Posts: 116
Joined: Tue Jun 04, 2013 11:19 am

Re: Geo2Grid v 1.0.1 Sunz and Rayleigh Correction

Post by davidh »

Last question, if I used the "--dtype float32 --no-enhance", the wrong standard name shouldn't affect the process right?
Correct. It should skip the enhancing/scaling part and store the "raw" (sunz/rayleigh) reflectance values.
Top
Post Reply

Return to “Geo2Grid”