SDR 3.0 processing problems

VIIRS Sensor Data Record
Post Reply
knuth
Posts: 9
Joined: Mon Jun 28, 2010 1:46 am

SDR 3.0 processing problems

Post by knuth »

Hi again.
Thank you for an interesting forum. :)

Installed SDR 3.0 SW for testing and preparation for JPSS. However, I encountered some problems:
After installation, everything went ok, until passing midnight (UT). After that time I am not able to produce results.

Tried to reinstall the whole SDR package, same result: failure after midnight.

I wonder if there is some database issue here.
The SDR SW is running under SLES 12.1 (SUSE Linux Enterprise Server 12 SP1).

In attachment log1.txt there is a reference to the second attachment (ProSdrViirsGeoController.exe_host_17196.log).

A reference to *Planet-Eph-ANC* is found in the second attachment and the file is found here:
/XXX/SDR_3_0/anc/cache/package/DmSm/ANC/26_19/59cab084-7c95b-6880cc6c-595a55fb.off_Planet-Eph-ANC_Static_JPL_000f_20000101_200001010000Z_20000101000000Z_ee00000000000000Z_np.dat

Hopefully there is a simple solution which I can't see at the moment.

PS. The same problems yields for CRIS and ATMS processing as well.

Best Regards Knut
Attachments

[The extension txt has been deactivated and can no longer be displayed.]

[The extension log has been deactivated and can no longer be displayed.]

kathys
Posts: 484
Joined: Tue Jun 22, 2010 4:51 pm

Re: SDR 3.0 processing problems

Post by kathys »

Hello Knut,

Sorry you are having problems, and thank you for providing us with the log files.

We want to make sure that we understand your problem. The example log files that you provided are from a March 2017 data set. Have you also seen this problem when running direct broadcast real-time data? The CSPP Version 3.0 SDR software is meant to support data sets starting from July 14, 2017. Do you have an example for us where the processing fails on a more recent overpass?

Thank you,

Kathy
knuth
Posts: 9
Joined: Mon Jun 28, 2010 1:46 am

Re: SDR 3.0 processing problems

Post by knuth »

Hello again.

The input file /products/NPP/rdr/RNSCA-RVIRS_npp_d20171120_t1001339_e1014220_b00001_c20171120102024721000_all-_dev.h5
is the most recent I have (from november 20 2017).
It is also to be mentioned that we use rt-rtstps v5.9 in advance.
There is no problem running a previous version e.g. SDR v2.2.

Best Regards
Knut
kathys
Posts: 484
Joined: Tue Jun 22, 2010 4:51 pm

Re: SDR 3.0 processing problems

Post by kathys »

Okay, thanks for the information. Can you please post your RDR for us? Feel free to use our anonymous ftp site at: ftp://ftp.ssec.wisc.edu/pub/incoming/

- Did you try running the software on the test data set? If not, can you please try that?
- I know you have already re-installed the software once, but can we please ask you to try this test for us? Please re-install one more time, and then execute the following commands:

sdr_ancillary.sh -t 2017324
sdr_ancillary.sh -t 2017323

sdr_luts.sh

and then try processing your 20171120 RDR again, using the -l flag which will execute without downloading any external files.

We believe that the problem is the choice of TLEs that the SDR software is making on your machine. This test will help us to narrow down the problem.

Sorry again, Kathy
knuth
Posts: 9
Joined: Mon Jun 28, 2010 1:46 am

Re: SDR 3.0 processing problems

Post by knuth »

Hello Kathy

You will find the RDR file 'RNSCA-RVIRS_npp_d20171120_t1001339_e1014220_b00001_c20171120102024721000_all-_dev.h5' at your ftp server.

After re installation of the SDR SW and following your instructions, it went ok.
Please take a look in the attached log2.txt

All three passes today, after re installation at 09:30 UTC and up to 13:30 UTC went ok.

The sdr_ancillary and sdr_luts scripts are now running from a cronjob.

Hopefully the processing will be ok also after midnight.

Best Regards
Knut
Attachments

[The extension txt has been deactivated and can no longer be displayed.]

knuth
Posts: 9
Joined: Mon Jun 28, 2010 1:46 am

Re: SDR 3.0 processing problems

Post by knuth »

Kathy

Unfortunately, the processing failed again.

In the work directory, the TLE*.msd files are empty. I believe they should be like ordinary TLE's.

Best Regards
Knut
kathys
Posts: 484
Joined: Tue Jun 22, 2010 4:51 pm

Re: SDR 3.0 processing problems

Post by kathys »

Hello Knut,

Sorry we have not responded yet to your post. We are working on a resolution to your problem.

Kathy
scottm

Re: SDR 3.0 processing problems

Post by scottm »

Hello,

Sorry I was on break. Are you still having issues? you may e-mail me directly scott.mindock@ssec.wisc.edu and I will help you out.
knuth
Posts: 9
Joined: Mon Jun 28, 2010 1:46 am

Re: SDR 3.0 processing problems

Post by knuth »

I have just installed the SDR 3.0.3 patch.
During the next days, I will monitor the data processing.

Merry Christmas to all of you
Knut
Post Reply