CSSPP-GEO errors

Post Reply
ve2fxl
Posts: 14
Joined: Sun Nov 29, 2020 2:59 pm

CSSPP-GEO errors

Post by ve2fxl »

Hi last week and still underway, I have errors in my G16 images (missing blocks) and they follow a pattern. I receive with CSPPGEO then feed to GEO2GRID. I don't know if it's related to the following GRB issue message sent by NOAA last week:

Update #1: The intermittent degradation (subtle horizontal stripes) of GOES-16 ABI Band-16 products continues. Engineers are aware of the problem and a solution is being discussed. Corrective action may occur as early as Friday the 27th of November.

But I checked on another GRB station that isn't using CSPP-GEO and I don't see any of those errors. I didn't have any GRB CADU error today yet so can't be that and the pattern (missing blocks are nearly always at the same places). Easy to check the errors in CONUS sector.

When it happens, a lot of the following errors are written in grb.log (especially the invalid time portion):

jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (GRBReceiver) Should never happen, invalid time portion of product key:
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (GRBReceiver) Unable to route packet for key APID: 480, last product time seen: 0x480_2020-11-29T19:25:17.355
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (CaduService) Frame Error, VCID: 5, prev VCFC: 7132272, this VCFC: 7135729
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (CaduService) Frame Error, VCID: 6, prev VCFC: 12733312, this VCFC: 12737072
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (GRBReceiver) Should never happen, invalid time portion of product key:
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (GRBReceiver) Unable to route packet for key APID: 480, last product time seen: 0x480_2020-11-29T19:25:17.355
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (GRBReceiver) APID: 0x91 sequence error, counter: 11975
jvm 1 | 2020/11/29 14:27:15.035 | [WARN ] (GRBProductDataset) Sequence count jump for APID:91, from: 7147 to: 11975
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (GRBReceiver) Should never happen, invalid time portion of product key:
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (GRBReceiver) Unable to route packet for key APID: 480, last product time seen: 0x480_2020-11-29T19:25:17.355
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (GRBReceiver) Should never happen, invalid time portion of product key:
jvm 1 | 2020/11/29 14:27:15.035 | [ERROR] (GRBReceiver) Unable to route packet for key APID: 480, last product time seen: 0x480_2020-11-29T19:25:17.355

and after the invalid time portion errors, those:
jvm 1 | 2020/11/29 14:27:15.037 | [INFO ] (GRBReceiver) New product for Key: 0x480_2020-11-29T19:26:58.312
jvm 1 | 2020/11/29 14:27:15.137 | [ERROR] (GRBReceiver) APID: 0x96 sequence error, counter: 1251
jvm 1 | 2020/11/29 14:27:15.137 | [WARN ] (GRBProductDataset) Sequence count jump for APID:96, from: 958 to: 1251
jvm 1 | 2020/11/29 14:27:15.137 | [ERROR] (GRBReceiver) APID: 0x99 sequence error, counter: 14079
jvm 1 | 2020/11/29 14:27:15.137 | [WARN ] (GRBProductDataset) Sequence count jump for APID:99, from: 13896 to: 14079
jvm 1 | 2020/11/29 14:27:15.237 | [ERROR] (GRBReceiver) APID: 0x97 sequence error, counter: 14665
jvm 1 | 2020/11/29 14:27:15.237 | [WARN ] (GRBProductDataset) Sequence count jump for APID:97, from: 14471 to: 14665
jvm 1 | 2020/11/29 14:27:15.437 | [ERROR] (GRBReceiver) APID: 0x9f sequence error, counter: 16243
jvm 1 | 2020/11/29 14:27:15.437 | [WARN ] (GRBProductDataset) Sequence count jump for APID:9f, from: 16054 to: 16243

So I uploaded also the image corresponding to those errors

So do you think it's only me or is it from GRB stream or CSPP-GEO bug or misbehaving?

Thanks
Luc Fontaine
VE2FXL
tommyj
Posts: 7
Joined: Tue May 22, 2018 8:33 pm

Re: CSSPP-GEO errors

Post by tommyj »

Hi Luc -

We don't think this is related to the alert from NOAA. Our systems behaved normally during this time period so our first suspicion is either:
  • * You are experiencing some local interference
    * Your machine is overworked to the point it is not keeping up with the data flow
If you are able, the best first step would be to run the cspp-geo-grb-diag.sh script, in the base CSPP-GEO install directory, then
email us the output (removing any info you might consider sensitive).

We will await your response or further questions.
ve2fxl
Posts: 14
Joined: Sun Nov 29, 2020 2:59 pm

Re: CSSPP-GEO errors

Post by ve2fxl »

Thanks,

Can you tell me the email address to send the log?

Luc Fontaine
VE2FXL
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: CSSPP-GEO errors

Post by kathys »

Please use this address: csppgeo.issues@ssec.wisc.edu

Kathy
tommyj
Posts: 7
Joined: Tue May 22, 2018 8:33 pm

Re: CSSPP-GEO errors

Post by tommyj »

After a Dec 22nd email exchange with Luc, we have determined the problem is upstream from CSPP Geo GRB,
either a cable or NIC on their GRBStreamer PC.
Post Reply