SNPP data outage

kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

SNPP data outage

Post by kathys »

The SNPP spacecraft entered a non-nominal state at ~16:24:49 UTC on July 26, 2022, after which all SMD and telemetry data was inaccessible. While the root cause continues to be investigated, subsequent contacts have confirmed the spacecraft and all instruments are currently in a safe mode state. Engineering will continue to restore all instruments and science data to an operational state once a plan forward has been determined. All missed data will not be recoverable.
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: SNPP data outage

Post by kathys »

Update #6: As of 1730 UTC (July 28, 2022), efforts are underway to investigate the S-NPP anomaly and prepare a plan to return the S-NPP spacecraft back to nominal status. These efforts are expected to continue into next week. S-NPP is in sun point (sun-safe) mode and all instruments are in a safe state. Although the HRD transmitter remains on, Direct Broadcast (DB) users are advised that science data is not available. All missed data will not be recoverable. No data is available starting at 16:09 UTC, July 26, 2022.
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: SNPP data outage

Post by kathys »

Update #7: As of 17:00 UTC (Aug 01, 2022) there have been no changes in status since the last update as engineering continues to troubleshoot.
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: SNPP data outage

Post by kathys »

Update #8 (August 1, 18:17 UTC): S-NPP transitioned to Mission Point mode on Friday, July 29, 2022. The S-NPP HRD transmitter (Direct Broadcast) was powered off on July 29, 2022 at 16:04 UTC. Engineering continues to troubleshoot.
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: SNPP data outage

Post by kathys »

Update #9 (August 3, 14:38UTC): All instruments have been offline since Friday, July 29, 2022. Instrument heater activation activities started today, Aug 3, 2022, and will continue throughout the week. The instrument activation sequence is tentatively planned to start next week (August 8-12) and the data product evaluation process is tentatively planned to start during the week of August 15-19. The High Rate Data (HRD) (Direct Broadcast) transmitter is powered off. Users who have any questions may directly contact OSPO’s JPSS Data Operations Manager at james.mcnitt@noaa.gov and include the ESPC Help Desk on the cc line (ESPCOperations@noaa.gov).
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: SNPP data outage

Post by kathys »

Update #10 (21:09 UTC, 9 August 2022): Instrument heater activation activities were completed on Monday, August 8. Instrument power-on activities started today, Tuesday, August 9 and will continue through tomorrow, Wednesday, August 10. The earliest the instrument activation process for science data could start is Wednesday, August 10. The process will be sequential and is expected to occur in the order of ATMS, VIIRS, OMPS, CERES, and CrIS. After all of the instruments are activated then the HRD transmitter (Direct Broadcast) will be powered on. However, the science data will not be cleared for operational use until the Sensor Data Record (SDR) and Environmental Data Record (EDR) product Cal/Val teams check each S-NPP product. Science data from Interface Data Processing Segment (IDPS) will be available on Government Resource for Algorithm Verification, Independent Test, and Evaluation (GRAVITE) for the Cal/Val teams and NDE I&T for the Product Area Leads (PAL), and will be archived in Comprehensive Large Array-data Stewardship System (CLASS). Full product recovery is expected to require approximately 2-3 weeks after the instruments start providing science data. Product Distribution and Access (PDA) OPS subscriptions for all S-NPP products have been disabled. S-NPP product subscriptions will be activated for distribution through PDA OPS after each product is cleared for operations by the product recovery team.
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: SNPP data outage

Post by kathys »

Update #11 (21:40 UTC, 10 August 2022: Instrument science data activation activities commenced today, Wednesday, August 10 and will continue through tomorrow, Thursday, August 11. All thermal and power systems on the S-NPP spacecraft remain nominal. ATMS was placed in operational mode at 15:33:53 UTC, with the first available observation data starting at 15:33:30 UTC. VIIRS was placed in full operational mode, following the DNB (Day Night Band) table updates and Daily Activity Schedule (DAS) loads at ~20:08 UTC. OMPS was placed in full operational mode at 19:12 UTC. Cal/Val teams are focusing their analysis on observed data following this timeline.

The HRD transmitter (Direct Broadcast) remains off and is currently planned to be turned on by August 12. Direct Broadcast (DB) users are advised that science data will not be of operational quality pending full product recovery.
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: SNPP data outage

Post by kathys »

Update #12 (August 11, 15:45 UTC): The S-NPP High Rate Data downlink was activated on August 11, 2022, at 14:35 UTC. Direct Broadcast (DB) users are advised not to use the S-NPP science data for operations until OSPO sends the ESPC Notification stating that the data product has been approved for operational use.

CSPP LEO users should wait to use the CSPP products for operations until the ESPC announcement has been issued.
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: SNPP data outage

Post by kathys »

Update #15 - Tuesday, August 16, 20:26UTC: As of Tuesday, August 16, 2022, the ATMS SDR, TDR, and Microwave Integrated Retrieval System (MiRS) EDR products and CrIS SDR product (including the ATMS and CrIS products) are approved for operational use. Direct Broadcast (DB) users can use the equivalent CSPP LEO products for operations.

The VIIRS and OMPS SDR and EDR teams continue to evaluate product quality. DB users are advised not to use the S-NPP VIIRS data for operations until NOAA sends the Notification stating that the data product has been approved for operational use. NOAA will issue a Notification prior to distributing the product to their users. At that point CSPP LEO users can use the equivalent CSPP product for operations.
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: SNPP data outage

Post by kathys »

Update #16 Issued 18 August 2022, 20:27 UTC: As of Thursday, August 18, 2022, the S-NPP VIIRS SDRs, VIIRS Imagery EDR, and the ACSPO Sea Surface Temperature EDRs are approved for operational use. Direct Broadcast users can use the equivalent CSPP LEO products for operations.The other VIIRS EDRs require additional analysis.
Post Reply