ADL4.0-- Ingest .hf NCEP-GSF Data

Data formats, HDF5, XML profiles, etc.
Post Reply
Nima
Posts: 7
Joined: Sun Sep 30, 2012 11:56 pm

ADL4.0-- Ingest .hf NCEP-GSF Data

Post by Nima »

Hello!

I just came across the following:
EDR algorithms in ADL 3.1 and the upcoming 4.0 require granulated ancillary data. This is produced in the VIIRS SDR Controller. The VIIRS SDR Controller requires "internally" format NCEP products, which are different from off_NCEP-GFS-*HR-ANC_*_np.h5. In ADL 3.1 you must use external tools (like the DynAncMetaCreator, DynAncConverter, and DynAncInterpolater) to create such internal files. In ADL 4.0 that process will get easier as ADL will have code to ingest and convert the native files.
I just wanted to make sure that this works properly in ADL4.0.

Based on the new capability, .hf file from CLASS would suffice to generate the ganulated ANC data. right?

Thanks,
Nima
Nima Pahlevan
UMass Boston
tjensen
Posts: 12
Joined: Fri Aug 05, 2011 5:09 pm
Location: Omaha, NE

Re: ADL4.0-- Ingest .hf NCEP-GSF Data

Post by tjensen »

Hi Nima.

That should be correct. In ADL 4.0, the IDPS Ingest Mission Support Data (ING MSD) executable was brought over to ADL. A wrapper script was created to simplify this process: $ADL_HOME/script/runMsd.pl

Code: Select all

Usage: ./runMsd.pl [a|t|m] [options]
REQUIRED (must include one of the following):
   -a        Run both ING MSD and Temporal Interpolation.
   -t        Only run Temporal Interpolation (skips ING MSD).
   -m        Only run ING MSD (skips Temporal Interpolation).

OPTIONS:
   -c cfg    Set ING MSD Executable Configuration file. Default:
              $ADL_HOME/cfg/dynamic/withMetadata/IngMsdLwFile.xml
   -o dir    Set Temporal Interpolation Output directory. Default:
              $ADL_HOME/data/output/withMetadata/ProAncTemporalInterpolationOutputs
   -l level  Set Temporal Interpolation Logging level (LOW|MED|HIGH)
              Default: HIGH.
   -v        Verbose mode.
   -h        This help page.

Required Environment Variables:
   ADL_HOME: Contains the root path of your ADL Installation
   ADL_MSD_LZ_PATH: Contains the path to the ING MSD Landing Zone
You should be able to unpack the h5 files from CLASS, sort them into the ADL Landing Zone directories ( $ADL_HOME/script/sortMsdIntoLz.pl can help with that), and run the runMsd.pl script.

More information can be found in ADL SW User's Manual part 2, Section 5.8.13.

Let me know if you run into any problems.
Tim Jensen
Raytheon Company
Nima
Posts: 7
Joined: Sun Sep 30, 2012 11:56 pm

Re: ADL4.0-- Ingest .hf NCEP-GSF Data

Post by Nima »

Hi Tim

It worked pretty well! will get back to you if I run into other issues!

Thanks,
Nima
Nima Pahlevan
UMass Boston
Post Reply