$ADL_HOME/script/runMsd.pl not able to convert msd files

Issues related to VIIRS EDR algorithms and data
Post Reply
jhuang
Posts: 1
Joined: Fri Apr 27, 2012 3:06 pm

$ADL_HOME/script/runMsd.pl not able to convert msd files

Post by jhuang »

Dear Helpdesk,
I am having problems with converting NCEP and NAAPS data to internal format in ADL4.2:
I am able to load my MSD files to $ADL_HOME/data/MSD_LZ/ANC/

Code: Select all

[jhuang@rhw9103 jhuang]$ ls -l $ADL_HOME/data/MSD_LZ/*
/data/data003/ADL4.2/ADL/data/MSD_LZ/ANC:
total 24
lrwxrwxrwx. 1 jhuang vaod 128 Oct 27 11:33 off_NAAPS-06HR-ANC_NAAPS_FNMOC_006f_20150519_201505191200Z_20150519151500Z_ee20150519210000Z_np.msd -> /data/data003/jhuang/anc_msd/off_NAAPS-06HR-ANC_NAAPS_FNMOC_006f_20150519_201505191200Z_20150519151500Z_ee20150519210000Z_np.msd
lrwxrwxrwx. 1 jhuang vaod 141 Oct 27 11:33 off_NAAPS-06HR-ANC_NAAPS_FNMOC_006f_20150519_201505191200Z_20150519151500Z_ee20150519210000Z_np.msd.CMP_FILENAME -> /data/data003/jhuang/anc_msd/off_NAAPS-06HR-ANC_NAAPS_FNMOC_006f_20150519_201505191200Z_20150519151500Z_ee20150519210000Z_np.msd.CMP_FILENAME
lrwxrwxrwx. 1 jhuang vaod 128 Oct 27 11:33 off_NCEP-GFS-06HR-ANC_GFS_NCEP_006f_20150519_201505191200Z_20150519153014Z_ee20150519210000Z_np.msd -> /data/data003/jhuang/anc_msd/off_NCEP-GFS-06HR-ANC_GFS_NCEP_006f_20150519_201505191200Z_20150519153014Z_ee20150519210000Z_np.msd
lrwxrwxrwx. 1 jhuang vaod 141 Oct 27 11:33 off_NCEP-GFS-06HR-ANC_GFS_NCEP_006f_20150519_201505191200Z_20150519153014Z_ee20150519210000Z_np.msd.CMP_FILENAME -> /data/data003/jhuang/anc_msd/off_NCEP-GFS-06HR-ANC_GFS_NCEP_006f_20150519_201505191200Z_20150519153014Z_ee20150519210000Z_np.msd.CMP_FILENAME
lrwxrwxrwx. 1 jhuang vaod 136 Oct 27 11:33 off_USNO-PolarWander-UT1-ANC_Ser7_USNO_000f_20150515_201505150000Z_20150515003003Z_ee20150522120000Z_np.msd -> /data/data003/jhuang/anc_msd/off_USNO-PolarWander-UT1-ANC_Ser7_USNO_000f_20150515_201505150000Z_20150515003003Z_ee20150522120000Z_np.msd
lrwxrwxrwx. 1 jhuang vaod 149 Oct 27 11:33 off_USNO-PolarWander-UT1-ANC_Ser7_USNO_000f_20150515_201505150000Z_20150515003003Z_ee20150522120000Z_np.msd.CMP_FILENAME -> /data/data003/jhuang/anc_msd/off_USNO-PolarWander-UT1-ANC_Ser7_USNO_000f_20150515_201505150000Z_20150515003003Z_ee20150522120000Z_np.msd.CMP_FILENAME
but when I tried to run the runMsd.pl

Code: Select all

[jhuang@rhw9103 jhuang]$ $ADL_HOME/script/runMsd.pl -m
Running ING MSD...
ING MSD completed successfully
6 not converted
Number of newly converted output files: 0
Running ING MSD only. Skipping TI check...
It did not generate the internal format files at all. Any ideas why this happens?
The package used is ADL4.2 for Mx8.10. Thanks!


Thanks a lot!
Jingfeng
kbisanz
Posts: 280
Joined: Wed Jan 05, 2011 7:02 pm
Location: Omaha NE

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Post by kbisanz »

There should be a log file in $ADL_HOME/log/. Does it say anything?

Do you have any other NCEP and NAAPS files already in your output directory? Some versions of Ingest will not ingest files if newer versions already exist. That behavior has changed over time and I don't remember when the switch was made.

If you don't figure anything out, please post a log file where the debug level was set to LOW.
Kevin Bisanz
Raytheon Company
jhuangadl
Posts: 142
Joined: Fri Apr 29, 2011 7:57 am

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Post by jhuangadl »

Code: Select all

/data/data003/ADL4.2/ADL/log/IngMsd.exe_20151028_133837_24302/message.log

Status Type:INF_STATUSTYPE_CMD_COMPL,Timestamp:2015-10-28 17:38:37.922335Z,ID1:,ID2:,Name1:Start Process,Name2:,Name3:,Quality:-1,Severity:INF_SEVERITYLEVEL_NOT_SET,Logging Level:INF_LOGLEVEL_NOT_SET,Display Flag:INF_DISPLAYFLAG_NOT_SET,Description:Start Process completed on /data/data003/ADL4.2/ADL/tools/bin/IngMsd.exe,Process WID:0,Subject WID:0
Status Type:INF_STATUSTYPE_PROC_START,Timestamp:2015-10-28 17:38:37.922469Z,ID1:,ID2:,Name1:,Name2:,Name3:,Quality:-1,Severity:INF_SEVERITYLEVEL_NOT_SET,Logging Level:INF_LOGLEVEL_NOT_SET,Display Flag:INF_DISPLAYFLAG_NOT_SET,Description:/data/data003/ADL4.2/ADL/tools/bin/IngMsd.exe started,Process WID:0,Subject WID:0
Detail Type:INF_DETAILTYPE_INF_INFO,Timestamp2015-10-28 17:38:37.922596Z,Process ID:,Routine Name:InfTk_InitData,Severity:INF_SEVERITYLEVEL_NOT_SET,Level:INF_LOGLEVEL_NOT_SET,Display Flag:INF_DISPLAYFLAG_NOT_SET,Description:Tk Initialization complete!
Status Type:INF_STATUSTYPE_ING_ERR,Timestamp:2015-10-28 17:38:37.924392Z,ID1:,ID2:,Name1:,Name2:,Name3:,Quality:-1,Severity:INF_SEVERITYLEVEL_WARNING,Logging Level:INF_LOGLEVEL_OPS,Display Flag:INF_DISPLAYFLAG_ACKNOWLEDG,Description:Unable to access DMS instance at location <DPE_DMS_INST_PATH UNDEFINED>,Process WID:0,Subject WID:0
Detail Type:INF_DETAILTYPE_ING_INFO,Timestamp2015-10-28 17:38:37.924504Z,Process ID:ING_MSD,Routine Name:IngMsdCommon_Master::shutdown,Severity:INF_SEVERITYLEVEL_NORMAL,Level:INF_LOGLEVEL_DETAIL,Display Flag:INF_DISPLAYFLAG_NORMAL,Description:MSD Master is shutting down
Status Type:INF_STATUSTYPE_PROC_FAIL,Timestamp:2015-10-28 17:38:37.924604Z,ID1:,ID2:,Name1:,Name2:,Name3:,Quality:-1,Severity:INF_SEVERITYLEVEL_NOT_SET,Logging Level:INF_LOGLEVEL_NOT_SET,Display Flag:INF_DISPLAYFLAG_NOT_SET,Description:Process failed,Process WID:0,Subject WID:0
jhuangadl
Posts: 142
Joined: Fri Apr 29, 2011 7:57 am

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Post by jhuangadl »

$DCONFIG/dynamic/withMetadata/IngMsdLwFile.xml

Code: Select all

<InfTkConfig>
  <idpProcessName>ING_LW</idpProcessName>
  <siSoftwareId></siSoftwareId>
  <isRestart>FALSE</isRestart>
  <useExtSiWriter>FALSE</useExtSiWriter>
  <debugLogLevel>NORMAL</debugLogLevel>
  <debugLevel>DBG_LOW</debugLevel>
   <dbgDest>D_FILE</dbgDest>
   <dbgPath>${ADL_HOME}/log</dbgPath>
  <perfPath>${ADL_HOME}/log</perfPath>
  <inputPath>${ADL_INGEST_OUTPUT_DIR}</inputPath>
  <outputPath>${ADL_INGEST_OUTPUT_DIR}</outputPath>
  <enablePerf>FALSE</enablePerf>
  <configGuideName>IngMsd_GuideList.cfg</configGuideName>
  <initData>
     <domain>dev</domain>
     <subDomain>SUBDOMAIN</subDomain>
     <startMode>INF_STARTMODE_COLD</startMode>
     <executionMode>INF_EXEMODE_PRIMARY</executionMode>
     <healthTimeoutPeriod>28</healthTimeoutPeriod>
  </initData>
  <lockinMem>FALSE</lockinMem>
  <rootDir>${ADL_HOME}/log</rootDir>

  <task>
    <taskType>SMD</taskType>
    <taskDetails1></taskDetails1>
    <taskDetails2></taskDetails2>
    <taskDetails3></taskDetails3>
    <taskDetails4></taskDetails4>
  </task>

</InfTkConfig>

jhuangadl
Posts: 142
Joined: Fri Apr 29, 2011 7:57 am

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Post by jhuangadl »

Sorry, my bad, I should have changed the output directory for runMsd.pl

Change:
$DCONFIG/dynamic/withMetadata/IngMsdLwFile.xml
53,54c53,54
< <inputPath>${ADL_INGEST_OUTPUT_DIR}</inputPath>
< <outputPath>${ADL_INGEST_OUTPUT_DIR}</outputPath>
---
> <inputPath>${ADL_HOME}/data/output/withMetadata/IngMsdOutputs</inputPath>
> <outputPath>${ADL_HOME}/data/output/withMetadata/IngMsdOutputs</outputPath>

But still even after I got the ancellary data converted, my ADL still did not run successfully. It seems the ANC granulization module does not work :(
jhuangadl
Posts: 142
Joined: Fri Apr 29, 2011 7:57 am

Re: $ADL_HOME/script/runMsd.pl not able to convert msd files

Post by jhuangadl »

Good news. I think I found the issue.
I did not get the correct location of the Tile-Eco-ANC tile inputs.
Now, both the IngMsd and Anc Gran modules are working properly, so the aerosol algorithm.
Thanks a lot!!! :)
Post Reply