IMAPP questions

dgorski
Posts: 3
Joined: Tue Jul 19, 2016 7:30 am

IMAPP questions

Post by dgorski »

Dear IMAPP developers,

1. Please how may I perform the conversion of imapp generated data (for example t1.16201.0912.ndvi.250m) into a carthographic projection, and then save image in geotiff format? What software to use for this purpose?

2. From al the Terra Modis data flow (*.pds) I only interested in a determined area. May I adjust imapp to work within my area of interest? In negative case, may I previously cut off a part of the pds-file within the borders of defined by me coordinates?

Best regards,
Dmitry
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: IMAPP questions

Post by kathys »

Hello Dmitry,

1. I see that my colleague Dave is helping you at: viewtopic.php?f=66&t=686&start=30

2. If you are able to cut off the PDS file to fit your region alone, the IMAPP VM should work to process that data, however, I do not know of a tool that will do that as of now.

Cheers,

Kathy
Dmitry
Posts: 34
Joined: Mon Feb 29, 2016 3:56 am

Re: IMAPP questions

Post by Dmitry »

Dear Kathy

Yes, Dave has been assisting me a lot. My thankfulness to him for all his support.

Please, help me. I try extracting region of my interest using imapp tools (modis_L1A_extract.py), what am I doing wrong:
modis_L1A_extract.py T2016192091816.L1A_LAC T2016192091816.GEO 22.00 51.00 34.00 57.00 T2016192091816.L1A_LAC T2016192091816.GEO
Traceback (most recent call last):
File "/home/dgorski/dbvm/apps/modisl1db/ocssw/run/scripts/modis_L1A_extract.py", line 62, in <module>
anc_utils.DEFAULT_ANC_DIR_TEXT + "/log/ does not " \
AttributeError: 'module' object has no attribute 'DEFAULT_ANC_DIR_TEXT'

Dmitry
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: IMAPP questions

Post by kathys »

Hello Dmitry,

The IMAPP virtual appliance uses the software distributed by the NASA Ocean Color Group for the processing that goes from Level 0 to Level 1B. As it it used in the IMAPP VM, it is set up to process the entire pass.
We can try to help you with using the software, but it is distributed and maintained at: http://seadas.gsfc.nasa.gov/modisl1db/

The execution of modis_L1A_extract.py should be as seen below. I think you need to include the prefixes including -g , -n, -s, -w, -e.

Good luck,

Kathy

Usage:
modis_L1A_extract.py [OPTIONS] L1AFILE [-g GEOFILE] [-o EXTRACTFILE] -n NORTH -s SOUTH -w WEST -e EAST
if GEOFILE is not provided, assumed to be basename of L1AFILE + '.GEO'
or
modis_L1A_extract.py --par parameter_file [OPTIONS]


Options:
--version show program's version number and exit
-h, --help show this help message and exit
-p PARFILE, --parfile=PARFILE
Parameter file containing program inputs
-o EXTRACTFILE, --output=EXTRACTFILE
Output L1A extract filename - defaults to L1AFILE.sub
-g GEOFILE, --geofile=GEOFILE
INPUT L1A GEOFILE filename - defaults to basename of
L1AFILE +'.GEO'
-n NORTH, --north=NORTH
Northernmost desired latitude
-s SOUTH, --south=SOUTH
Southernmost desired latitude
-w WEST, --west=WEST Westernmost desired longitude
-e EAST, --east=EAST Easternmost desired longitude
--extract_geo=EXGEO extract geolocation filename
-v, --verbose print status messages
--log Save processing log file(s)

==========================================================================

The modis_L1A_extract.py script extracts a Level 1A subscene from an Aqua or
Terra L1A and GEO file. If an output GEO file is specified, the script will
also create a GEO file corresponding to the new L1A subscene, since the
original GEO file will not work with the new subscene.

==========================================================================

======================================
Explanation of command line arguments:
======================================

L1AFILE (required)
Input MODIS Aqua or Terra L1A file to be extracted.

GEOFILE (required)
Input MODIS Aqua or Terra Geolocation file. If not provided on command line,
the basename of the L1AFILE + '.GEO' is assumed.

EXTRACTFILE (required)
Filename of the output L1A extracted subscene. If not provided, L1AFILE.sub is
used.

==========================================================================
que
Posts: 11
Joined: Wed Feb 22, 2017 9:00 am

Re: IMAPP questions

Post by que »

Dear Kathy,
Good day to you. We keep getting this message on our server while using IMAPP VIRTUAL MACHINE to process our MODIS image. Your assistance is highly needed please.

(Starting MODISL1DB unpacking and geolocation processing)
modis_L1A.py /home/modis/dbvm/data/level0/P0420064AAAAAAAAAAAAAA17026101907001.PDS --startnudge 0 --stopnudge 0
L1A version: 6.0.4 built on Sep 13 2013 (08:59:47)
scan: 0 out of 73 Tue Feb 21 09:13:28 2017
scan: 10 out of 73 Tue Feb 21 09:13:29 2017
scan: 20 out of 73 Tue Feb 21 09:13:29 2017
scan: 30 out of 73 Tue Feb 21 09:13:29 2017
scan: 40 out of 73 Tue Feb 21 09:13:29 2017
scan: 50 out of 73 Tue Feb 21 09:13:29 2017
scan: 60 out of 73 Tue Feb 21 09:13:30 2017
modis_GEO.py T2017026101921.L1A_LAC --threshold 80
Level 0 to Level 1A processing failed for input file: /home/modis/dbvm/data/level0/P0420064AAAAAAAAAAAAAA17026101907001.PDS; will retry

Thank you
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: IMAPP questions

Post by kathys »

The modisl1db software now requires accessing ancillary files from a NASA https instead of http website. This resulted in a number of problems for users. However, if you are using the IMAPP virtual machine version 2.0, you should be fine if you use the IMAPP scripts to update your leapsecond and utcpole files regularly.

Can you please try this?

- Run the update script that is part of the IMAPP VA before attempting to run the modisl1db software.

$DBVM_HOME/scripts/update_leapsec_utcpole.bash

- Then try to process your PDS file again.

If this resolves your problem, the crontab file that is included in the imapp va distribution can be used to automatically execute the script daily.

Please let me know if this resolves your problem.

Kathy
que
Posts: 11
Joined: Wed Feb 22, 2017 9:00 am

Re: IMAPP questions

Post by que »

Dear Kathy,

Thank you or your prompt reply. Below is the operational steps i undertook after your suggestion
but to no avail;

modis@dbvm:~/dbvm/scripts$ update_leapsec_utcpole.bash
modis@dbvm:~/dbvm$ cd ~
modis@dbvm:~$ touch /home/modis/dbvm/data/level0/P1540064AAAAAAAAAAAAAA17053115639001.PDS.event

I later tried to start the bash again;

modis@dbvm:~$ dbvm_start.bash
(Starting the DBVM system)
(Starting daemons)
Starting daemon_pds_event.bash
(Activating crontab)
(Updating leapsec.dat and utcpole.dat files)
modis@dbvm:~$ touch /home/modis/dbvm/data/level0/P1540064AAAAAAAAAAAAAA17053115639001.PDS.event

I later check the error log and this is what i found

Starting GBAD processing)
Aqua GBAD Level 0 file not found: /home/modis/dbvm/data/level0/P1540957AAAAAAAAAAAAAA17053115639001.PDS
MODIS Level 1 processing failed for input file: /home/modis/dbvm/data/level0/P1540064AAAAAAAAAAAAAA17053115639001.PDS

My concern is that we do not have P1540957AAAAAAAAAAAAAA17053115639001 has metadata what we have is
P1540957AAAAAAAAAAAAAA17053115639001
P1540957AAAAAAAAAAAAAA17053115639000

But the test data with the Virtual Machine has a metadata like that too (see below)
P1540064AAAAAAAAAAAAAA15033184802001.PDS
P1540957AAAAAAAAAAAAAA15033184802001.PDS

Thank you and hope to hear from you

Taiwo
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: IMAPP questions

Post by kathys »

Hi Taiwo,

Can you please post your PDS files for us to try? I think I will be able to provide you with better advice on how to resolve your problem. Feel free to post your PDS files at our anonymous ftp site: ftp://ftp.ssec.wisc.edu/pub/incoming.

Kathy
que
Posts: 11
Joined: Wed Feb 22, 2017 9:00 am

Re: IMAPP questions

Post by que »

Dear Kathy,
Good day to you. I have attached one of the PDS files (Terra) to your anonymous ftp site: ftp://ftp.ssec.wisc.edu/pub/incoming. The file are;
P0420064AAAAAAAAAAAAAA17004091805001.PDS
P0420064AAAAAAAAAAAAAA17004091805000.PDS
for your reference

I shall attached the following PDS fileS (AQUA) to tomorrow;
P1540064AAAAAAAAAAAAAA17006120707001.PDS
P1540064AAAAAAAAAAAAAA17006120707000.PDS

Thank you while anticipating to hear from you

Taiwo
kathys
Posts: 487
Joined: Tue Jun 22, 2010 4:51 pm

Re: IMAPP questions

Post by kathys »

Hello, I downloaded your data and will investigate. Thank you for staging at our ftp site.

Kathy
Post Reply