Mirror ancillary and luts on authenticated server

VIIRS Sensor Data Record
Post Reply
sverrem
Posts: 10
Joined: Tue May 19, 2020 4:38 pm

Mirror ancillary and luts on authenticated server

Post by sverrem »

We have mirrored the ancillary and luts from these sites on our own auxdata server.
JPSS_REMOTE_ANC_DIR=https://jpssdb.ssec.wisc.edu/cspp_v_4_0/ancillary/
JPSS_REMOTE_LUT_DIR=https://jpssdb.ssec.wisc.edu/cspp_luts_v_4_0/

However our server uses authentication:
JPSS_REMOTE_ANC_DIR=https://user:password@auxdata.company.c ... ancillary/
JPSS_REMOTE_LUT_DIR=https://juser:password@auxdata.company. ... uts_v_5_0/

However CSPP SDR does not work with these URLs.
Any ideas how we can get this to work? Is it a bug in CSPP SDR that it does not support authentication in these resources?

When running ./common/sdr_luts.sh to update the luts in local cache.

Code: Select all

2022-03-08 12:02:10(INFO):ancillary_control.py:1053:check_for_cache_database_initalization /home/sverre/media/drive/cspp/SDR_3_3/anc/cache/SDR_3_3_DB/db
2022-03-08 12:02:10(INFO):ancillary_control.py:1081:Database initialized or in process [Errno 17] File exists: '/home/user/media/drive/cspp/SDR_3_3/anc/cache/SDR_3_3_DB/db'
2022-03-08 12:02:10(INFO):http.py:105:Connection problem httpsuser:password@auxdata.company.com/cspp_luts_v_5_0/:// >VIIRS-SDR-OBC-ER-LUT_npp_.*?bin< 
2022-03-08 12:02:10(INFO):http.py:105:Connection problem httpsuser:password@auxdata.company.com/cspp_luts_v_5_0/:// >VIIRS-SDR-OBC-ER-LUT_npp_.*?bin< 
scottm

Re: Mirror ancillary and luts on authenticated server

Post by scottm »

Will your server respond to an http request? In that case define.

export JPSS_REMOTE_ANC_DIR=http://auxdata.company.com/cspp_v_4_0/ancillary/
export JPSS_REMOTE_LUT_DIR=http://auxdata.company.com/cspp_luts_v_5_0/

Your server may respond to https without a password. This is our expected behavior.

export JPSS_REMOTE_ANC_DIR=https://auxdata.company.com/cspp_v_4_0/ancillary/
export JPSS_REMOTE_LUT_DIR=https://auxdata.company.com/cspp_luts_v_4_0/

We have never tested with a user name and password. It is not a supported feature and as far as I know this is our first encounter with this issue. You should be able to configure your server to allow un authenticated access, or you would have to change the CSPP code, which I do not recommend. There may be scenarios where you can copy ancillary and LUT files to your installation. I would recommend checking your server configuration first, then contact us again.

Sorry for the inconvenience.
Post Reply