GREMLIN CONUS3 Dataset for 2021

Code for reading the data: The data can be read using the provided Python code ("read_conus3_file.py" and "test_read.py") or the provided Fortran code ("gzmodule.f90", "test_read.f90", "compile.sh"). Note that this code reads the data without having to unzip the files.

The "test_read.py" and "test_read.f90" use one sample file (ABI_C13_202001010000.bin.gz) to verify the code is reading correctly by checking against seven points within the image and against the minimum and maximum over the full image. This file has been included in the software.tar package.

To use the Python code, at the command line simply invoke:

python test_read.py

The function that actually reads a data file, in "read_conus3_file.py", makes use of the gzip module, which is part of the Python Standard Library. If your code is reading correctly, you should see this output:

testfile= ABI_C13_202001010000.bin.gz
min data, expected, isclose= -1e+30 -1e+30 True
max data, expected, isclose= 296.77463 296.77463 True
data[   0,   0], expected, isclose= -1e+30 -1e+30 True
data[ 529,   0], expected, isclose= -1e+30 -1e+30 True
data[1058,   0], expected, isclose= -1e+30 -1e+30 True
data[   0, 899], expected, isclose= 254.55347 254.55347 True
data[   0,1798], expected, isclose= 295.85233 295.85233 True
data[ 529, 899], expected, isclose= 267.37692 267.37692 True
data[1058,1798], expected, isclose= -1e+30 -1e+30 True

The important thing is that each line ends with "True", which confirms that the values returned by the code match the expected values to a precision of 1.E-07.

To use the Fortran code, first you must compile the code using "compile.sh", at the command line:

 ./compile.sh

Note that this script specifies a typical path to the zlib library on a Linux machine:

 /lib64/libz.so.1

If your zlib library is in a different location, you must modify this path.

Once compiled, you can use the Fortran code by invoking at the command line:

 ./test_read.exe

If your code is reading correctly, you should see the output:

  testfile=ABI_C13_202001010000.bin.gz
  min gzdata, expected, isclose=  -1.00000002E+30  -1.00000002E+30 T
  max gzdata, expected, isclose=   296.774628       296.774628     T
  gzdata(   1,   1), expected, isclose=  -1.00000002E+30  -1.00000002E+30 T
  gzdata(   1, 530), expected, isclose=  -1.00000002E+30  -1.00000002E+30 T
  gzdata(   1,1059), expected, isclose=  -1.00000002E+30  -1.00000002E+30 T
  gzdata( 900,   1), expected, isclose=   254.553467       254.553467     T
  gzdata(1799,   1), expected, isclose=   295.852325       295.852325     T
  gzdata( 900, 530), expected, isclose=   267.376923       267.376923     T
  gzdata(1799,1059), expected, isclose=  -1.00000002E+30  -1.00000002E+30 T

The important thing is that each line ends with "T", which confirms that the values returned by the code match the expected values to a precision of 1.E-07.

Once you have confirmed that the code is reading correctly for you, then you can use it in your own code.

For Python, this means adding the lines to your code:

 from read_conus3_file import read_conus3_file
 data = read_conus3_file(testfile)

The data are accessible through the NumPy array "data".

For Fortran, this means adding the lines to your code:

 include 'gzmodule.f90'
 use gzmodule, only: read_gzip, gzdata
 logical :: success
 call read_gzip(testfile,success)
 if (.not.success) stop 'error reading testfile'

The data are accessible through the "gzdata" array. Please refer to the "test_read.f90" code for more information about where these statements belong in a Fortran program.

Funding provided by: National Oceanic and Atmospheric Administration
Crossref Funder Registry ID: http://dx.doi.org/10.13039/100000192
Award Number: NA19OAR4320073