Processing raw RINEX data

In this example, we process some example RINEX files to demonstrate gnssvod.

Running the tutorials

Once gnssvod is installed in your environment, you can download the tutorials using the command line

git clone --depth 1 --filter=blob:none --sparse https://github.com/vincenthumphrey/gnssvod.git
cd gnssvod
git sparse-checkout set docs/source/examples

Alternatively, download the repository as a ZIP, unzip, and navigate to docs/source/examples

Preprocessing

The main pre-processing function is gnssvod.preprocess(). This function can do several things:

  • It will read RINEX observation files as pandas data frames

  • It can aggregate the raw data to a lower temporal rate if specified.

  • It will automatically download orbit and clock files for the corresponding days from the GSSC ESA server

  • From the orbit and clock files, it will calculate azimuth and elevation for each measurement

  • It can save each processed file as a netcdf file in the outputdir folder or return the results as a dictionary

specifying input files

The function exclusively reads RINEX observation files. Such files typically end with the extension ‘.yyO’ where yy is the last two digit of the year. The function can be used to process a single file, a group of files, or several groups of files corresponding to several receivers, as shown in the examples below. All of this is done by specifying a pattern as the first argument to the function.

specifying output destinations

Results are saved to a NetCDF file when an output directory is specified and/or returned as a dictionary when “outputresult=True” is passed.

Let’s read a single file using the example data to begin with

import gnssvod as gv

pattern = {'Dav2_Twr':'data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282106.21O'}
result = gv.preprocess(pattern, outputresult=True)

Created a temporary directory at /tmp/tmpzf3jqmyn
data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282106.21O exists | Reading...
Observation file  data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282106.21O  is read in 4.06 seconds.
Processing 112382 individual observations
Calculating Azimuth and Elevation
This file does not exist: /tmp/tmpzf3jqmyn/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3
Downloading: GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3.gz

GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3.gz: 0.98MB [00:01, 521kB/s]                             

 | Download completed for GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3.gz
/tmp/tmpzf3jqmyn/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3 file is read in 2.49 seconds
This file does not exist: /tmp/tmpzf3jqmyn/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3
Downloading: GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3.gz

GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3.gz: 0.98MB [00:00, 2.00MB/s]                            

 | Download completed for GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3.gz
/tmp/tmpzf3jqmyn/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3 file is read in 1.10 seconds
This file does not exist: /tmp/tmpzf3jqmyn/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK
Downloading: GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK.gz

GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK.gz: 4.54MB [00:00, 8.26MB/s]                            

 | Download completed for GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK.gz
/tmp/tmpzf3jqmyn/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK file is read in 3.08 seconds
This file does not exist: /tmp/tmpzf3jqmyn/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK
Downloading: GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK.gz

GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK.gz: 4.55MB [00:01, 4.53MB/s]                            

 | Download completed for GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK.gz
/tmp/tmpzf3jqmyn/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK file is read in 3.21 seconds
SP3 interpolation is done in 8.28 seconds
Removed the temporary directory at /tmp/tmpzf3jqmyn

The logs should indicate how many observations were read in the file.

The logs also show some orbit files were downloaded. Orbit files are necessary to calculate the azimuth and elevation of the satellites. A temporary folder is automatically created to store those orbit files and process them, then the temporary folder is deleted.

If you process very recent data (less than 3 days old), it could be that the orbit and clock files are not available on the ESA server yet and there would then be an error.

The result returned by the function is a dictionary that maps keys to lists of Observation objects.

result

{'Dav2_Twr': [<gnssvod.io.io.Observation at 0x7f18fe1a3f70>]}

Since we processed one file, there is only one Observation object in the list. Let us access this first and unique item.

obs = result['Dav2_Twr'][0]
obs

<gnssvod.io.io.Observation at 0x7f18fe1a3f70>

Observation objects are custom classes introduced in the gnsspy package by Mustafa Serkan Işık and Volkan Özbey. A significant number of base functions in gnssvod are based on gnsspy.

Attribute

Description

obs.filename

Name of the source file

obs.epoch

Datetime indicating the day at the start of the record

obs.observation

Pandas DataFrame containing all measurements

obs.approx_position

Approximate receiver position from the RINEX file [X, Y, Z]

obs.receiver_type

Receiver type (if provided in the RINEX file)

obs.antenna_type

Antenna type (if provided in the RINEX file)

obs.interval

Measurement frequency in seconds

obs.receiver_clock

Receiver clock information (if provided)

obs.version

RINEX file version

obs.observation_types

Observation types reported as columns in obs.observation

Let’s just look at the data..

obs.observation
C1 L1 D1 S1 C2 L2 D2 S2 C7 L7 D7 S7 Azimuth Elevation
Epoch SV
2021-04-28 21:07:08 G01 2.300005e+07 1.208661e+08 -2545.050 47.0 2.300006e+07 9.418140e+07 -1983.223 44.0 NaN NaN NaN NaN 132.372864 59.902810
G03 2.257959e+07 1.186567e+08 -528.921 47.0 2.257959e+07 9.245973e+07 -412.197 42.0 NaN NaN NaN NaN -16.744176 79.170432
G04 2.373431e+07 1.247247e+08 1971.157 45.0 2.373431e+07 9.718807e+07 1535.983 42.0 NaN NaN NaN NaN -169.822432 50.693499
G09 2.620530e+07 1.377098e+08 3155.798 40.0 2.620531e+07 1.073063e+08 2459.033 40.0 NaN NaN NaN NaN -150.328510 19.288991
G17 2.423057e+07 1.273325e+08 -403.684 49.0 2.423058e+07 9.922014e+07 -314.543 40.0 NaN NaN NaN NaN -81.696037 43.789922
... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ...
2021-04-28 22:07:07 C16 NaN 2.282536e+08 -1695.972 36.0 4.383370e+07 2.282536e+08 -1695.972 36.0 4.383372e+07 NaN -1311.197 31.0 41.172558 7.343129
C27 NaN 1.432542e+08 1694.596 44.0 2.751047e+07 1.432542e+08 1694.596 44.0 NaN NaN NaN NaN -42.395746 20.938009
C28 NaN 1.326840e+08 -1191.327 49.0 2.548056e+07 1.326840e+08 -1191.327 49.0 NaN NaN NaN NaN -99.551780 49.140759
S23 4.111082e+07 2.160388e+08 -516.361 45.0 NaN NaN NaN NaN NaN NaN NaN NaN NaN NaN
S36 4.078565e+07 2.143301e+08 -517.120 42.0 NaN NaN NaN NaN NaN NaN NaN NaN NaN NaN

112382 rows × 14 columns

The pandas data frame has a MultIndex that contains both Epoch and SV as indices. The Epoch is the local time of the measurement and the SV is a satellite identification number (also called PRN).

The columns correspond to:

  • C# = Pseudorange from the receiver to the satellite, in meters

  • L# = Carrier phase, in cycles

  • D# = Doppler, in Hz

  • S# = Carrier to noise density C/N$_0$, in dB (receiver-dependent)

And the numbers (S1, S2, etc. ) indicate the corresponding GNSS frequency

The azimuth and elevation of the satellite with respect to the receiver are expressed in degrees. Computation speed for the azimuth and elevation can vary according to your hardware. Most of the time is spent interpolating the orbit parameters to the time stamps of each measurement. This is why it is sometimes useful to resample high frequency data (here one measurement per second) to for instance one measurement each 15 seconds.

Resampling

We can pass “interval=’15s’” to resample the data during the preprocessing. The returned data will be smaller and the calculation of the azimuths and elevations (reported as “SP3 interpolation”) will be faster.

pattern = {'Dav2_Twr':'data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282106.21O'}
result = gv.preprocess(pattern,interval='15s',outputresult=True)
# and show data frame
result['Dav2_Twr'][0].observation

Created a temporary directory at /tmp/tmp2y9_xgyk
data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282106.21O exists | Reading...
Observation file  data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282106.21O  is read in 4.06 seconds.
Processing 112382 individual observations
Calculating Azimuth and Elevation
This file does not exist: /tmp/tmp2y9_xgyk/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3
Downloading: GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3.gz

GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3.gz: 0.98MB [00:01, 608kB/s]                             

 | Download completed for GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3.gz
/tmp/tmp2y9_xgyk/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3 file is read in 2.34 seconds
This file does not exist: /tmp/tmp2y9_xgyk/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3
Downloading: GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3.gz

GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3.gz: 0.98MB [00:00, 2.12MB/s]                            

 | Download completed for GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3.gz
/tmp/tmp2y9_xgyk/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3 file is read in 1.01 seconds
This file does not exist: /tmp/tmp2y9_xgyk/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK
Downloading: GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK.gz

GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK.gz: 4.54MB [00:00, 8.07MB/s]                            

 | Download completed for GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK.gz
/tmp/tmp2y9_xgyk/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK file is read in 3.40 seconds
This file does not exist: /tmp/tmp2y9_xgyk/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK
Downloading: GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK.gz

GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK.gz: 4.55MB [00:00, 7.95MB/s]                            

 | Download completed for GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK.gz
/tmp/tmp2y9_xgyk/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK file is read in 3.03 seconds
SP3 interpolation is done in 2.08 seconds
Removed the temporary directory at /tmp/tmp2y9_xgyk
C1 C2 C7 D1 D2 D7 L1 L2 L7 S1 S2 S7 Azimuth Elevation
Epoch SV
2021-04-28 21:07:00 C06 NaN 4.307927e+07 4.307927e+07 -1539.026429 -1539.026429 -1189.841571 2.243250e+08 2.243250e+08 1.734648e+08 38.000000 38.000000 31.000000 36.614495 10.132689
C09 NaN 4.080972e+07 4.080973e+07 -1076.832857 -1076.832857 -832.746571 2.125070e+08 2.125070e+08 1.643239e+08 41.000000 41.000000 36.000000 49.034472 32.742503
C11 NaN 2.596665e+07 2.596666e+07 -3555.085714 -3555.085714 -2748.967571 1.352152e+08 1.352152e+08 1.045570e+08 43.428571 43.428571 41.000000 177.234549 35.079888
C14 NaN 2.382462e+07 2.382462e+07 32.760429 32.760429 25.282429 1.240611e+08 1.240611e+08 9.593200e+07 45.000000 45.000000 42.285714 -96.373353 76.785189
C16 NaN 4.268828e+07 4.268830e+07 -1595.855857 -1595.855857 -1234.117000 2.222891e+08 2.222891e+08 1.718881e+08 38.000000 38.000000 33.000000 38.266603 15.249211
... ... ... ... ... ... ... ... ... ... ... ... ... ... ... ...
2021-04-28 22:07:00 R18 2.326705e+07 2.326705e+07 NaN -3848.505125 -2993.250750 NaN 1.242018e+08 9.660093e+07 NaN 46.375000 42.000000 NaN -167.160718 45.315939
R19 2.237872e+07 2.237872e+07 NaN -52.467125 -40.688500 NaN 1.197111e+08 9.310873e+07 NaN 37.375000 38.875000 NaN -74.711561 63.385367
R20 2.596147e+07 2.596148e+07 NaN 3565.564875 2773.281125 NaN 1.388277e+08 1.079770e+08 NaN 37.875000 34.750000 NaN -26.146660 13.545577
S23 4.111048e+07 NaN NaN -515.803000 NaN NaN 2.160370e+08 NaN NaN 44.750000 NaN NaN NaN NaN
S36 4.078531e+07 NaN NaN -516.305375 NaN NaN 2.143283e+08 NaN NaN 41.750000 NaN NaN NaN NaN

7550 rows × 14 columns

There are now less rows in the data frame since we resampled data to one value every 15 seconds.

Batch processing

We now demonstrate how to use the preprocessing function to process not just one but many files and save the outputs as NetCDF files (instead of returning the results as objects). If we were processing several hundreds of files, your computer may not have sufficient memory to hold all of the outputs, so it makes sense to save processed data as a NetCDF file.

Specifying several groups of files

Instead of specifying just one file, like data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282106.21O, we specify a UNIX-style pattern like data_RINEX2.11/Dav2_Twr/rinex/*.*O. All files matching that pattern (relying on function :func:glob.glob) will be processed. We can process several groups files by specifying different matching patterns (see below).

Specifying where to save data

Same as for specifying the inputs, we use a dictionary to indicate where to save data (see the example call below). The destination folder will be created if it does not exist.

Specifying a list of variables to save

For calculating GNSS-VOD, we only need the “S” variables. We can reduce the size of the saved NetCDF files by discarding the other variables, this is done with the ‘keepvars’ argument, which will only keep the variables present in the passed list. This argument supports UNIX-style pattern matching (e.g. ‘S*’ will match all variables starting with ‘S’)

Compression

Unless encoding=None is passed as argument, gv.preprocess() will compress all S* variables, as well as Azimuth and Elevation when saving to NetCDF. These variables are encoded as Int16 with a scale factor of 0.1. The decoding is automatically applied when reading the data with xarray.

# use gnssvod to batch process the observation RINEX files 
# (files with extension .yyO for each station)
# pattern = {'choice_of_name_for_station1':'pattern to match (UNIX-style)',
#            'choice_of_name_for_station2':'pattern to match (UNIX-style)',
#             ...}
#
pattern = {'Dav2_Twr':'data_RINEX2.11/Dav2_Twr/rinex/*.*O',
          'Dav1_Grnd':'data_RINEX2.11/Dav1_Grnd/rinex/*.*O'}
outputdir = {'Dav2_Twr':'data_RINEX2.11/Dav2_Twr/nc/',
            'Dav1_Grnd':'data_RINEX2.11/Dav1_Grnd/nc/'}
# what variables should be kept
keepvars = ['S?','S??']

gv.preprocess(pattern,interval='15s',keepvars=keepvars,outputdir=outputdir)

Created a temporary directory at /tmp/tmpfk6r0oua
Could not find any files matching the pattern data_RINEX2.11/Dav2_Twr/nc/*.nc
data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282106.21O exists | Reading...
Observation file  data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282106.21O  is read in 3.90 seconds.
Processing 112382 individual observations
Calculating Azimuth and Elevation
This file does not exist: /tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3
Downloading: GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3.gz

GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3.gz: 0.98MB [00:00, 2.11MB/s]                            

 | Download completed for GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3.gz
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3 file is read in 1.10 seconds
This file does not exist: /tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3
Downloading: GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3.gz

GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3.gz: 0.98MB [00:00, 2.15MB/s]                            

 | Download completed for GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3.gz
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3 file is read in 1.01 seconds
This file does not exist: /tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK
Downloading: GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK.gz

GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK.gz: 4.54MB [00:00, 7.65MB/s]                            

 | Download completed for GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK.gz
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK file is read in 3.22 seconds
This file does not exist: /tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK
Downloading: GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK.gz

GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK.gz: 4.55MB [00:00, 8.36MB/s]                            

 | Download completed for GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK.gz
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK file is read in 2.86 seconds
SP3 interpolation is done in 2.22 seconds
Saved 7550 individual observations in data_RINEX2.11/Dav2_Twr/nc/Reach_Dav2_Twr-raw_202104282106.nc
data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282206.21O exists | Reading...
Observation file  data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282206.21O  is read in 3.90 seconds.
Processing 112113 individual observations
Calculating Azimuth and Elevation
Saved 7533 individual observations in data_RINEX2.11/Dav2_Twr/nc/Reach_Dav2_Twr-raw_202104282206.nc
data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282306.21O exists | Reading...
Observation file  data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104282306.21O  is read in 3.94 seconds.
Processing 115429 individual observations
Calculating Azimuth and Elevation
Saved 7756 individual observations in data_RINEX2.11/Dav2_Twr/nc/Reach_Dav2_Twr-raw_202104282306.nc
data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104290006.21O exists | Reading...
Observation file  data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104290006.21O  is read in 3.95 seconds.
Processing 109702 individual observations
Calculating Azimuth and Elevation
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3 exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3 file is read in 0.50 seconds
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3 exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3 file is read in 0.62 seconds
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK file is read in 3.09 seconds
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK file is read in 3.23 seconds
SP3 interpolation is done in 2.26 seconds
Saved 7370 individual observations in data_RINEX2.11/Dav2_Twr/nc/Reach_Dav2_Twr-raw_202104290006.nc
data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104290106.21O exists | Reading...
Observation file  data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104290106.21O  is read in 4.27 seconds.
Processing 117216 individual observations
Calculating Azimuth and Elevation
Saved 7871 individual observations in data_RINEX2.11/Dav2_Twr/nc/Reach_Dav2_Twr-raw_202104290106.nc
data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104290206.21O exists | Reading...
Observation file  data_RINEX2.11/Dav2_Twr/rinex/Reach_Dav2_Twr-raw_202104290206.21O  is read in 3.81 seconds.
Processing 108484 individual observations
Calculating Azimuth and Elevation
Saved 7331 individual observations in data_RINEX2.11/Dav2_Twr/nc/Reach_Dav2_Twr-raw_202104290206.nc
Could not find any files matching the pattern data_RINEX2.11/Dav1_Grnd/nc/*.nc
data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104282106.21O exists | Reading...
Observation file  data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104282106.21O  is read in 3.15 seconds.
Processing 111162 individual observations
Calculating Azimuth and Elevation
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3 exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3 file is read in 0.27 seconds
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3 exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3 file is read in 0.27 seconds
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK file is read in 2.13 seconds
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK file is read in 1.93 seconds
SP3 interpolation is done in 1.51 seconds
Saved 7481 individual observations in data_RINEX2.11/Dav1_Grnd/nc/Reach_Dav1_Grnd-raw_202104282106.nc
data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104282206.21O exists | Reading...
Observation file  data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104282206.21O  is read in 3.74 seconds.
Processing 107018 individual observations
Calculating Azimuth and Elevation
Saved 7231 individual observations in data_RINEX2.11/Dav1_Grnd/nc/Reach_Dav1_Grnd-raw_202104282206.nc
data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104282306.21O exists | Reading...
Observation file  data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104282306.21O  is read in 3.98 seconds.
Processing 113394 individual observations
Calculating Azimuth and Elevation
Saved 7670 individual observations in data_RINEX2.11/Dav1_Grnd/nc/Reach_Dav1_Grnd-raw_202104282306.nc
data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104290006.21O exists | Reading...
Observation file  data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104290006.21O  is read in 3.91 seconds.
Processing 110793 individual observations
Calculating Azimuth and Elevation
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3 exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_05M_ORB.SP3 file is read in 0.48 seconds
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3 exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_05M_ORB.SP3 file is read in 0.48 seconds
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211180000_01D_30S_CLK.CLK file is read in 2.53 seconds
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK exists | Reading...
/tmp/tmpfk6r0oua/GFZ0MGXRAP_20211190000_01D_30S_CLK.CLK file is read in 2.99 seconds
SP3 interpolation is done in 2.20 seconds
Saved 7498 individual observations in data_RINEX2.11/Dav1_Grnd/nc/Reach_Dav1_Grnd-raw_202104290006.nc
data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104290106.21O exists | Reading...
Observation file  data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104290106.21O  is read in 3.80 seconds.
Processing 109171 individual observations
Calculating Azimuth and Elevation
Saved 7414 individual observations in data_RINEX2.11/Dav1_Grnd/nc/Reach_Dav1_Grnd-raw_202104290106.nc
data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104290206.21O exists | Reading...
Observation file  data_RINEX2.11/Dav1_Grnd/rinex/Reach_Dav1_Grnd-raw_202104290206.21O  is read in 3.63 seconds.
Processing 102591 individual observations
Calculating Azimuth and Elevation
Saved 6961 individual observations in data_RINEX2.11/Dav1_Grnd/nc/Reach_Dav1_Grnd-raw_202104290206.nc
Removed the temporary directory at /tmp/tmpfk6r0oua

Skipping existing files by default

The preprocess function will scan the destination folder for existing NetCDF files. If some files are found that have already been processed, these files will be skipped unless overwrite=True has been passed.

Here because the destination folder was empty, a user warning appears in the log above but can be ignored (“Could not find any files matching the pattern data_RINEX2.11/Dav2_Twr/nc/*.nc”)