There is a newer version of this record available.

Dataset Open Access

Wind WAVES TDSF Dataset

Wilson III, Lynn B


Citation Style Language JSON Export

{
  "publisher": "Zenodo", 
  "DOI": "10.5281/zenodo.3911205", 
  "title": "Wind WAVES TDSF Dataset", 
  "issued": {
    "date-parts": [
      [
        2020, 
        6, 
        28
      ]
    ]
  }, 
  "abstract": "<p><strong><em>Wind</em> Spacecraft:</strong></p>\n\n<p>The <em>Wind</em> spacecraft (<a href=\"https://wind.nasa.gov\">https://wind.nasa.gov</a>) was launched on November 1, 1994 and currently orbits the first Lagrange point between the Earth and sun. &nbsp;It holds a suite of instruments from gamma ray detectors to quasi-static magnetic field instruments, Bo. &nbsp;The instruments used for this data product&nbsp;are the fluxgate magnetometer (MFI) [<a href=\"https://ui.adsabs.harvard.edu/abs/1995SSRv...71..207L/abstract\"><em>Lepping et al.</em>, 1995</a>] and the radio receivers (WAVES) [<a href=\"https://ui.adsabs.harvard.edu/abs/1995SSRv...71..231B/abstract\"><em>Bougeret et al.</em>, 1995</a>]. &nbsp;The MFI measures 3-vector <strong>B</strong><sub>o</sub> at ~11 samples per second (sps); WAVES observes electromagnetic radiation from ~4 kHz to &gt;12 MHz which provides an observation of the upper hybrid line (also called the plasma line) used to define the total electron density and also takes time series snapshot/waveform captures of electric and magnetic field fluctuations, called TDS bursts herein.</p>\n\n<p><strong>WAVES Instrument:</strong></p>\n\n<p>The WAVES experiment [<a href=\"https://ui.adsabs.harvard.edu/abs/1995SSRv...71..231B/abstract\"><em>Bougeret et al.</em>, 1995</a>] on the <em>Wind</em> spacecraft is composed of three orthogonal electric field antenna and three orthogonal search coil magnetometers. &nbsp;The electric fields are measured through five different receivers: Low Frequency FFT receiver called FFT (0.3 Hz to 11 kHz), Thermal Noise Receiver called TNR (4-256 kHz), Radio receiver band 1 called RAD1 (20-1040 kHz), Radio receiver band 2 called RAD2 (1.075-13.825 MHz), and the Time Domain Sampler (TDS). &nbsp;The electric field antenna are dipole antennas with two orthogonal antennas in the spin plane and one spin axis stacer antenna.</p>\n\n<p>The TDS receiver allows one to examine the electromagnetic waves observed by <em>Wind</em> as time series waveform captures. There are two modes of operation, TDS Fast (TDSF) and TDS Slow (TDSS). TDSF returns 2048 data points for two channels of the electric field, typically E<sub>x</sub> and E<sub>y</sub> (i.e. spin plane components), with little to no gain below ~120 Hz (the data herein has been high pass filtered above ~150 Hz for this reason). TDSS returns four channels with three electric(magnetic) field components and one magnetic(electric) component. &nbsp;The search coils show a gain roll off ~3.3 Hz [e.g., see <a href=\"https://ui.adsabs.harvard.edu/abs/2010JGRA..11512104W/abstract\"><em>Wilson et al.</em>, 2010</a>; <a href=\"https://ui.adsabs.harvard.edu/abs/2012GeoRL..39.8109W/abstract\"><em>Wilson et al.</em>, 2012</a>; <a href=\"https://ui.adsabs.harvard.edu/abs/2013JGRA..118....5W/abstract\"><em>Wilson et al.</em>, 2013</a> and references therein for more details].</p>\n\n<p>The original calibration of the electric field antenna found that the effective antenna lengths are roughly 41.1 m, 3.79 m, and 2.17 m for the X, Y, and Z antenna, respectively. &nbsp;The +E<sub>x</sub> antenna was broken twice during the mission as of June 26, 2020. &nbsp;The first break occurred on August 3, 2000 around ~21:00 UTC and the second on September 24, 2002 around ~23:00 UTC. &nbsp;These breaks reduced the effective antenna length of Ex from ~41 m to 27 m after the first break and ~25 m after the second break [e.g., see <a href=\"https://ui.adsabs.harvard.edu/abs/2014GeoRL..41..266M/abstract\"><em>Malaspina et al.</em>, 2014</a>; <a href=\"https://ui.adsabs.harvard.edu/abs/2016JGRA..121.9369M/abstract\"><em>Malaspina &amp; Wilson</em>, 2016</a>].</p>\n\n<p><strong>TDS Bursts:</strong></p>\n\n<p>TDS bursts are waveform captures/snapshots of electric and magnetic field data. &nbsp;The data is triggered by the largest amplitude waves which exceed a specific threshold and are then stored in a memory buffer. &nbsp;The bursts are ranked according to a quality filter which mostly depends upon amplitude. &nbsp;Due to the age of the spacecraft and ubiquity of large amplitude electromagnetic and electrostatic waves, the memory buffer often fills up before dumping onto the magnetic tape drive. &nbsp;If the memory buffer is full, then the bottom ranked TDS burst is erased every time a new TDS burst is sampled. &nbsp;That is, the newest TDS burst sampled by the instrument is always stored and if it ranks higher than any other in the list, it will be kept. &nbsp;This results in the bottom ranked burst always being erased. &nbsp;Earlier in the mission, there were also so called honesty bursts, which were taken periodically to test whether the triggers were working properly. &nbsp;It was found that the TDSF triggered properly, but not the TDSS. &nbsp;So the TDSS was set to trigger off of the Ex signals.</p>\n\n<p>A TDS burst from the <em>Wind</em>/WAVES instrument is always 2048 time steps for each channel. &nbsp;The sample rate for TDSF bursts ranges from 1875 samples/second (sps) to 120,000 sps. &nbsp;Every TDS burst is marked a unique set of numbers (unique on any given date) to help distinguish it from others and to ensure any set of channels are appropriately connected to each other. &nbsp;For instance, during one spacecraft downlink interval there may be 95% of the TDS bursts with a complete set of channels (i.e., TDSF has two channels, TDSS has four) while the remaining 5% can be missing channels (just example numbers, not quantitatively accurate). &nbsp;During another downlink interval, those missing channels may be returned if they are not overwritten. &nbsp;During every downlink, the flight operations team at NASA Goddard Space Fligth Center (GSFC) generate level zero binary files from the raw telemetry data. &nbsp;Those files are filled with data received on that date and the file name is labeled with that date. &nbsp;There is no attempt to sort chronologically the data within so any given level zero file can have data from multiple dates within. &nbsp;Thus, it is often necessary to load upwards of five days of level zero files to find as many full channel sets as possible. &nbsp;The remaining unmatched channel sets comprise a much smaller fraction of the total.</p>\n\n<p>All data provided here are from TDSF, so only two channels. &nbsp;Most of the time channel 1 will be associated with the E<sub>x</sub> antenna and channel 2 with the E<sub>y</sub> antenna. &nbsp;The data are provided in the spinning instrument coordinate basis with associated angles necessary to rotate into a physically meaningful basis (e.g., GSE).</p>\n\n<p><strong>TDS Time Stamps:</strong></p>\n\n<p>Each TDS burst is tagged with a time stamp called a spacecraft event time or SCET. &nbsp;The TDS datation time is sampled after the burst is acquired which requires a delay buffer. &nbsp;The datation time requires two corrections. &nbsp;The first correction arises from tagging the TDS datation with an associated spacecraft major frame in house keeping (HK) data. &nbsp;The second correction removes the delay buffer duration. &nbsp;Both inaccuracies are essentially artifacts of on ground derived values in the archives created by the WINDlib software (<em>K. Goetz, Personal Communication</em>, 2008) found at <a href=\"https://github.com/lynnbwilsoniii/Wind_Decom_Code\">https://github.com/lynnbwilsoniii/Wind_Decom_Code</a>.</p>\n\n<p>The WAVES instrument&#39;s HK mode sends relevant low rate science back to ground once every spacecraft major frame. &nbsp;If multiple TDS bursts occur in the same major frame, it is possible for the WINDlib software to assign them the same SCETs. &nbsp;The reason being that this top-level SCET is only accurate to within +300 ms (in 120,000 sps mode) due to the issues described above (at lower sample rates, the error can be slightly larger). &nbsp;The time stamp uncertainty is a positive definite value because it results from digitization rounding errors. &nbsp;One can correct these issues to within +10 ms if using the proper HK data.</p>\n\n<p><strong>*** The data stored here have not corrected the SCETs! ***</strong></p>\n\n<p>The 300 ms uncertainty, due to the HK corrections mentioned above, results from WINDlib trying to recreate the time stamp after it has been telemetered back to ground. &nbsp;If a burst&nbsp;stays in the TDS buffer for extended periods of time (i.e., &gt;2 days), the interpolation done by WINDlib can make mistakes in the 11<sup>th</sup> significant digit. &nbsp;The positive definite nature of this uncertainty is due to rounding errors associated with the onboard DPU (digital processing unit)&nbsp;clock rollover. &nbsp;The DPU clock is a 24 bit integer clock sampling at &sim;50,018.8 Hz. &nbsp;The clock rolls over at &sim;5366.691244092221 seconds, i.e., (16*2<sup>24</sup>)/50,018.8. The sample rate is a temperature sensitive issue and thus subject to change over time. &nbsp;From a sample of 384 different points on 14 different days, a statistical estimate of the rollover time is 5366.691124061162 &plusmn; 0.000478370049 seconds (<em>calculated by Lynn B. Wilson III</em>, 2008). &nbsp;Note that the WAVES instrument team used <em>UR8</em> times, which are the number of 86,400 second days from 1982-01-01/00:00:00.000 UTC.</p>\n\n<p>The method to correct the SCETs to within +10 ms, were one to do so, is given as follows:</p>\n\n<ol>\n\t<li>Retrieve the DPU clock times, SCETs, UR8 times, and DPU Major Frame Numbers from the WINDlib libraries on the VAX/ALPHA systems for the TDSS(F) data of interest.</li>\n\t<li>Retrieve the same quantities from the HK data.</li>\n\t<li>Match the HK event number with the same DPU Major Frame Number as the TDSS(F) burst of interest.</li>\n\t<li>Find the difference in DPU clock times between the TDSS(F) burst of interest and the HK event with matching major frame number (<strong>Note:</strong> The TDSS(F) DPU clock time will always be greater than the HK DPU clock if they are the same DPU Major Frame Number and the DPU clock has not rolled over).</li>\n\t<li>Convert the difference to a UR8 time and add this to the HK UR8 time. &nbsp;The new UR8 time is the corrected UR8 time to within +10 ms.</li>\n\t<li>Find the difference between the new UR8 time and the UR8 time WINDlib associates with the TDSS(F) burst. Add the difference to the DPU clock time assigned by WINDlib to get the corrected DPU clock time (Note: watch for the DPU clock rollover).</li>\n\t<li>Convert the new UR8 time to a SCET using either the IDL WINDlib libraries or TMLib (STEREO S/WAVES software) libraries of available functions. &nbsp;This new SCET is accurate to within +10 ms.</li>\n</ol>\n\n<p>One can find a UR8 to UTC conversion routine at <a href=\"https://github.com/lynnbwilsoniii/wind_3dp_pros\">https://github.com/lynnbwilsoniii/wind_3dp_pros</a> in the <strong>~/LYNN_PRO/Wind_WAVES_routines/</strong> folder.</p>\n\n<p>Examples of good waveforms can be found in the notes PDF at <a href=\"https://wind.nasa.gov/docs/wind_waves.pdf\">https://wind.nasa.gov/docs/wind_waves.pdf</a>.</p>\n\n<p><strong>Data Set Description</strong></p>\n\n<p>Each Zip file contains 300+ IDL save files; one for each day of the year with available data. &nbsp;This data set is not complete as the software used to retrieve and calibrate these TDS bursts did not have sufficient error handling to handle some of the more nuanced bit errors or major frame errors in some of the level zero files. &nbsp;There is currently (as of June 27, 2020) an effort (by <em>Keith Goetz et al.</em>) to generate the entire TDSF and TDSS data set in one repository to be put on SPDF/CDAWeb as CDF files. &nbsp;Once that data set is available, it will supercede and replace this one as it will be more complete and all SCETs will be corrected.</p>\n\n<p>When one restores any given IDL save file, they will find an IDL structure named struc. &nbsp;Inside are several tags and for each date there are&nbsp;T number of&nbsp;TDSF bursts, each of which has K (= 2048) time stamps. &nbsp;The structure&nbsp;contains the following tags:</p>\n\n<ul>\n\t<li><strong>SCETS</strong>: &nbsp;[T]-Element [string] array of SCETs at start of TDS burst with format &#39;YYYY-MM-DD/hh:mm:ss.xxx&#39;</li>\n\t<li><strong>UNIX</strong>: &nbsp;[T,K]-Element [double] array of quasi-Unix times (i.e., converted from UTC times without removing leap seconds)</li>\n\t<li><strong>CH1EXDA_CH2EXYZAC_WAVES</strong>: &nbsp;[T,K,5]-Element [float] array&nbsp;of electric fields [mV/m] in spinning WAVES coordinates, where the components are:\n\t<ul>\n\t\t<li>[*,*,0] = E<sub>x</sub> in DC-coupled mode from channel 1</li>\n\t\t<li>[*,*,1] = E<sub>x</sub> in AC-coupled mode from channel 1</li>\n\t\t<li>[*,*,2] = E<sub>x</sub> in AC-coupled mode from channel 2</li>\n\t\t<li>[*,*,3] = E<sub>y</sub> in AC-coupled mode from channel 2</li>\n\t\t<li>[*,*,4] = E<sub>z</sub> in AC-coupled mode from channel 2</li>\n\t</ul>\n\t</li>\n\t<li><strong>SRATE</strong>: &nbsp;[T]-Element [float] array of sample rates for each TDSF burst [Hz]</li>\n\t<li><strong>FILTER_FREQ</strong>: &nbsp;[T]-Element [float] array of soft low pass filter frequencies [Hz]</li>\n\t<li><strong>EVENT_NUM</strong>: &nbsp;[T]-Element [long] array of TDS event numbers [N/A]</li>\n\t<li><strong>UR8_START</strong>: &nbsp;[T]-Element [double] array of UR8 times at start of TDS burst [# of 86,400 second days from 1982-01-01/00:00:00.000 UTC]</li>\n\t<li><strong>EX_START_ANG</strong>: &nbsp;[T]-Element [float] array of counter-clockwise&nbsp;angles between the +Ex antenna and the spacecraft-to-sun line at the start of each TDS burst&nbsp;[e.g., see&nbsp;<a href=\"https://ui.adsabs.harvard.edu/abs/2016JGRA..121.9369M/abstract\"><em>Malaspina &amp; Wilson</em>, 2016</a>&nbsp;for definitions]</li>\n\t<li><strong>EX___END_ANG</strong>: &nbsp;[T]-Element [float] array of counter-clockwise&nbsp;angles between the +Ex antenna and the spacecraft-to-sun line at the end of each TDS burst&nbsp;[e.g., see&nbsp;<a href=\"https://ui.adsabs.harvard.edu/abs/2016JGRA..121.9369M/abstract\"><em>Malaspina &amp; Wilson</em>, 2016</a>&nbsp;for definitions]</li>\n\t<li><strong>THETA_AX</strong>: &nbsp;[T]-Element [float] array of average&nbsp;counter-clockwise&nbsp;angles between the +Ex antenna and the Earth-to-sun line&nbsp;[e.g., see&nbsp;<a href=\"https://ui.adsabs.harvard.edu/abs/2016JGRA..121.9369M/abstract\"><em>Malaspina &amp; Wilson</em>, 2016</a>&nbsp;for definitions]</li>\n\t<li><strong>BO_GSE</strong>: &nbsp;[T,3]-Element [float] array of <strong>B</strong><sub>o</sub> 3-vectors [nT] in GSE coordinate basis at start of TDS bursts</li>\n\t<li><strong>SC_GSE_POS</strong>: &nbsp;[T,3]-Element [float] array of spacecraft position&nbsp;3-vectors [R<sub>E</sub>] in GSE coordinate basis at start of TDS bursts</li>\n\t<li><strong>SC_SPIN_RATE</strong>: &nbsp;[T]-Element [float] array of spacecraft spin rates [deg/s] at start of TDS bursts</li>\n\t<li><strong>JULIAN</strong>: &nbsp;[T]-Element [double] array of Julian day numbers [N/A]</li>\n\t<li><strong>EARTH_WAKE</strong>: &nbsp;[T]-Element [byte] array of logical values defining whether spacecraft is in Earth&#39;s optical wake [1 = TRUE, 0 = FALSE]</li>\n\t<li><strong>LUNAR_WAKE</strong>: &nbsp;[T]-Element [byte] array of logical values defining whether spacecraft is in the lunar&nbsp;optical wake [1 = TRUE, 0 = FALSE]</li>\n\t<li><strong>CHANNEL_1_LABS</strong>: &nbsp;[T]-Element [string] array of channel 1 labels defining the source type shown in the&nbsp;<strong>CH1EXDA_CH2EXYZAC_WAVES</strong> tag</li>\n\t<li><strong>CHANNEL_2_LABS</strong>: &nbsp;[T]-Element [string] array of channel 2 labels defining the source type shown in the&nbsp;<strong>CH1EXDA_CH2EXYZAC_WAVES</strong> tag</li>\n\t<li><strong>CHANNEL_1_INT</strong>: &nbsp;[T]-Element [integer] array of channel 1 labels&nbsp;[<strong>obsolete</strong>]</li>\n\t<li><strong>CHANNEL_2_INT</strong>: &nbsp;[T]-Element [integer] array of channel 2 labels&nbsp;[<strong>obsolete</strong>]</li>\n\t<li><strong>UNITS</strong>: &nbsp;[19]-Element&nbsp;[string] array defining the units of each structure tag</li>\n\t<li><strong>NOTES</strong>: &nbsp;[11]-Element&nbsp;[string] array defining some useful things about the data set</li>\n</ul>\n\n<p>Note that the angles have all been shifted by +360 degrees to avoid rollover issues. &nbsp;The reason being that the spacecraft rotates such that&nbsp;<strong>EX_START_ANG</strong>&nbsp;is always larger than <strong>EX___END_ANG</strong>. &nbsp;All angles herein are counter-clockwise angles in the GSE basis.</p>\n\n<p><strong>Rotating B<sub>o</sub> from GSE to WAVES coordinates</strong></p>\n\n<p>Since the quasi-static magnetic field is given in GSE coordinates, one may want to examine the wave fields relative to the <strong>B</strong><sub>o</sub> direction. &nbsp;If you examine the attached figure labeled&nbsp;GSE-Basis_to_WAVES_rotation_2.jpg, you will see how to rotated from GSE into WAVES coordinates. &nbsp;The angle&nbsp;<span class=\"math-tex\">\\(\\phi\\)</span>&nbsp;in the image corresponds to the <strong>THETA_AX</strong> structure tag values. &nbsp;The angle&nbsp;<span class=\"math-tex\">\\(\\pi\\)</span>&nbsp;in the image is the actual value of pi in radians. &nbsp;This is is necessary to flip the GSE vectors to match the WAVES +z-axis, which is pointed toward the south ecliptic pole, not the north like Z-GSE.</p>\n\n<p>It is important to rotate <strong>B</strong><sub>o</sub>&nbsp;into WAVES rather than the electric fields into magnetic field-aligned coordinates since each antenna has different noise and response functions.</p>", 
  "author": [
    {
      "family": "Wilson III, Lynn B"
    }
  ], 
  "note": "This is like a Level 1.75 data product, not a Level 1 or Level 2.  The full level 2 data product will included TDSS bursts and use a slightly different complex transfer function for converting the raw engineering units [e.g., counts] into physical units [e.g., mV/m].  The level 2 data will also have corrected SCETs for all TDS bursts.", 
  "version": "1.0", 
  "type": "dataset", 
  "id": "3911205"
}
396
156
views
downloads
All versions This version
Views 396292
Downloads 15684
Data volume 228.1 GB127.8 GB
Unique views 348272
Unique downloads 5434

Share

Cite as