SGP/ECOR/E10 - Timestamp problems and intermittent data gaps

The raw files produced by the instrument contained bad (uncorrectable) data.  Specifically 
the date of the data in the file is given a time that is ahead of the actual time the 
data was genertaed.  This was caught because the date in the file was ahead of the system 
time of the server processing the raw file.  The mentor indicated all such files were 
compeltely bad and unrecoverable so all files that failed to be ingested were not shipped to 
the archive, thus producing holes in the raw and processed datastreams.  Because the 
problem was discovered by comparing to system time at time of processing all files between 
these dates should be consider suspect.  Therefore the files that are on the system over 
these three days should be used cautiously

• Raw data stream - documentation not supported(raw)

• kurtosis of variable v(kurt_v)
• covariance vq(cvar_vq)
• specific heat of moist air(cp)
• vector averaged wind speed(wind_spd)
• variance of variable v(var_v)
• Time offset from base_time(base_time)
• standard deviation of wind elevation angle(std_elev)
• rotated covariance ut(cvar_rot_ut)
• variance of variable w(var_w)
• kurtosis of variable q(kurt_q)
• friction velocity(ustar)
• number of valid t samples(n_good_t)
• corrected sensible heat flux(h)
• number of u samples removed due to spikes(n_spk_u)
• mean value of \spike\ w samples(mean_spk_w)
• mean water vapor concentration (q)(mean_q)
• rotated covariance wt(cvar_rot_wt)
• rotated mean w(mean_rot_w)
• kurtosis of variable w(kurt_w)
• vw covariance(cvar_vw)
• skewness of variable v(skew_v)
• 0=real or 1=dummy value of lv(real_lv)
• Down-boom wind velocity (u)(mean_u)
• latent heat flux(lv_e)
• Retrieved water vapor density profile(rho)
• mean sonic temperature (t), i.e. virtual temperature(mean_t)
• covariance wq(cvar_wq)
• number of t samples removed due to spikes(n_spk_t)
• rotated covariance vq(cvar_rot_vq)
• rotated covariance wc(cvar_rot_wc)
• altitude above sea levelaltunits(alt)
• number of samples with bad sonic status flag(n_bad_son_ic)
• vertical (elevation) wind angle(elev)
• number of q samples removed due to spikes(n_spk_q)
• covariance uc(cvar_uc)
• number of valid c samples(n_good_c)
• Cross-boom wind velocity (v)(mean_v)
• kurtosis of variable t(kurt_t)
• number of valid w samples(n_good_w)
• rotated covariance uw(cvar_rot_uw)
• 0=real or 1=dummy value of mr(real_mr)
• number of valid u samples(n_good_u)
• rotated covariance vt(cvar_rot_vt)
• rotated covariance uc(cvar_rot_uc)
• rotated covariance uv(cvar_rot_uv)
• number of valid v samples(n_good_v)
• rotated covariance vw(cvar_rot_vw)
• covariance of tc(cvar_tc)
• variance of variable u(var_u)
• wT covariance(cvar_wt)
• covariance vt(cvar_vt)
• 0=real or 1=dummy value of cp(real_cp)
• number of bad or out of range v samples(n_bad_v)
• skewness of variable c(skew_c)
• latent heat of vaporization(lv)
• covariance wc(cvar_wc)
• CO2 flux(fc)
• variance of variable t(var_t)
• number of bad or out of range u samples(n_bad_u)
• Time offset of tweaks from base_time(time_offset)
• skewness of variable t(skew_t)
• rotated mean v(mean_rot_v)
• number of v samples removed due to spikes(n_spk_v)
• vector averaged wind direction(wind_dir)
• Vertical angle of wind(phi)
• Time offset from midnight of date of file. For CO data, this is identical to
  time_offset and is included for compatibility.(time)
• mean value of \spike\ v samples(mean_spk_v)
• east longitude for all the input platforms.(lon)
• number of bad or out of range c samples(n_bad_c)
• number of w samples removed due to spikes(n_spk_w)
• number of valid q samples(n_good_q)
• number of c samples removed due to spikes(n_spk_c)
• 0=real or 1=dummy value of rho(real_rho)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• mean w (vertical) wind component(mean_w)
• rotated variance w(var_rot_w)
• covariance vc(cvar_vc)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• covariance of tq(cvar_tq)
• number of bad or out of range q samples(n_bad_q)
• skewness of variable q(skew_q)
• kurtosis of variable u(kurt_u)
• covariance of qc(cvar_qc)
• average temperature (IGRA internal sensor)(temp_irga)
• rotated variance v(var_rot_v)
• mean value of \spike\ u samples(mean_spk_u)
• mean co2 concentration (c)(mean_c)
• covariance uv(cvar_uv)
• mean value of out of range values and spikes of t -9999 if no spikes(mean_spk_t)
• number of samples with IRGA optical path blocked flag(n_bad_irga_light)
• number of bad or out of range t samples(n_bad_t)
• mean horizontal wind speed(mean_rot_u)
• variance of variable c(var_c)
• rotated covariance vc(cvar_rot_vc)
• skewness of variable u(skew_u)
• uw covariance(cvar_uw)
• covariance ut(cvar_ut)
• average atmospheric pressure (IGRA internal sensor)(atm_pres)
• north latitude for all the input platforms.(lat)
• skewness of variable w(skew_w)
• rotated covariance wq(cvar_rot_wq)
• momentum flux (dynamic)(k)
• standard deviation of wind direction(std_wind_dir)
• average voltage of IRGA cooler(mean_cooler)
• mixing ratio(mr)
• rotated variance u(var_rot_u)
• variance of variable q(var_q)
• number of bad or out of range w samples(n_bad_w)
• kurtosis of variable c(kurt_c)
• number of samples with \IRGA hardware problem\ flag(n_bad_irga)

SGP/ECOR/E10 - Sensor failure

Due to LI-7500 (H2O/CO2 infrared gas analyzer) sensor failure all humidity and CO2 data 
are incorrect for the period of Jul. 14, 2004 01:00 to Aug. 13, 2004 18:00.

• Raw data stream - documentation not supported(raw)

• rotated covariance vq(cvar_rot_vq)
• rotated covariance wc(cvar_rot_wc)
• skewness of variable c(skew_c)
• latent heat of vaporization(lv)
• covariance wc(cvar_wc)
• mean value of out of range values and spikes of t -9999 if no spikes(mean_spk_t)
• covariance vq(cvar_vq)
• specific heat of moist air(cp)
• covariance uc(cvar_uc)
• variance of variable c(var_c)
• rotated covariance vc(cvar_rot_vc)
• mean value of \spike\ v samples(mean_spk_v)
• kurtosis of variable q(kurt_q)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• mean value of \spike\ w samples(mean_spk_w)
• average atmospheric pressure (IGRA internal sensor)(atm_pres)
• rotated covariance uc(cvar_rot_uc)
• mean water vapor concentration (q)(mean_q)
• covariance vc(cvar_vc)
• rotated covariance wq(cvar_rot_wq)
• covariance of tc(cvar_tc)
• covariance uq(cvar_uq)
• average voltage of IRGA cooler(mean_cooler)
• rotated covariance uq(cvar_rot_uq)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• mixing ratio(mr)
• variance of variable q(var_q)
• latent heat flux(lv_e)
• covariance of tq(cvar_tq)
• Retrieved water vapor density profile(rho)
• skewness of variable q(skew_q)
• covariance of qc(cvar_qc)
• average temperature (IGRA internal sensor)(temp_irga)
• covariance wq(cvar_wq)
• kurtosis of variable c(kurt_c)
• mean value of \spike\ u samples(mean_spk_u)
• mean co2 concentration (c)(mean_c)

SGP/ECOR/E10 - Sensor failure

Due to sensor failure all the parameters measured by the Infrared Gas Analyzer (water 
vapor density, CO2 concentration, fluxes of latent heat and CO2, etc.) are incorrect for the 
period of 18:30 Oct. 22, 2004 to 22:00 Dec. 14, 2004. The data is irrevocably lost.

• Raw data stream - documentation not supported(raw)

• rotated covariance vq(cvar_rot_vq)
• rotated covariance wc(cvar_rot_wc)
• skewness of variable c(skew_c)
• covariance wc(cvar_wc)
• covariance vq(cvar_vq)
• number of samples with bad sonic status flag(n_bad_son_ic)
• CO2 flux(fc)
• number of q samples removed due to spikes(n_spk_q)
• specific heat of moist air(cp)
• number of samples with IRGA optical path blocked flag(n_bad_irga_light)
• covariance uc(cvar_uc)
• number of valid c samples(n_good_c)
• variance of variable c(var_c)
• rotated covariance vc(cvar_rot_vc)
• kurtosis of variable q(kurt_q)
• number of bad or out of range c samples(n_bad_c)
• 0=real or 1=dummy value of mr(real_mr)
• number of valid q samples(n_good_q)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• 0=real or 1=dummy value of rho(real_rho)
• number of c samples removed due to spikes(n_spk_c)
• average atmospheric pressure (IGRA internal sensor)(atm_pres)
• rotated covariance uc(cvar_rot_uc)
• mean water vapor concentration (q)(mean_q)
• covariance vc(cvar_vc)
• rotated covariance wq(cvar_rot_wq)
• covariance of tc(cvar_tc)
• covariance uq(cvar_uq)
• 0=real or 1=dummy value of lv(real_lv)
• average voltage of IRGA cooler(mean_cooler)
• rotated covariance uq(cvar_rot_uq)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• mixing ratio(mr)
• variance of variable q(var_q)
• latent heat flux(lv_e)
• covariance of tq(cvar_tq)
• number of bad or out of range q samples(n_bad_q)
• Retrieved water vapor density profile(rho)
• skewness of variable q(skew_q)
• average temperature (IGRA internal sensor)(temp_irga)
• covariance of qc(cvar_qc)
• covariance wq(cvar_wq)
• 0=real or 1=dummy value of cp(real_cp)
• number of samples with \IRGA hardware problem\ flag(n_bad_irga)
• kurtosis of variable c(kurt_c)
• mean co2 concentration (c)(mean_c)

SGP/ECOR/E10 - Reprocess: Incorrect H2O, CO2

Due to failure of analog output circuitry in the Infrared Gas Analyzer (IRGA), CO2 and 
water vapor parameters measured by the IRGA (water vapor density, CO2 concentration, fluxes 
of latent heat and CO2) were incorrectly recorded in sonic raw data files for the period 
of 22:30 Dec. 14, 2004 to 22:00 Jan. 11, 2005. The data could be recovered from IRGA raw 
serial files (00 level).

• Raw data stream - documentation not supported(raw)

• rotated covariance vq(cvar_rot_vq)
• rotated covariance wc(cvar_rot_wc)
• latent heat of vaporization(lv)
• skewness of variable c(skew_c)
• covariance wc(cvar_wc)
• covariance vq(cvar_vq)
• CO2 flux(fc)
• number of q samples removed due to spikes(n_spk_q)
• specific heat of moist air(cp)
• covariance uc(cvar_uc)
• number of valid c samples(n_good_c)
• variance of variable c(var_c)
• rotated covariance vc(cvar_rot_vc)
• kurtosis of variable q(kurt_q)
• number of bad or out of range c samples(n_bad_c)
• 0=real or 1=dummy value of mr(real_mr)
• number of valid q samples(n_good_q)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• 0=real or 1=dummy value of rho(real_rho)
• number of c samples removed due to spikes(n_spk_c)
• rotated covariance uc(cvar_rot_uc)
• mean water vapor concentration (q)(mean_q)
• covariance vc(cvar_vc)
• rotated covariance wq(cvar_rot_wq)
• covariance of tc(cvar_tc)
• covariance uq(cvar_uq)
• 0=real or 1=dummy value of lv(real_lv)
• rotated covariance uq(cvar_rot_uq)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• mixing ratio(mr)
• variance of variable q(var_q)
• latent heat flux(lv_e)
• covariance of tq(cvar_tq)
• number of bad or out of range q samples(n_bad_q)
• Retrieved water vapor density profile(rho)
• skewness of variable q(skew_q)
• covariance of qc(cvar_qc)
• covariance wq(cvar_wq)
• 0=real or 1=dummy value of cp(real_cp)
• number of samples with \IRGA hardware problem\ flag(n_bad_irga)
• kurtosis of variable c(kurt_c)
• mean co2 concentration (c)(mean_c)

SGP/ECOR/E10 - Reprocess: Incorrectly flagged (marked as "bad") H2O/CO2 data

Due to system clock instability on ECOR computers their system time is adjusted 
approximately once per hour; sometimes this adjustment leads to backward time jumps over midnight, 
into the previous day. In this case all the data based on CO2/H2O measurements might be 
erroneously marked as bad.

• rotated covariance vq(cvar_rot_vq)
• rotated covariance wc(cvar_rot_wc)
• skewness of variable c(skew_c)
• latent heat of vaporization(lv)
• covariance wc(cvar_wc)
• covariance vq(cvar_vq)
• CO2 flux(fc)
• specific heat of moist air(cp)
• number of q samples removed due to spikes(n_spk_q)
• covariance uc(cvar_uc)
• number of valid c samples(n_good_c)
• variance of variable c(var_c)
• rotated covariance vc(cvar_rot_vc)
• number of bad or out of range c samples(n_bad_c)
• 0=real or 1=dummy value of mr(real_mr)
• number of valid q samples(n_good_q)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• 0=real or 1=dummy value of rho(real_rho)
• number of c samples removed due to spikes(n_spk_c)
• rotated covariance uc(cvar_rot_uc)
• mean water vapor concentration (q)(mean_q)
• covariance vc(cvar_vc)
• rotated covariance wq(cvar_rot_wq)
• covariance of tc(cvar_tc)
• covariance uq(cvar_uq)
• 0=real or 1=dummy value of lv(real_lv)
• rotated covariance uq(cvar_rot_uq)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• mixing ratio(mr)
• variance of variable q(var_q)
• latent heat flux(lv_e)
• covariance of tq(cvar_tq)
• number of bad or out of range q samples(n_bad_q)
• skewness of variable q(skew_q)
• covariance of qc(cvar_qc)
• covariance wq(cvar_wq)
• 0=real or 1=dummy value of cp(real_cp)
• mean co2 concentration (c)(mean_c)

SGP/ECOR/E10 - Data Missing

Most of the E10 ECOR data was missing for this period due to communication problems.

• kurtosis of variable v(kurt_v)
• covariance vq(cvar_vq)
• specific heat of moist air(cp)
• vector averaged wind speed(wind_spd)
• variance of variable v(var_v)
• Time offset from base_time(base_time)
• standard deviation of wind elevation angle(std_elev)
• rotated covariance ut(cvar_rot_ut)
• variance of variable w(var_w)
• kurtosis of variable q(kurt_q)
• friction velocity(ustar)
• number of valid t samples(n_good_t)
• corrected sensible heat flux(h)
• number of u samples removed due to spikes(n_spk_u)
• mean value of \spike\ w samples(mean_spk_w)
• mean water vapor concentration (q)(mean_q)
• rotated covariance wt(cvar_rot_wt)
• rotated mean w(mean_rot_w)
• kurtosis of variable w(kurt_w)
• vw covariance(cvar_vw)
• skewness of variable v(skew_v)
• 0=real or 1=dummy value of lv(real_lv)
• Down-boom wind velocity (u)(mean_u)
• latent heat flux(lv_e)
• Retrieved water vapor density profile(rho)
• mean sonic temperature (t), i.e. virtual temperature(mean_t)
• covariance wq(cvar_wq)
• number of t samples removed due to spikes(n_spk_t)
• rotated covariance vq(cvar_rot_vq)
• rotated covariance wc(cvar_rot_wc)
• altitude above sea levelaltunits(alt)
• number of samples with bad sonic status flag(n_bad_son_ic)
• vertical (elevation) wind angle(elev)
• number of q samples removed due to spikes(n_spk_q)
• covariance uc(cvar_uc)
• number of valid c samples(n_good_c)
• Cross-boom wind velocity (v)(mean_v)
• kurtosis of variable t(kurt_t)
• number of valid w samples(n_good_w)
• rotated covariance uw(cvar_rot_uw)
• 0=real or 1=dummy value of mr(real_mr)
• number of valid u samples(n_good_u)
• rotated covariance vt(cvar_rot_vt)
• rotated covariance uc(cvar_rot_uc)
• rotated covariance uv(cvar_rot_uv)
• number of valid v samples(n_good_v)
• rotated covariance vw(cvar_rot_vw)
• covariance of tc(cvar_tc)
• variance of variable u(var_u)
• wT covariance(cvar_wt)
• covariance vt(cvar_vt)
• 0=real or 1=dummy value of cp(real_cp)
• number of bad or out of range v samples(n_bad_v)
• skewness of variable c(skew_c)
• latent heat of vaporization(lv)
• covariance wc(cvar_wc)
• CO2 flux(fc)
• variance of variable t(var_t)
• number of bad or out of range u samples(n_bad_u)
• Time offset of tweaks from base_time(time_offset)
• skewness of variable t(skew_t)
• rotated mean v(mean_rot_v)
• number of v samples removed due to spikes(n_spk_v)
• vector averaged wind direction(wind_dir)
• Vertical angle of wind(phi)
• Time offset from midnight of date of file. For CO data, this is identical to
  time_offset and is included for compatibility.(time)
• mean value of \spike\ v samples(mean_spk_v)
• east longitude for all the input platforms.(lon)
• number of bad or out of range c samples(n_bad_c)
• number of w samples removed due to spikes(n_spk_w)
• number of valid q samples(n_good_q)
• number of c samples removed due to spikes(n_spk_c)
• 0=real or 1=dummy value of rho(real_rho)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• mean w (vertical) wind component(mean_w)
• rotated variance w(var_rot_w)
• covariance vc(cvar_vc)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• covariance of tq(cvar_tq)
• number of bad or out of range q samples(n_bad_q)
• skewness of variable q(skew_q)
• kurtosis of variable u(kurt_u)
• covariance of qc(cvar_qc)
• average temperature (IGRA internal sensor)(temp_irga)
• rotated variance v(var_rot_v)
• mean value of \spike\ u samples(mean_spk_u)
• mean co2 concentration (c)(mean_c)
• covariance uv(cvar_uv)
• mean value of out of range values and spikes of t -9999 if no spikes(mean_spk_t)
• number of samples with IRGA optical path blocked flag(n_bad_irga_light)
• number of bad or out of range t samples(n_bad_t)
• mean horizontal wind speed(mean_rot_u)
• variance of variable c(var_c)
• rotated covariance vc(cvar_rot_vc)
• skewness of variable u(skew_u)
• uw covariance(cvar_uw)
• covariance ut(cvar_ut)
• average atmospheric pressure (IGRA internal sensor)(atm_pres)
• north latitude for all the input platforms.(lat)
• skewness of variable w(skew_w)
• rotated covariance wq(cvar_rot_wq)
• momentum flux (dynamic)(k)
• standard deviation of wind direction(std_wind_dir)
• average voltage of IRGA cooler(mean_cooler)
• mixing ratio(mr)
• rotated variance u(var_rot_u)
• variance of variable q(var_q)
• number of bad or out of range w samples(n_bad_w)
• kurtosis of variable c(kurt_c)
• number of samples with \IRGA hardware problem\ flag(n_bad_irga)

SGP/ECOR/E10 - Reprocess: Wind Direction Incorrect

It was discovered that the E10 ECOR boom is aligned 17 degrees to the west of true north.  
Therefore, all wind direction data for the stated period is 17 degrees too high.  
Subtract 17 degrees from the wind direction to give the correct direction.

The E10 configuration file was modified to correct this problem.

• vector averaged wind direction(wind_dir)

SGP/ECOR/E10 - LI-7500 Pressure and Temperature missing

The LI-7500 pressure and temperature were not recorded;
the serial datastream was not being captured by the ECOR.

• average atmospheric pressure (IGRA internal sensor)(atm_pres)
• average temperature (IGRA internal sensor)(temp_irga)