DQRID : D141121.2
Start DateStart TimeEnd DateEnd Time
01/01/2004000005/02/20162359
more
Subject:
SGP/SURFSPECALB/C1 -  Reprocessed and Corrected: Incorrect missing value resulted in 
incorrect data
DataStreams:sgpsurfspecalb1mlawerC1.s1, sgpsurfspecalb1mlawerC1.c1
Description:
DATA REPROCESSED and CORRECTED: 

hese data were reprocessed to fix the problems described below.

One variable in an intermediate datastream (i.e. surfspecalb1mlawer.c0) to this VAP did 
not have a missing_value attribute defined. Variables without a missing_value used 
__FillValue as their missing value. The downstream VAP did not recognize those fill values as 
"bad" and used them in its processing messing up the logic and resulting in no clear days 
being found.

Inability to access the DQR database resulted in a gap in data files for 
20140218-20140419.

The data were archived in August 2016. Please retrieve the reprocessed data for use in 
your analysis.

You may find these data using the ARM Discovery tool at the following link:

http://www.archive.arm.gov/discovery/#v/results/s/finst::surfspecalb/fsite::sgp/ffac::sgp.C1 

ORIGINAL DQR CATEGORY: Red( Incorrect)

REPROCESSED and CORRECTED DATA ARCHIVED:2016-08

REPROCESS IDENTIFICATION NUMBER: RID 1254

---------------------------------------------------
--- ORIGINAL DQR DESCRIPTION ---
---------------------------------------------------


An update to the shared libraries negatively impacted the Value Added Product (VAP) 
because one variable in its intermediate datastream (i.e. surfspecalb1mlawer.c0) did not have a 
missing_value attribute defined. An update to the transformation library made in the 
spring was for variables without a missing_value to use __FillFalue as their missing value. 
In a typically VAP the use of fill values instead of missing would be immediately caught 
by processes that check the output files before shipping to the archive. However, this 
fill value was in an intermediate datastream that is not shipped to the archive, and is 
immediately removed after it is no longer needed. The downstream VAP did not recognize those 
fill values as "bad" and used them in its processing messing up the logic and resulting 
in no clear days being found.
Suggestions: 
Measurements:sgpsurfspecalb1mlawerC1.c1:
  • 25 meter Upwelling Hemispheric Irradiance(up_hemisp_narrowband_mfr25mC1)
  • Estimation status flag for Best estimate Broadband surface albedo at the 10m
    tower(be_surface_albedo_mfr_broadband_10m_status)
  • Best estimate MFR broadband surface albedo at the 10m tower(be_surface_albedo_mfr_broadband_10m)
  • 25 meter Broadband Upwelling Hemispheric Irradiance(up_hemisp_broadband_mfr25mC1)
  • Narrowband Direct Normal Irradiance(direct_normal_narrowband_mfrsrC1)
  • Best estimate Narrowband surface albedo at the 10m tower(be_surface_albedo_mfr_narrowband_10m)
  • Downwelling Shortwave Hemispheric Irradiance for beflux1longC1(down_short_hemisp_beflux1longC1)
  • Hemispheric Broadband Irradiance for mfrsrC1, offset and cosine corrected,
    broadband scale factor applied(hemisp_broadband_mfrsrC1)
  • MFRSR source of hemispheric narrowband irradiance used in calculating
    be_hemisp_narrowband_mfrsr,surface_albedo_mfr_narrowband_10m, and
    surface_albedo_mfr_narrowband_25m(hemisp_narrowband_facility_mfrsr)
  • Broadband albedo at 10m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_10m)
  • Narrowband Diffuse Hemispheric Irradiance(diffuse_hemisp_narrowband_mfrsrE13)
  • Hemispheric Broadband Irradiance for mfrsrE13, offset and cosine corrected,
    broadband scale factor applied(hemisp_broadband_mfrsrE13)
  • Best estimate Best measured hemispheric broadband irradiance from mfrsrC1 and/or
    mfrsrE13(be_hemisp_broadband_mfrsr)
  • Estimation status flag for Best estimate 10 meter narrowband upwelling
    hemispheric irradiance(be_up_hemisp_narrowband_status_mfr10mC1)
  • MFR broadband surface albedo at 25m on the 60m tower(surface_albedo_mfr_broadband_25m)
  • Derived surface type under the 25 tower(surface_type_25m_tower)
  • Best estimate 25 meter hemispheric broadband irradiance(be_up_hemisp_broadband_mfr25mC1)
  • Shortwave Direct Normal Irradiance for beflux1longC1(short_direct_normal_beflux1longC1)
  • Estimation status flag for Best estimate MFR narrowband surface albedo at the
    10m tower(be_surface_albedo_mfr_narrowband_10m_status)
  • Estimation status flag for Best estimate MFR narrowband surface albedo at 25m on
    the 60m tower(be_surface_albedo_mfr_narrowband_25m_status)
  • Narrowband Hemispheric Irradiance(hemisp_narrowband_mfrsrC1)
  • 10 meter Cosine Solar Zenith Angle(cosine_solar_zenith_angle_mfr10mC1)
  • Best estimate Best measured hemispheric narrowband irradiance from mfrsrC1(be_hemisp_narrowband_mfrsr)
  • Direct Normal Broadband Irradiance(direct_normal_broadband_mfrsrE13)
  • Narrowband Diffuse Hemispheric Irradiance for mfrsrC1(diffuse_hemisp_narrowband_mfrsrC1)
  • Best measured hemispheric narrowband irradiance from mfrsrC1 and/or mfrsrE13(hemisp_narrowband_mfrsr)
  • Best measured hemispheric broadband irradiance from MFRSRC1 and/or MFRSRE13(hemisp_broadband_mfrsr)
  • MFRSR source of hemispheric broadband irradiance used in calculating
    be_hemisp_broadband_mfrsr,surface_albedo_mfr_broadband_10m, and
    surface_albedo_mfr_broadband_25m(hemisp_broadband_facility_mfrsr)
  • Upwelling (Best) Shortwave Hemispheric Irradiance(up_short_hemisp_beflux1longC1)
  • MFR narrowband surface albedo at 25m on the 60m tower(surface_albedo_mfr_narrowband_25m)
  • Best estimate Narrowband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_narrowband_25m)
  • PSP broadband surface albedo at the 10m tower
    (up_short_hemisp_qcrad1longC1/down_short_hemisp_qcrad1longC1)(be_surface_albedo_psp_broadband_10m)
  • Best estimate 10 meter narrowband upwelling hemispheric irradiance(be_up_hemisp_narrowband_mfr10mC1)
  • MFR broadband surface albedo at the 10m tower(surface_albedo_mfr_broadband_10m)
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 25m tower(estimated_spectral_albedo_25m)
  • Diffuse Hemispheric Broadband Irradiance for mfrsrC1(diffuse_hemisp_broadband_mfrsrC1)
  • Estimation status flag for Best estimate 10 meter broadband upwelling
    hemispheric irradiance(be_up_hemisp_broadband_status_mfr10mC1)
  • Narrowband Direct Normal Irradiance(direct_normal_narrowband_mfrsrE13)
  • Wavenumber for a given sample time(wavenumber)
  • Estimation status flag for Best estimate Broadband surface albedo at 25m on the
    60m tower(be_surface_albedo_mfr_broadband_25m_status)
  • PSP broadband surface albedo at 25m on the 60m tower
    (up_short_hemisp_irt25mC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_25m)
  • Estimation status flag for Best estimate 25 meter narrowband hemispheric
    irradiance(be_up_hemisp_narrowband_status_mfr25mC1)
  • Best estimate 10 meter broadband upwelling hemispheric irradiance(be_up_hemisp_broadband_mfr10mC1)
  • Estimation status flag for best estimate best measured hemispheric narrowband
    irradiance from mfrsrC1 and/or mfrsrE13(be_hemisp_narrowband_status_mfrsr)
  • Best estimate Broadband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_broadband_25m)
  • Estimation status flag for best estimate best measured hemispheric broadband
    irradiance from MFRSRC1 and/or MFRSRE13(be_hemisp_broadband_status_mfrsr)
  • MFR narrowband surface albedo at the 10m tower(surface_albedo_mfr_narrowband_10m)
  • Broadband albedo at 25m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_25m)
  • Derived surface type under the 10 tower(surface_type_10m_tower)
  • Estimation status flag for Best estimate 25 meter hemispheric broadband
    irradiance(be_up_hemisp_broadband_status_mfr25mC1)
  • Best estimate 25 meter narrowband hemispheric irradiance(be_up_hemisp_narrowband_mfr25mC1)
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 10m tower(estimated_spectral_albedo_10m)
  • 10 meter Broadband Upwelling Hemispheric Irradiance(up_hemisp_broadband_mfr10mC1)
  • null(up_short_hemisp_irt25mC1)
  • Narrowband Hemispheric Irradiance for mfrsrE13(hemisp_narrowband_mfrsrE13)
  • Wavelength of each of the 6 filters measured by the MFR radiometers(filter)
  • Direct Normal Broadband Irradiance for mfrsrC1(direct_normal_broadband_mfrsrC1)
  • Diffuse Hemispheric Broadband Irradiance E13(diffuse_hemisp_broadband_mfrsrE13)
  • Cosine Solar Zenith Angle(cosine_solar_zenith_angle_mfr25mC1)
  • 10 meter Narrowband Upwelling Hemispheric Irradiance(up_hemisp_narrowband_mfr10mC1)
more
sgpsurfspecalb1mlawerC1.s1:
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 25m tower(estimated_spectral_albedo_25m)
  • Estimation status flag for Best estimate Broadband surface albedo at the 10m
    tower(be_surface_albedo_mfr_broadband_10m_status)
  • Estimation status flag for best estimate best measured hemispheric broadband
    irradiance from MFRSRC1 and/or MFRSRE13(be_hemisp_broadband_status_mfrsr)
  • Best estimate Narrowband surface albedo at the 10m tower(be_surface_albedo_mfr_narrowband_10m)
  • Shortwave Direct Normal Irradiance for beflux1longC1(short_direct_normal_beflux1longC1)
  • Estimation status flag for Best estimate 25 meter narrowband hemispheric
    irradiance(be_up_hemisp_narrowband_status_mfr25mC1)
  • Best estimate Broadband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_broadband_25m)
  • Best estimate 25 meter hemispheric broadband irradiance(be_up_hemisp_broadband_mfr25mC1)
  • Downwelling Shortwave Hemispheric Irradiance for beflux1longC1(down_short_hemisp_beflux1longC1)
  • Broadband albedo at 25m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_25m)
  • Wavelength of each of the 6 filters measured by the MFR radiometers(filter)
  • Estimation status flag for Best estimate 10 meter narrowband upwelling
    hemispheric irradiance(be_up_hemisp_narrowband_status_mfr10mC1)
  • MFRSR source of hemispheric broadband irradiance used in calculating
    be_hemisp_broadband_mfrsr,surface_albedo_mfr_broadband_10m, and
    surface_albedo_mfr_broadband_25m(hemisp_broadband_facility_mfrsr)
  • Best estimate Best measured hemispheric narrowband irradiance from mfrsrC1(be_hemisp_narrowband_mfrsr)
  • Best estimate Best measured hemispheric broadband irradiance from mfrsrC1 and/or
    mfrsrE13(be_hemisp_broadband_mfrsr)
  • Derived surface type under the 25 tower(surface_type_25m_tower)
  • PSP broadband surface albedo at the 10m tower
    (up_short_hemisp_qcrad1longC1/down_short_hemisp_qcrad1longC1)(be_surface_albedo_psp_broadband_10m)
  • Best estimate 25 meter narrowband hemispheric irradiance(be_up_hemisp_narrowband_mfr25mC1)
  • Cosine Solar Zenith Angle(cosine_solar_zenith_angle_mfr25mC1)
  • Upwelling (Best) Shortwave Hemispheric Irradiance(up_short_hemisp_beflux1longC1)
  • Estimation status flag for Best estimate Broadband surface albedo at 25m on the
    60m tower(be_surface_albedo_mfr_broadband_25m_status)
  • Estimation status flag for Best estimate 10 meter broadband upwelling
    hemispheric irradiance(be_up_hemisp_broadband_status_mfr10mC1)
  • Derived surface type under the 10 tower(surface_type_10m_tower)
  • Broadband albedo at 10m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_10m)
  • MFRSR source of hemispheric narrowband irradiance used in calculating
    be_hemisp_narrowband_mfrsr,surface_albedo_mfr_narrowband_10m, and
    surface_albedo_mfr_narrowband_25m(hemisp_narrowband_facility_mfrsr)
  • Best estimate Narrowband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_narrowband_25m)
  • Estimation status flag for best estimate best measured hemispheric narrowband
    irradiance from mfrsrC1 and/or mfrsrE13(be_hemisp_narrowband_status_mfrsr)
  • Best estimate 10 meter broadband upwelling hemispheric irradiance(be_up_hemisp_broadband_mfr10mC1)
  • null(up_short_hemisp_irt25mC1)
  • Best estimate MFR broadband surface albedo at the 10m tower(be_surface_albedo_mfr_broadband_10m)
  • PSP broadband surface albedo at 25m on the 60m tower
    (up_short_hemisp_irt25mC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_25m)
  • Estimation status flag for Best estimate MFR narrowband surface albedo at 25m on
    the 60m tower(be_surface_albedo_mfr_narrowband_25m_status)
  • Estimation status flag for Best estimate MFR narrowband surface albedo at the
    10m tower(be_surface_albedo_mfr_narrowband_10m_status)
  • Wavenumber for a given sample time(wavenumber)
  • 10 meter Cosine Solar Zenith Angle(cosine_solar_zenith_angle_mfr10mC1)
  • Best estimate 10 meter narrowband upwelling hemispheric irradiance(be_up_hemisp_narrowband_mfr10mC1)
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 10m tower(estimated_spectral_albedo_10m)
  • Estimation status flag for Best estimate 25 meter hemispheric broadband
    irradiance(be_up_hemisp_broadband_status_mfr25mC1)
more

Close this window