DQRID : D141121.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/01/2004000005/02/20162359Does not affect quality
more
Subject:
SGP/SURFSPECALB/C1 -  Reprocessed and Corrected: Incorrect missing value resulted in 
incorrect data
DataStreams:sgpsurfspecalb1mlawerC1.s1, sgpsurfspecalb1mlawerC1.c1
Description:
DATA REPROCESSED and CORRECTED: 

hese data were reprocessed to fix the problems described below.

One variable in an intermediate datastream (i.e. surfspecalb1mlawer.c0) to this VAP did 
not have a missing_value attribute defined. Variables without a missing_value used 
__FillValue as their missing value. The downstream VAP did not recognize those fill values as 
"bad" and used them in its processing messing up the logic and resulting in no clear days 
being found.

Inability to access the DQR database resulted in a gap in data files for 
20140218-20140419.

The data were archived in August 2016. Please retrieve the reprocessed data for use in 
your analysis.

You may find these data using the ARM Discovery tool at the following link:

http://www.archive.arm.gov/discovery/#v/results/s/finst::surfspecalb/fsite::sgp/ffac::sgp.C1 

ORIGINAL DQR CATEGORY: Red( Incorrect)

REPROCESSED and CORRECTED DATA ARCHIVED:2016-08

REPROCESS IDENTIFICATION NUMBER: RID 1254

---------------------------------------------------
--- ORIGINAL DQR DESCRIPTION ---
---------------------------------------------------


An update to the shared libraries negatively impacted the Value Added Product (VAP) 
because one variable in its intermediate datastream (i.e. surfspecalb1mlawer.c0) did not have a 
missing_value attribute defined. An update to the transformation library made in the 
spring was for variables without a missing_value to use __FillFalue as their missing value. 
In a typically VAP the use of fill values instead of missing would be immediately caught 
by processes that check the output files before shipping to the archive. However, this 
fill value was in an intermediate datastream that is not shipped to the archive, and is 
immediately removed after it is no longer needed. The downstream VAP did not recognize those 
fill values as "bad" and used them in its processing messing up the logic and resulting 
in no clear days being found.
Suggestions: 
Measurements:sgpsurfspecalb1mlawerC1.c1:
  • up_hemisp_narrowband_mfr25mC1
  • be_surface_albedo_mfr_broadband_10m_status
  • be_surface_albedo_mfr_broadband_10m
  • up_hemisp_broadband_mfr25mC1
  • direct_normal_narrowband_mfrsrC1
  • be_surface_albedo_mfr_narrowband_10m
  • down_short_hemisp_beflux1longC1
  • hemisp_broadband_mfrsrC1
  • hemisp_narrowband_facility_mfrsr
  • broadband_from_spectral_albedo_10m
  • diffuse_hemisp_narrowband_mfrsrE13
  • hemisp_broadband_mfrsrE13
  • be_hemisp_broadband_mfrsr
  • be_up_hemisp_narrowband_status_mfr10mC1
  • surface_albedo_mfr_broadband_25m
  • surface_type_25m_tower
  • be_up_hemisp_broadband_mfr25mC1
  • short_direct_normal_beflux1longC1
  • be_surface_albedo_mfr_narrowband_10m_status
  • be_surface_albedo_mfr_narrowband_25m_status
  • hemisp_narrowband_mfrsrC1
  • cosine_solar_zenith_angle_mfr10mC1
  • be_hemisp_narrowband_mfrsr
  • direct_normal_broadband_mfrsrE13
  • diffuse_hemisp_narrowband_mfrsrC1
  • hemisp_narrowband_mfrsr
  • hemisp_broadband_mfrsr
  • hemisp_broadband_facility_mfrsr
  • up_short_hemisp_beflux1longC1
  • surface_albedo_mfr_narrowband_25m
  • be_surface_albedo_mfr_narrowband_25m
  • be_surface_albedo_psp_broadband_10m
  • be_up_hemisp_narrowband_mfr10mC1
  • surface_albedo_mfr_broadband_10m
  • estimated_spectral_albedo_25m
  • diffuse_hemisp_broadband_mfrsrC1
  • be_up_hemisp_broadband_status_mfr10mC1
  • direct_normal_narrowband_mfrsrE13
  • wavenumber
  • be_surface_albedo_mfr_broadband_25m_status
  • be_surface_albedo_psp_broadband_25m
  • be_up_hemisp_narrowband_status_mfr25mC1
  • be_up_hemisp_broadband_mfr10mC1
  • be_hemisp_narrowband_status_mfrsr
  • be_surface_albedo_mfr_broadband_25m
  • be_hemisp_broadband_status_mfrsr
  • surface_albedo_mfr_narrowband_10m
  • broadband_from_spectral_albedo_25m
  • surface_type_10m_tower
  • be_up_hemisp_broadband_status_mfr25mC1
  • be_up_hemisp_narrowband_mfr25mC1
  • estimated_spectral_albedo_10m
  • up_hemisp_broadband_mfr10mC1
  • up_short_hemisp_irt25mC1
  • hemisp_narrowband_mfrsrE13
  • filter
  • direct_normal_broadband_mfrsrC1
  • diffuse_hemisp_broadband_mfrsrE13
  • cosine_solar_zenith_angle_mfr25mC1
  • up_hemisp_narrowband_mfr10mC1
more
sgpsurfspecalb1mlawerC1.s1:
  • estimated_spectral_albedo_25m
  • be_surface_albedo_mfr_broadband_10m_status
  • be_hemisp_broadband_status_mfrsr
  • be_surface_albedo_mfr_narrowband_10m
  • short_direct_normal_beflux1longC1
  • be_up_hemisp_narrowband_status_mfr25mC1
  • be_surface_albedo_mfr_broadband_25m
  • be_up_hemisp_broadband_mfr25mC1
  • down_short_hemisp_beflux1longC1
  • broadband_from_spectral_albedo_25m
  • filter
  • be_up_hemisp_narrowband_status_mfr10mC1
  • hemisp_broadband_facility_mfrsr
  • be_hemisp_narrowband_mfrsr
  • be_hemisp_broadband_mfrsr
  • surface_type_25m_tower
  • be_surface_albedo_psp_broadband_10m
  • be_up_hemisp_narrowband_mfr25mC1
  • cosine_solar_zenith_angle_mfr25mC1
  • up_short_hemisp_beflux1longC1
  • be_surface_albedo_mfr_broadband_25m_status
  • be_up_hemisp_broadband_status_mfr10mC1
  • surface_type_10m_tower
  • broadband_from_spectral_albedo_10m
  • hemisp_narrowband_facility_mfrsr
  • be_surface_albedo_mfr_narrowband_25m
  • be_hemisp_narrowband_status_mfrsr
  • be_up_hemisp_broadband_mfr10mC1
  • up_short_hemisp_irt25mC1
  • be_surface_albedo_mfr_broadband_10m
  • be_surface_albedo_psp_broadband_25m
  • be_surface_albedo_mfr_narrowband_25m_status
  • be_surface_albedo_mfr_narrowband_10m_status
  • wavenumber
  • cosine_solar_zenith_angle_mfr10mC1
  • be_up_hemisp_narrowband_mfr10mC1
  • estimated_spectral_albedo_10m
  • be_up_hemisp_broadband_status_mfr25mC1
more

Close this window