Data Quality Reports for Session: 181771 User: dattam1 Completed: 11/29/2016


TABLE OF CONTENTS

DQR IDSubjectData Streams Affected Data Quality Metric
D130725.2SGP/SURFSPECALB/C1 - Data processing problemsgpsurfspecalb1mlawerC1.s1Does not affect quality
D140923.1SGP/SURFSPECALB/C1 - Value Added Product errorsgpsurfspecalb1mlawerC1.s1Does not affect quality
D141114.1SGP/SURFSPECALB/C1 - Reprocessed and Corrected: A gap in data filessgpsurfspecalb1mlawerC1.s1Does not affect quality
D141121.2SGP/SURFSPECALB/C1 - Reprocessed and Corrected: Incorrect missing value resulted in
incorrect data
sgpsurfspecalb1mlawerC1.s1Does not affect quality


DQRID : D130725.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/01/2004000001/26/20130000Does not affect quality
Subject:
SGP/SURFSPECALB/C1 - Data processing problem
DataStreams:sgpsurfspecalb1mlawerC1.s1
Description:
An intermediate process, surfspecalb_transform, of the surfspecalb1mlawer VAP incorrectly 
treated its input datastream (intermediate datastream surfspecalbmfrsr.c0) as it had a 
bin alignment equal to the end of the bin, but it was actually the middle of the bin.  The 
result was a shifting of the values with respect to time 10 seconds to the left.  The 
impact on the primary measurement, spectral albedo, was considered to be less than the 
uncertainty of that measurement.

The problem occurs for all measurements dimensioned by time.
Measurements:sgpsurfspecalb1mlawerC1.s1:
  • time_offset
  • Best estimate MFR narrowband surface albedo at the 10m tower(be_surface_albedo_mfr_narrowband_10m)
  • be_up_hemisp_narrowband_mfr10mC1
  • Broadband albedo at 10m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_10m)
  • be_hemisp_narrowband_mfrsr
  • up_short_hemisp_beflux1longC1
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 10m tower(estimated_spectral_albedo_10m)
  • hemisp_narrowband_facility_mfrsr
  • up_short_hemisp_irt25mC1
  • be_hemisp_narrowband_status_mfrsr
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 25m tower(estimated_spectral_albedo_25m)
  • Best estimate MFR broadband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_broadband_25m)
  • Best estimate Narrowband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_narrowband_25m)
  • cosine_solar_zenith_angle_mfr10mC1
  • be_surface_albedo_mfr_broadband_10m_status
  • time
  • be_up_hemisp_narrowband_mfr25mC1
  • be_up_hemisp_narrowband_status_mfr10mC1
  • be_surface_albedo_mfr_broadband_25m_status
  • be_up_hemisp_narrowband_status_mfr25mC1
  • be_surface_albedo_mfr_narrowband_25m_status
  • be_up_hemisp_broadband_status_mfr25mC1
  • cosine_solar_zenith_angle_mfr25mC1
  • be_hemisp_broadband_status_mfrsr
  • be_surface_albedo_mfr_narrowband_10m_status
  • down_short_hemisp_beflux1longC1
  • short_direct_normal_beflux1longC1
  • PSP broadband surface albedo at the 10m tower
    (up_short_hemisp_beflux1longC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_10m)
  • hemisp_broadband_facility_mfrsr
  • be_up_hemisp_broadband_mfr10mC1
  • be_hemisp_broadband_mfrsr
  • be_up_hemisp_broadband_mfr25mC1
  • Best estimate Broadband surface albedo at the 10m tower(be_surface_albedo_mfr_broadband_10m)
  • PSP broadband surface albedo at 25m on the 60m tower
    (up_short_hemisp_irt25mC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_25m)
  • base_time
  • be_up_hemisp_broadband_status_mfr10mC1
  • Broadband albedo at 25m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_25m)


Back To Table of Contents

DQRID : D140923.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/25/2013000107/11/20142359Does not affect quality
Subject:
SGP/SURFSPECALB/C1 - Value Added Product error
DataStreams:sgpsurfspecalb1mlawerC1.s1
Description:
The configuration files needed to perform the transformations correctly were not released 
with the updated software. As a result the data is not as accurate as it could be because 
the alignment of the averaged data was assumed to be center of the averaging bin, but 
some instances exist where the averaging alignment was not at the center of the bin.  This 
data product averages the input over a five minute period, and then an additional 
transformation is applied to a longer time interval later in the process. The impact on this 
data is minor and expected to be under the uncertainty associated with the methods applied.  
This processing difference should not affect the use of the data.
Measurements:sgpsurfspecalb1mlawerC1.s1:
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 10m tower(estimated_spectral_albedo_10m)
  • short_direct_normal_beflux1longC1
  • Derived surface type under the 10 tower(surface_type_10m_tower)
  • PSP broadband surface albedo at the 10m tower
    (up_short_hemisp_beflux1longC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_10m)
  • up_short_hemisp_irt25mC1
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 25m tower(estimated_spectral_albedo_25m)
  • Broadband albedo at 10m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_10m)
  • down_short_hemisp_beflux1longC1
  • PSP broadband surface albedo at 25m on the 60m tower
    (up_short_hemisp_irt25mC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_25m)
  • up_short_hemisp_beflux1longC1
  • Derived surface type under the 25 tower(surface_type_25m_tower)
  • Broadband albedo at 25m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_25m)


Back To Table of Contents

DQRID : D141114.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/01/2004000005/02/20162359Does not affect quality
Subject:
SGP/SURFSPECALB/C1 - Reprocessed and Corrected: A gap in data files
DataStreams:sgpsurfspecalb1mlawerC1.s1
Description:
DATA REPROCESSED and CORRECTED: 


These data were reprocessed to fix the problems described below.

One variable in an intermediate datastream (i.e. surfspecalb1mlawer.c0) to this VAP did 
not have a missing_value attribute defined. Variables without a missing_value used 
__FillValue as their missing value. The downstream VAP did not recognize those fill values as 
"bad" and used them in its processing messing up the logic and resulting in no clear days 
being found.

Inability to access the DQR database resulted in a gap in data files for 
20140218-20140419.

The data were archived in August 2016. Please retrieve the reprocessed data for use in 
your analysis.

You may find these data using the ARM Discovery tool at the following link:

http://www.archive.arm.gov/discovery/#v/results/s/finst::surfspecalb/fsite::sgp/ffac::sgp.C1


ORIGINAL DQR CATEGORY: black( Missing)

REPROCESSED and CORRECTED DATA ARCHIVED:2016-08

REPROCESS IDENTIFICATION NUMBER: RID 1259

---------------------------------------------------
--- ORIGINAL DQR DESCRIPTION ---
---------------------------------------------------


There is no data for the indicated period due to inability to access the DQR database.
Measurements:sgpsurfspecalb1mlawerC1.s1:
  • time_offset
  • East longitude(lon)
  • Best estimate MFR narrowband surface albedo at the 10m tower(be_surface_albedo_mfr_narrowband_10m)
  • be_up_hemisp_narrowband_mfr10mC1
  • Broadband albedo at 10m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_10m)
  • be_hemisp_narrowband_mfrsr
  • up_short_hemisp_beflux1longC1
  • Derived surface type under the 25 tower(surface_type_25m_tower)
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 10m tower(estimated_spectral_albedo_10m)
  • hemisp_narrowband_facility_mfrsr
  • up_short_hemisp_irt25mC1
  • be_hemisp_narrowband_status_mfrsr
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 25m tower(estimated_spectral_albedo_25m)
  • Best estimate MFR broadband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_broadband_25m)
  • Best estimate Narrowband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_narrowband_25m)
  • cosine_solar_zenith_angle_mfr10mC1
  • be_surface_albedo_mfr_broadband_10m_status
  • time
  • be_up_hemisp_narrowband_mfr25mC1
  • be_up_hemisp_narrowband_status_mfr10mC1
  • be_surface_albedo_mfr_broadband_25m_status
  • be_up_hemisp_narrowband_status_mfr25mC1
  • Derived surface type under the 10 tower(surface_type_10m_tower)
  • be_surface_albedo_mfr_narrowband_25m_status
  • be_up_hemisp_broadband_status_mfr25mC1
  • cosine_solar_zenith_angle_mfr25mC1
  • be_hemisp_broadband_status_mfrsr
  • be_surface_albedo_mfr_narrowband_10m_status
  • wavenumber
  • down_short_hemisp_beflux1longC1
  • filter
  • short_direct_normal_beflux1longC1
  • PSP broadband surface albedo at the 10m tower
    (up_short_hemisp_beflux1longC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_10m)
  • Altitude above mean sea level(alt)
  • hemisp_broadband_facility_mfrsr
  • be_up_hemisp_broadband_mfr10mC1
  • be_hemisp_broadband_mfrsr
  • be_up_hemisp_broadband_mfr25mC1
  • Best estimate Broadband surface albedo at the 10m tower(be_surface_albedo_mfr_broadband_10m)
  • PSP broadband surface albedo at 25m on the 60m tower
    (up_short_hemisp_irt25mC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_25m)
  • base_time
  • be_up_hemisp_broadband_status_mfr10mC1
  • Broadband albedo at 25m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_25m)
  • North latitude(lat)


Back To Table of Contents

DQRID : D141121.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/01/2004000005/02/20162359Does not affect quality
Subject:
SGP/SURFSPECALB/C1 -  Reprocessed and Corrected: Incorrect missing value resulted in 
incorrect data
DataStreams:sgpsurfspecalb1mlawerC1.s1
Description:
DATA REPROCESSED and CORRECTED: 

hese data were reprocessed to fix the problems described below.

One variable in an intermediate datastream (i.e. surfspecalb1mlawer.c0) to this VAP did 
not have a missing_value attribute defined. Variables without a missing_value used 
__FillValue as their missing value. The downstream VAP did not recognize those fill values as 
"bad" and used them in its processing messing up the logic and resulting in no clear days 
being found.

Inability to access the DQR database resulted in a gap in data files for 
20140218-20140419.

The data were archived in August 2016. Please retrieve the reprocessed data for use in 
your analysis.

You may find these data using the ARM Discovery tool at the following link:

http://www.archive.arm.gov/discovery/#v/results/s/finst::surfspecalb/fsite::sgp/ffac::sgp.C1 

ORIGINAL DQR CATEGORY: Red( Incorrect)

REPROCESSED and CORRECTED DATA ARCHIVED:2016-08

REPROCESS IDENTIFICATION NUMBER: RID 1254

---------------------------------------------------
--- ORIGINAL DQR DESCRIPTION ---
---------------------------------------------------


An update to the shared libraries negatively impacted the Value Added Product (VAP) 
because one variable in its intermediate datastream (i.e. surfspecalb1mlawer.c0) did not have a 
missing_value attribute defined. An update to the transformation library made in the 
spring was for variables without a missing_value to use __FillFalue as their missing value. 
In a typically VAP the use of fill values instead of missing would be immediately caught 
by processes that check the output files before shipping to the archive. However, this 
fill value was in an intermediate datastream that is not shipped to the archive, and is 
immediately removed after it is no longer needed. The downstream VAP did not recognize those 
fill values as "bad" and used them in its processing messing up the logic and resulting 
in no clear days being found.
Measurements:sgpsurfspecalb1mlawerC1.s1:
  • Best estimate MFR narrowband surface albedo at the 10m tower(be_surface_albedo_mfr_narrowband_10m)
  • be_up_hemisp_narrowband_mfr10mC1
  • Broadband albedo at 10m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_10m)
  • be_hemisp_narrowband_mfrsr
  • up_short_hemisp_beflux1longC1
  • Derived surface type under the 25 tower(surface_type_25m_tower)
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 10m tower(estimated_spectral_albedo_10m)
  • hemisp_narrowband_facility_mfrsr
  • up_short_hemisp_irt25mC1
  • be_hemisp_narrowband_status_mfrsr
  • Spectral albedo estimated from mfr albedos using surface type and Mlawer
    algorithm at 25m tower(estimated_spectral_albedo_25m)
  • Best estimate MFR broadband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_broadband_25m)
  • Best estimate Narrowband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_narrowband_25m)
  • cosine_solar_zenith_angle_mfr10mC1
  • be_surface_albedo_mfr_broadband_10m_status
  • be_up_hemisp_narrowband_mfr25mC1
  • be_up_hemisp_narrowband_status_mfr10mC1
  • be_surface_albedo_mfr_broadband_25m_status
  • be_up_hemisp_narrowband_status_mfr25mC1
  • Derived surface type under the 10 tower(surface_type_10m_tower)
  • be_surface_albedo_mfr_narrowband_25m_status
  • be_up_hemisp_broadband_status_mfr25mC1
  • cosine_solar_zenith_angle_mfr25mC1
  • be_hemisp_broadband_status_mfrsr
  • be_surface_albedo_mfr_narrowband_10m_status
  • wavenumber
  • down_short_hemisp_beflux1longC1
  • filter
  • short_direct_normal_beflux1longC1
  • PSP broadband surface albedo at the 10m tower
    (up_short_hemisp_beflux1longC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_10m)
  • hemisp_broadband_facility_mfrsr
  • be_up_hemisp_broadband_mfr10mC1
  • be_hemisp_broadband_mfrsr
  • be_up_hemisp_broadband_mfr25mC1
  • Best estimate Broadband surface albedo at the 10m tower(be_surface_albedo_mfr_broadband_10m)
  • PSP broadband surface albedo at 25m on the 60m tower
    (up_short_hemisp_irt25mC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_25m)
  • be_up_hemisp_broadband_status_mfr10mC1
  • Broadband albedo at 25m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_25m)


Back To Table of Contents



END OF DATA