DQR ID | Subject | Data Streams Affected | Data Quality Metric |
---|---|---|---|
D130725.2 | SGP/SURFSPECALB/C1 - Data processing problem | sgpsurfspecalb1mlawerC1.s1 | Does not affect quality |
D140923.1 | SGP/SURFSPECALB/C1 - Value Added Product error | sgpsurfspecalb1mlawerC1.s1 | Does not affect quality |
D141114.1 | SGP/SURFSPECALB/C1 - Reprocessed and Corrected: A gap in data files | sgpsurfspecalb1mlawerC1.s1 | Does not affect quality |
D141121.2 | SGP/SURFSPECALB/C1 - Reprocessed and Corrected: Incorrect missing value resulted in incorrect data | sgpsurfspecalb1mlawerC1.s1 | Does not affect quality |
Start Date | Start Time | End Date | End Time | Data Quality Metric |
---|---|---|---|---|
01/01/2004 | 0000 | 01/26/2013 | 0000 | Does not affect quality |
Subject: | SGP/SURFSPECALB/C1 - Data processing problem |
DataStreams: | sgpsurfspecalb1mlawerC1.s1 |
Description: | An intermediate process, surfspecalb_transform, of the surfspecalb1mlawer VAP incorrectly treated its input datastream (intermediate datastream surfspecalbmfrsr.c0) as it had a bin alignment equal to the end of the bin, but it was actually the middle of the bin. The result was a shifting of the values with respect to time 10 seconds to the left. The impact on the primary measurement, spectral albedo, was considered to be less than the uncertainty of that measurement. The problem occurs for all measurements dimensioned by time. |
Measurements: | sgpsurfspecalb1mlawerC1.s1:
|
Start Date | Start Time | End Date | End Time | Data Quality Metric |
---|---|---|---|---|
01/25/2013 | 0001 | 07/11/2014 | 2359 | Does not affect quality |
Subject: | SGP/SURFSPECALB/C1 - Value Added Product error |
DataStreams: | sgpsurfspecalb1mlawerC1.s1 |
Description: | The configuration files needed to perform the transformations correctly were not released with the updated software. As a result the data is not as accurate as it could be because the alignment of the averaged data was assumed to be center of the averaging bin, but some instances exist where the averaging alignment was not at the center of the bin. This data product averages the input over a five minute period, and then an additional transformation is applied to a longer time interval later in the process. The impact on this data is minor and expected to be under the uncertainty associated with the methods applied. This processing difference should not affect the use of the data. |
Measurements: | sgpsurfspecalb1mlawerC1.s1:
|
Start Date | Start Time | End Date | End Time | Data Quality Metric |
---|---|---|---|---|
01/01/2004 | 0000 | 05/02/2016 | 2359 | Does not affect quality |
Subject: | SGP/SURFSPECALB/C1 - Reprocessed and Corrected: A gap in data files |
DataStreams: | sgpsurfspecalb1mlawerC1.s1 |
Description: | DATA REPROCESSED and CORRECTED: These data were reprocessed to fix the problems described below. One variable in an intermediate datastream (i.e. surfspecalb1mlawer.c0) to this VAP did not have a missing_value attribute defined. Variables without a missing_value used __FillValue as their missing value. The downstream VAP did not recognize those fill values as "bad" and used them in its processing messing up the logic and resulting in no clear days being found. Inability to access the DQR database resulted in a gap in data files for 20140218-20140419. The data were archived in August 2016. Please retrieve the reprocessed data for use in your analysis. You may find these data using the ARM Discovery tool at the following link: http://www.archive.arm.gov/discovery/#v/results/s/finst::surfspecalb/fsite::sgp/ffac::sgp.C1 ORIGINAL DQR CATEGORY: black( Missing) REPROCESSED and CORRECTED DATA ARCHIVED:2016-08 REPROCESS IDENTIFICATION NUMBER: RID 1259 --------------------------------------------------- --- ORIGINAL DQR DESCRIPTION --- --------------------------------------------------- There is no data for the indicated period due to inability to access the DQR database. |
Measurements: | sgpsurfspecalb1mlawerC1.s1:
|
Start Date | Start Time | End Date | End Time | Data Quality Metric |
---|---|---|---|---|
01/01/2004 | 0000 | 05/02/2016 | 2359 | Does not affect quality |
Subject: | SGP/SURFSPECALB/C1 - Reprocessed and Corrected: Incorrect missing value resulted in |
DataStreams: | sgpsurfspecalb1mlawerC1.s1 |
Description: | DATA REPROCESSED and CORRECTED: hese data were reprocessed to fix the problems described below. One variable in an intermediate datastream (i.e. surfspecalb1mlawer.c0) to this VAP did not have a missing_value attribute defined. Variables without a missing_value used __FillValue as their missing value. The downstream VAP did not recognize those fill values as "bad" and used them in its processing messing up the logic and resulting in no clear days being found. Inability to access the DQR database resulted in a gap in data files for 20140218-20140419. The data were archived in August 2016. Please retrieve the reprocessed data for use in your analysis. You may find these data using the ARM Discovery tool at the following link: http://www.archive.arm.gov/discovery/#v/results/s/finst::surfspecalb/fsite::sgp/ffac::sgp.C1 ORIGINAL DQR CATEGORY: Red( Incorrect) REPROCESSED and CORRECTED DATA ARCHIVED:2016-08 REPROCESS IDENTIFICATION NUMBER: RID 1254 --------------------------------------------------- --- ORIGINAL DQR DESCRIPTION --- --------------------------------------------------- An update to the shared libraries negatively impacted the Value Added Product (VAP) because one variable in its intermediate datastream (i.e. surfspecalb1mlawer.c0) did not have a missing_value attribute defined. An update to the transformation library made in the spring was for variables without a missing_value to use __FillFalue as their missing value. In a typically VAP the use of fill values instead of missing would be immediately caught by processes that check the output files before shipping to the archive. However, this fill value was in an intermediate datastream that is not shipped to the archive, and is immediately removed after it is no longer needed. The downstream VAP did not recognize those fill values as "bad" and used them in its processing messing up the logic and resulting in no clear days being found. |
Measurements: | sgpsurfspecalb1mlawerC1.s1:
|