Data Quality Reports for Session: 184190 User: ninga1 Completed: 03/11/2017


TABLE OF CONTENTS

DQR IDSubjectData Streams Affected Data Quality Metric
D020426.6SGP/TSI/C1 - sampling rate changesgptsiskycoverC1.b1Does not affect quality
D030130.3SGP/TSI/C1 - Metadata Errors in NetCDF HeadersgptsiskycoverC1.b1Does not affect quality
D031218.1SGP/TSI/C1 - Shadowband misalignedsgptsiskycoverC1.b1Suspect
D040526.1SGP/TSI/C1 - Metadata errorssgptsiskycoverC1.b1Does not affect quality
D041116.2SGP/TSI/C1 - Shadowband MisalignmentsgptsiskycoverC1.b1Suspect
D050321.2SGP/TSI/C1 - Instrument failuresgptsiskycoverC1.b1Missing
D050928.8SGP/TSI/C1 - Heater problemsgptsiskycoverC1.b1Suspect
D080411.2SGP/TSI/C1 - Missing datasgptsiskycoverC1.b1Missing
D080414.2SGP/TSI/C1 - Contamination of mirrorsgptsiskycoverC1.b1Suspect
D111006.5SGP/TSI/C1 - Ingest ProblemsgptsiskycoverC1.b1Does not affect quality
D121016.4SGP/TSI/C1 - Water on lenssgptsiskycoverC1.b1Suspect
D130423.8SGP/TSI/C1 - Mirror contaminationsgptsiskycoverC1.b1Suspect
D130701.1SGP/TSI/C1 - Data processing problemsgptsiskycoverC1.b1Does not affect quality
D130802.1SGP/TSI/C1 - Reprocessing Notice (RID 951)sgptsiskycoverC1.b1Does not affect quality
D140204.2SGP/TSI/C1 - Camera misalignmentsgptsiskycoverC1.b1Suspect
D140317.3SGP/TSI/C1 - Shadowband misalignmentsgptsiskycoverC1.b1Suspect
D151223.1SGP/TSI/C1 - Icing eventsgptsiskycoverC1.b1Suspect
D160105.2SGP/TSI/C1 - Ice stormsgptsiskycoverC1.b1Suspect
D160105.3SGP/TSI/C1 - power failuresgptsiskycoverC1.b1Missing
D161005.3SGP/TSI/C1 - Reprocess: Corrupt properties filesgptsiskycoverC1.b1Incorrect
D170228.1SGP/TSI/C1 - Reprocess: Global attribute units incorrect for cam_mir_distsgptsiskycoverC1.b1Incorrect


DQRID : D020426.6
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/02/2000003504/26/20020018Does not affect quality
Subject:
SGP/TSI/C1 - sampling rate change
DataStreams:sgptsiskycoverC1.b1
Description:
SGP TSI-880 sampling rate changed from 20-second to
30-second at 20020426.001900 UTC (20020425.1819 SGP
CF local time) per ECR-00226 and BCR-00491.

This change brings all ARM TSIs to the same operational
sampling rate.  Daily SGP TSI data volume will decrease
by about 1/3 due to this change.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count.opaque
  • solar.altitude
  • count.mask
  • region.zenith.count.thin
  • region.zenith.count
  • count.unknown
  • count.sub.proczen
  • North latitude(lat)
  • region.zenith.count.opaque
  • count.sky
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count.thin
  • East longitude(lon)
  • solar.azimuth
  • region.horizon.count
  • region.horizon.count.thin
  • count.sub.horz
  • Altitude above mean sea level(alt)
  • Cloud amount, thin (percent)(percent.thin)
  • count.thin
  • base_time
  • Sunshine Meter(sunny)
  • region.sun.count
  • count.box
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • time_offset


Back To Table of Contents

DQRID : D030130.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/02/2000003501/21/20032359Does not affect quality
Subject:
SGP/TSI/C1 - Metadata Errors in NetCDF Header
DataStreams:sgptsiskycoverC1.b1
Description:
The value of "sample_int" reported in the netCDF header is
incorrect.  The correct sampling interval is 30 seconds.

The maximum values for the variable "sunny" is incorrect.  
It should be 1, not 100 as documented in the netCDF header. 
Users should disregard the "qc_sunny" flag during this
period of time and apply their own qc check if desired.

The minimum value for the variable "solar.altitude" is
incorrect. It should be -90, not 10 as documented in the
netCDF header.  Users should disregard the "qc_solar.altitude"
flag during this period of time and apply their own qc check
if desired.
Measurements:sgptsiskycoverC1.b1:
  • Sunshine Meter(sunny)
  • solar.altitude
  • time_offset


Back To Table of Contents

DQRID : D031218.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
06/25/2003184007/05/20031523Suspect
Subject:
SGP/TSI/C1 - Shadowband misaligned
DataStreams:sgptsiskycoverC1.b1
Description:
The shadowband and mask were initially misaligned after the re-installation of the TSI.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count
  • region.horizon.count.opaque
  • count.sub.horz
  • region.horizon.count.thin
  • count.mask
  • region.zenith.count.thin
  • region.zenith.count
  • count.unknown
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • count.sub.proczen
  • region.zenith.count.opaque
  • count.sky
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count
  • region.sun.count.thin
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.box


Back To Table of Contents

DQRID : D040526.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/02/2000003505/05/20032359Does not affect quality
Subject:
SGP/TSI/C1 - Metadata errors
DataStreams:sgptsiskycoverC1.b1
Description:
The latitude, longitude and altitude of the Total Sky Imager 
(TSI) were incorrectly entered into the ARM database.  The 
correct location of the SGP.C1 TSI is:
   Lat: 36.606N
   Lon: 97.485W
   Alt:    316m
Measurements:sgptsiskycoverC1.b1:
  • East longitude(lon)
  • Altitude above mean sea level(alt)
  • North latitude(lat)


Back To Table of Contents

DQRID : D041116.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
10/25/2004164011/16/20042232Suspect
Subject:
SGP/TSI/C1 - Shadowband Misalignment
DataStreams:sgptsiskycoverC1.b1
Description:
The shadowband was slightly misaligned and was corrected by adjusting it +2 degrees.
Measurements:sgptsiskycoverC1.b1:
  • count.sky
  • count.opaque
  • region.sun.count.opaque
  • region.sun.count
  • region.sun.count.thin
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.mask
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • count.sub.proczen


Back To Table of Contents

DQRID : D050321.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/17/2005192504/05/20051630Missing
Subject:
SGP/TSI/C1 - Instrument failure
DataStreams:sgptsiskycoverC1.b1
Description:
The TSI-880 experienced a power and/or computer failure. It was replaced with a spare 
TSI-440 and data collection resumed 4/5/05.  Note: this is a temporary replacement.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count.opaque
  • solar.altitude
  • count.mask
  • region.zenith.count.thin
  • region.zenith.count
  • count.unknown
  • count.sub.proczen
  • North latitude(lat)
  • region.zenith.count.opaque
  • count.sky
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count.thin
  • East longitude(lon)
  • solar.azimuth
  • region.horizon.count
  • region.horizon.count.thin
  • count.sub.horz
  • Altitude above mean sea level(alt)
  • Cloud amount, thin (percent)(percent.thin)
  • count.thin
  • base_time
  • Sunshine Meter(sunny)
  • region.sun.count
  • count.box
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • time_offset


Back To Table of Contents

DQRID : D050928.8
Start DateStart TimeEnd DateEnd Time Data Quality Metric
08/01/2005213510/06/20051650Suspect
Subject:
SGP/TSI/C1 - Heater problem
DataStreams:sgptsiskycoverC1.b1
Description:
The TSI was converted from a model 880 to 660 which requires separate power for the mirror 
heater. The heater was not powered during this period so morning dew and other 
condensation was not quickly evaporated.
Measurements:sgptsiskycoverC1.b1:
  • count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)


Back To Table of Contents

DQRID : D080411.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/23/2007211008/27/20071530Missing
Subject:
SGP/TSI/C1 - Missing data
DataStreams:sgptsiskycoverC1.b1
Description:
Data are missing and unrecoverable.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count.opaque
  • solar.altitude
  • count.mask
  • region.zenith.count.thin
  • region.zenith.count
  • count.unknown
  • count.sub.proczen
  • North latitude(lat)
  • region.zenith.count.opaque
  • count.sky
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count.thin
  • East longitude(lon)
  • solar.azimuth
  • region.horizon.count
  • region.horizon.count.thin
  • count.sub.horz
  • Altitude above mean sea level(alt)
  • Cloud amount, thin (percent)(percent.thin)
  • count.thin
  • base_time
  • Sunshine Meter(sunny)
  • region.sun.count
  • count.box
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • time_offset


Back To Table of Contents

DQRID : D080414.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/21/2008000004/15/20081600Suspect
Subject:
SGP/TSI/C1 - Contamination of mirror
DataStreams:sgptsiskycoverC1.b1
Description:
A persistent bird was landing on and polluting the mirror, multiple times throughout the 
day. Spikes were placed on the corners and top of the instrument (an affective deterrent 
in the past) but this bird had the agility to perch on the top-center of the mirror.
Measurements:sgptsiskycoverC1.b1:
  • count.sky
  • count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.zenith.count.thin
  • region.zenith.count
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • region.zenith.count.opaque


Back To Table of Contents

DQRID : D111006.5
Start DateStart TimeEnd DateEnd Time Data Quality Metric
11/11/2010165010/20/20111800Does not affect quality
Subject:
SGP/TSI/C1 - Ingest Problem
DataStreams:sgptsiskycoverC1.b1
Description:
A minor error was made with diagnostic metadata attribute sunny_thresh when the TSI ingest 
was updated.
Measurements:sgptsiskycoverC1.b1:
  • base_time


Back To Table of Contents

DQRID : D121016.4
Start DateStart TimeEnd DateEnd Time Data Quality Metric
08/15/2011221710/16/20121705Suspect
Subject:
SGP/TSI/C1 - Water on lens
DataStreams:sgptsiskycoverC1.b1
Description:
After a rain episode, drops of water collected on the lens window causing the cloud 
fraction values to be suspect.

To prevent this, a drip edge was formed around the bottom of the enclosure with thick 
electrical or splicing tape.
Measurements:sgptsiskycoverC1.b1:
  • count.sky
  • count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.zenith.count.thin
  • region.zenith.count
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • region.zenith.count.opaque


Back To Table of Contents

DQRID : D130423.8
Start DateStart TimeEnd DateEnd Time Data Quality Metric
09/01/2012002309/04/20121430Suspect
12/31/2010134701/04/20111550Suspect
Subject:
SGP/TSI/C1 - Mirror contamination
DataStreams:sgptsiskycoverC1.b1
Description:
The surface of the chrome mirror was soiled causing the cloud fraction determination to be 
unreliable.
Measurements:sgptsiskycoverC1.b1:
  • count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)


Back To Table of Contents

DQRID : D130701.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/02/2000000010/19/20132359Does not affect quality
Subject:
SGP/TSI/C1 - Data processing problem
DataStreams:sgptsiskycoverC1.b1
Description:
Values of count_opaque and count_thin are reals but should be integers  (units = pixels).
Measurements:sgptsiskycoverC1.b1:
  • count.opaque
  • count.thin


Back To Table of Contents

DQRID : D130802.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
08/01/2010000010/19/20132359Does not affect quality
Subject:
SGP/TSI/C1 - Reprocessing Notice (RID 951)
DataStreams:sgptsiskycoverC1.b1
Description:
See below for details of reprocessing that was completed on 20140922.  Original 
DQR category: 5 (Transparent - Does not affect quality).

-----------------------------------------------------------

The units of global attributes region_sun_radius and region_zenith_radius should be 
degrees, not pixels.
Measurements:sgptsiskycoverC1.b1:
  • base_time


Back To Table of Contents

DQRID : D140204.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
10/11/2013185002/03/20141640Suspect
Subject:
SGP/TSI/C1 - Camera misalignment
DataStreams:sgptsiskycoverC1.b1
Description:
The camera was slightly out of alignment causing the west edge of the image to be cropped. 
The position of the camera was adjusted so it was centered over the mirror.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count
  • count.box
  • count.sub.horz


Back To Table of Contents

DQRID : D140317.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/03/2014000003/12/20141816Suspect
Subject:
SGP/TSI/C1 - Shadowband misalignment
DataStreams:sgptsiskycoverC1.b1
Description:
The shadowband was misaligned.
Measurements:sgptsiskycoverC1.b1:
  • count.opaque
  • region.sun.count.opaque
  • region.sun.count.thin
  • region.horizon.count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count.thin
  • sun.strength
  • region.zenith.count.thin
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • region.zenith.count.opaque


Back To Table of Contents

DQRID : D151223.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
11/26/2015172611/29/20152309Suspect
Subject:
SGP/TSI/C1 - Icing event
DataStreams:sgptsiskycoverC1.b1
Description:
An icing event (winter storm Cara) passed slowly through the area during this time frame.  
The TSI image was affected by ice accumulation on the mirror.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count
  • region.horizon.count.opaque
  • count.sub.horz
  • region.horizon.count.thin
  • count.mask
  • region.zenith.count.thin
  • region.zenith.count
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • count.sub.proczen
  • region.zenith.count.opaque
  • count.sky
  • Sunshine Meter(sunny)
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count
  • region.sun.count.thin
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength


Back To Table of Contents

DQRID : D160105.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
12/27/2015000001/03/20161959Suspect
Subject:
SGP/TSI/C1 - Ice storm
DataStreams:sgptsiskycoverC1.b1
Description:
The TSI images were affected by an ice storm that caused the mirror to be covered with 
ice, the shadowband to stop rotating, and condensation to blur the images.
Measurements:sgptsiskycoverC1.b1:
  • Sunshine Meter(sunny)
  • count.opaque
  • region.sun.count.opaque
  • region.sun.count.thin
  • region.horizon.count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count.thin
  • sun.strength
  • region.zenith.count.thin
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • region.zenith.count.opaque


Back To Table of Contents

DQRID : D160105.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
12/28/2015015512/31/20151501Missing
Subject:
SGP/TSI/C1 - power failure
DataStreams:sgptsiskycoverC1.b1
Description:
An ice storm caused the SGP site to lose power.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count.opaque
  • solar.altitude
  • count.mask
  • region.zenith.count.thin
  • region.zenith.count
  • count.unknown
  • count.sub.proczen
  • North latitude(lat)
  • region.zenith.count.opaque
  • count.sky
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count.thin
  • East longitude(lon)
  • solar.azimuth
  • region.horizon.count
  • region.horizon.count.thin
  • count.sub.horz
  • Altitude above mean sea level(alt)
  • Cloud amount, thin (percent)(percent.thin)
  • count.thin
  • base_time
  • Sunshine Meter(sunny)
  • region.sun.count
  • count.box
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • time_offset


Back To Table of Contents

DQRID : D161005.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
05/14/2014140209/23/20162201Incorrect
Subject:
SGP/TSI/C1 - Reprocess: Corrupt properties file
DataStreams:sgptsiskycoverC1.b1
Description:
The YYYMMDDHHMMSS_tsi.properties files were corrupted when the computer operating system 
was upgraded, causing the ingest to assign incorrect values to attributes opaque_thresh, 
thin_thresh, cam_mir_dist, and center_x. A default properties file from 5/25/2004 was 
briefly used and then a properties file from 10/11/2013 was being concatenated to the current 
properties file before it was moved to the ingest directory, so that the last values 
read were from the earlier date.
Measurements:sgptsiskycoverC1.b1:
  • base_time


Back To Table of Contents

DQRID : D170228.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/02/2000000001/20/20171559Incorrect
Subject:
SGP/TSI/C1 - Reprocess: Global attribute units incorrect for cam_mir_dist
DataStreams:sgptsiskycoverC1.b1
Description:
The global attribute cam_mir_dist was converted incorrectly.  The raw 
camera.mirror.distance, in inches, was multiplied by 10 and assigned a unit of mm.
Measurements:sgptsiskycoverC1.b1:
  • base_time


Back To Table of Contents



END OF DATA