Data Quality Reports for Session: 183760 User: clong Completed: 02/24/2017


TABLE OF CONTENTS

DQR IDSubjectData Streams Affected Data Quality Metric
D151223.1SGP/TSI/C1 - Icing eventsgptsiskycoverC1.b1Suspect
D160105.2SGP/TSI/C1 - Ice stormsgptsiskycoverC1.b1Suspect
D160105.3SGP/TSI/C1 - power failuresgptsiskycoverC1.b1Missing
D160212.3SGP - Data System Upgrades: Data MissingsgptsiskycoverC1.b1Missing
D160811.4SGP/TSI/S01 - Damaged data cablesgptsiskycoverS01.b1Missing
D160815.3SGP/TSI/S01 - Reprocess: Sky filter thresholdssgptsiskycoverS01.b1Suspect
D160815.4SGP/TSI/S01 - position coordinatessgptsiskycoverS01.b1Does not affect quality
D160926.1SGP/TSI/S01 - Reprocess: Corrupt properties filesgptsiskycoverS01.b1Incorrect
D161005.3SGP/TSI/C1 - Reprocess: Corrupt properties filesgptsiskycoverC1.b1Incorrect
D161128.3SGP/TSI/S01 - Image capturesgptsiskycoverS01.b1Does not affect quality
D170117.3SGP/TSI/C1 - ice stormsgptsiskycoverC1.b1Incorrect
D170117.4SGP/TSI/E42 - ice stormsgptsiskycoverE42.b1Incorrect
D170209.1SGP/TSI/E42 - Mirror replacedsgptsiskycoverE42.b1Incorrect


DQRID : D151223.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
11/26/2015172611/29/20152309Suspect
Subject:
SGP/TSI/C1 - Icing event
DataStreams:sgptsiskycoverC1.b1
Description:
An icing event (winter storm Cara) passed slowly through the area during this time frame.  
The TSI image was affected by ice accumulation on the mirror.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count
  • region.horizon.count.opaque
  • count.sub.horz
  • region.horizon.count.thin
  • count.mask
  • region.zenith.count.thin
  • region.zenith.count
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • count.sub.proczen
  • region.zenith.count.opaque
  • count.sky
  • Sunshine Meter(sunny)
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count
  • region.sun.count.thin
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength


Back To Table of Contents

DQRID : D160105.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
12/27/2015000001/03/20161959Suspect
Subject:
SGP/TSI/C1 - Ice storm
DataStreams:sgptsiskycoverC1.b1
Description:
The TSI images were affected by an ice storm that caused the mirror to be covered with 
ice, the shadowband to stop rotating, and condensation to blur the images.
Measurements:sgptsiskycoverC1.b1:
  • Sunshine Meter(sunny)
  • count.opaque
  • region.sun.count.opaque
  • region.sun.count.thin
  • region.horizon.count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count.thin
  • sun.strength
  • region.zenith.count.thin
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • region.zenith.count.opaque


Back To Table of Contents

DQRID : D160105.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
12/28/2015015512/31/20151501Missing
Subject:
SGP/TSI/C1 - power failure
DataStreams:sgptsiskycoverC1.b1
Description:
An ice storm caused the SGP site to lose power.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count.opaque
  • solar.altitude
  • count.mask
  • region.zenith.count.thin
  • region.zenith.count
  • count.unknown
  • count.sub.proczen
  • North latitude(lat)
  • region.zenith.count.opaque
  • count.sky
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count.thin
  • East longitude(lon)
  • solar.azimuth
  • region.horizon.count
  • region.horizon.count.thin
  • count.sub.horz
  • Altitude above mean sea level(alt)
  • Cloud amount, thin (percent)(percent.thin)
  • count.thin
  • base_time
  • Sunshine Meter(sunny)
  • region.sun.count
  • count.box
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • time_offset


Back To Table of Contents

DQRID : D160212.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/26/2016180001/27/20162145Missing
Subject:
SGP - Data System Upgrades: Data Missing
DataStreams:sgptsiskycoverC1.b1
Description:
The data system was undergoing upgrades.  Data were lost during this period.
Measurements:sgptsiskycoverC1.b1:
  • region.horizon.count.opaque
  • solar.altitude
  • count.mask
  • count_thin
  • count.unknown
  • region.zenith.count
  • Cloud amount, thin (percent)(percent_thin)
  • count.sub.proczen
  • North latitude(lat)
  • region.zenith.count.opaque
  • count.sky
  • region.sun.count.opaque
  • region_sun_count_opaque
  • qc_region_zenith_count_thin
  • qc_count_box
  • qc_region_sun_count_thin
  • qc_percent_thin
  • region_zenith_count_thin
  • count_sub_horz
  • count.sub.horz
  • Cloud amount, thin (percent)(percent.thin)
  • count_unknown
  • Sunshine Meter(sunny)
  • solar_azimuth
  • region.sun.count
  • region_horizon_count_opaque
  • count.box
  • region_sun_count_thin
  • qc_region_sun_count_opaque
  • qc_count_sky
  • count_opaque
  • count_box
  • sun_strength
  • qc_solar_azimuth
  • time
  • qc_count_unknown
  • region.zenith.count.thin
  • qc_region_sun_count
  • qc_region_horizon_count_thin
  • qc_region_zenith_count
  • qc_sun_strength
  • count.opaque
  • region.sun.count.thin
  • qc_percent_opaque
  • solar_altitude
  • region_horizon_count
  • East longitude(lon)
  • count_mask
  • solar.azimuth
  • region.horizon.count
  • qc_region_zenith_count_opaque
  • count_sub_proczen
  • region_sun_count
  • qc_solar_altitude
  • region_zenith_count_opaque
  • region_zenith_count
  • region.horizon.count.thin
  • Altitude above mean sea level(alt)
  • qc_region_horizon_count
  • qc_count_mask
  • count.thin
  • qc_count_sub_proczen
  • base_time
  • qc_time
  • qc_sunny
  • Cloud amount, opaque (percent)(percent_opaque)
  • qc_count_sub_horz
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • qc_region_horizon_count_opaque
  • qc_count_thin
  • region_horizon_count_thin
  • qc_count_opaque
  • time_offset
  • count_sky


Back To Table of Contents

DQRID : D160811.4
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/28/2016220008/08/20161436Missing
Subject:
SGP/TSI/S01 - Damaged data cable
DataStreams:sgptsiskycoverS01.b1
Description:
The network cable was damaged and replaced.
Measurements:sgptsiskycoverS01.b1:
  • count_box
  • solar_azimuth
  • region_zenith_count
  • Cloud amount, thin (percent)(percent_thin)
  • qc_count_box
  • qc_solar_azimuth
  • region_zenith_count_opaque
  • qc_region_sun_count
  • count_opaque
  • Altitude above mean sea level(alt)
  • qc_sun_strength
  • qc_time
  • qc_region_horizon_count_thin
  • East longitude(lon)
  • sun_strength
  • region_horizon_count_opaque
  • qc_region_sun_count_thin
  • count_mask
  • count_sky
  • qc_count_mask
  • qc_count_sky
  • qc_solar_altitude
  • qc_region_sun_count_opaque
  • region_sun_count_thin
  • qc_count_unknown
  • qc_count_opaque
  • region_sun_count
  • time
  • solar_altitude
  • count_sub_proczen
  • qc_count_thin
  • time_offset
  • qc_percent_thin
  • qc_region_zenith_count
  • Cloud amount, opaque (percent)(percent_opaque)
  • region_horizon_count
  • region_sun_count_opaque
  • qc_region_horizon_count_opaque
  • qc_percent_opaque
  • North latitude(lat)
  • qc_count_sub_horz
  • qc_region_zenith_count_opaque
  • qc_region_horizon_count
  • Sunshine Meter(sunny)
  • qc_region_zenith_count_thin
  • base_time
  • qc_sunny
  • count_thin
  • qc_count_sub_proczen
  • region_horizon_count_thin
  • count_unknown
  • region_zenith_count_thin
  • count_sub_horz


Back To Table of Contents

DQRID : D160815.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
04/20/2016182907/04/20161928Suspect
Subject:
SGP/TSI/S01 - Reprocess: Sky filter thresholds
DataStreams:sgptsiskycoverS01.b1
Description:
The clear/thin sky filter threshold was changed from 60% to 70%.
Measurements:sgptsiskycoverS01.b1:
  • region_sun_count_opaque
  • region_zenith_count_thin
  • Cloud amount, thin (percent)(percent_thin)
  • region_zenith_count_opaque
  • count_thin
  • region_horizon_count_opaque
  • Cloud amount, opaque (percent)(percent_opaque)
  • count_opaque
  • region_horizon_count_thin
  • region_sun_count_thin


Back To Table of Contents

DQRID : D160815.4
Start DateStart TimeEnd DateEnd Time Data Quality Metric
04/20/2016182908/15/20161952Does not affect quality
Subject:
SGP/TSI/S01 - position coordinates
DataStreams:sgptsiskycoverS01.b1
Description:
The TSI at S01 was originally configured to use the same latitude and longitude (36.607, 
-97.488) as the TSI at C1 but the actual coordinates of S01 are 36.601 deg, -97.481 deg. 
Since the ingest uses the actual coordinates, the TSI was configured to use the same. The 
difference is so minor, 580m, that the change did not affect the position of the shadowband.
Measurements:sgptsiskycoverS01.b1:
  • North latitude(lat)
  • East longitude(lon)


Back To Table of Contents

DQRID : D160926.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
04/20/2016000009/23/20162203Incorrect
Subject:
SGP/TSI/S01 - Reprocess: Corrupt properties file
DataStreams:sgptsiskycoverS01.b1
Description:
The YYYMMDDHHMMSS_tsi.properties files were corrupted causing the ingest to assign 
incorrect values to attributes opaque_thresh, thin_thresh, cam_mir_dist, and center_x. A default 
properties file from 10/11/2013 was being concatenated to the current properties file 
before it was moved to the ingest directory, so that the last values read were from the 
earlier date.
Measurements:sgptsiskycoverS01.b1:
  • base_time


Back To Table of Contents

DQRID : D161005.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
05/14/2014140209/23/20162201Incorrect
Subject:
SGP/TSI/C1 - Reprocess: Corrupt properties file
DataStreams:sgptsiskycoverC1.b1
Description:
The YYYMMDDHHMMSS_tsi.properties files were corrupted when the computer operating system 
was upgraded, causing the ingest to assign incorrect values to attributes opaque_thresh, 
thin_thresh, cam_mir_dist, and center_x. A default properties file from 5/25/2004 was 
briefly used and then a properties file from 10/11/2013 was being concatenated to the current 
properties file before it was moved to the ingest directory, so that the last values 
read were from the earlier date.
Measurements:sgptsiskycoverC1.b1:
  • base_time


Back To Table of Contents

DQRID : D161128.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
09/10/2016000011/08/20162209Does not affect quality
Subject:
SGP/TSI/S01 - Image capture
DataStreams:sgptsiskycoverS01.b1
Description:
The data were intermittent due to an image capture error.
Measurements:sgptsiskycoverS01.b1:
  • count_sky
  • count_box
  • region_zenith_count
  • Cloud amount, thin (percent)(percent_thin)
  • region_zenith_count_opaque
  • count_thin
  • count_opaque
  • Cloud amount, opaque (percent)(percent_opaque)
  • region_horizon_count_thin
  • region_horizon_count
  • region_sun_count_thin
  • region_sun_count_opaque
  • count_unknown
  • region_zenith_count_thin
  • sun_strength
  • region_sun_count
  • count_sub_horz
  • region_horizon_count_opaque
  • count_sub_proczen
  • Sunshine Meter(sunny)
  • count_mask


Back To Table of Contents

DQRID : D170117.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/13/2017204401/16/20172335Incorrect
01/13/2017134601/13/20171621Incorrect
Subject:
SGP/TSI/C1 - ice storm
DataStreams:sgptsiskycoverC1.b1
Description:
An ice storm caused the mirror to freeze so the shadowband was not in the correct 
position.
Measurements:sgptsiskycoverC1.b1:
  • region_zenith_count_thin
  • sun_strength
  • region_zenith_count_opaque
  • region.zenith.count.thin
  • count_thin
  • Cloud amount, thin (percent)(percent_thin)
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • region.zenith.count.opaque
  • count.sky
  • Sunshine Meter(sunny)
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count.thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • region_sun_count_opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • region_sun_count_thin
  • count_opaque
  • count_sky


Back To Table of Contents

DQRID : D170117.4
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/13/2017205201/15/20171721Incorrect
Subject:
SGP/TSI/E42 - ice storm
DataStreams:sgptsiskycoverE42.b1
Description:
An ice storm caused the mirror to freeze so the shadowband was not in the correct 
position.
Measurements:sgptsiskycoverE42.b1:
  • region_zenith_count_opaque
  • Cloud amount, opaque (percent)(percent_opaque)
  • count_thin
  • count_opaque
  • sun_strength
  • count_sky
  • region_zenith_count_thin
  • region_sun_count_thin
  • Sunshine Meter(sunny)
  • region_sun_count_opaque
  • Cloud amount, thin (percent)(percent_thin)


Back To Table of Contents

DQRID : D170209.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
02/07/2017155402/07/20171650Incorrect
Subject:
SGP/TSI/E42 - Mirror replaced
DataStreams:sgptsiskycoverE42.b1
Description:
The TSI images are not valid during the chrome mirror replacement.
Measurements:sgptsiskycoverE42.b1:
  • region_zenith_count_opaque
  • Cloud amount, opaque (percent)(percent_opaque)
  • region_horizon_count_thin
  • count_thin
  • count_opaque
  • sun_strength
  • region_horizon_count_opaque
  • count_sky
  • region_zenith_count_thin
  • region_sun_count_thin
  • Sunshine Meter(sunny)
  • region_sun_count_opaque
  • Cloud amount, thin (percent)(percent_thin)


Back To Table of Contents



END OF DATA