Data Quality Reports for Session: 182951 User: newmank1 Completed: 01/20/2017


TABLE OF CONTENTS

DQR IDSubjectData Streams Affected Data Quality Metric
D160105.2SGP/TSI/C1 - Ice stormsgptsiskyimageC1.a1, sgptsiskycoverC1.b1Suspect
D160212.3SGP - Data System Upgrades: Data MissingsgptsiskyimageC1.a1, sgpceilC1.b1, sgptsiskycoverC1.b1Missing
D160401.1NSA/TSI/C1 - frost on lensnsatsiskyimageC1.a1Incorrect
D160422.1NSA/TSI/C1 - Condensation on lensnsatsiskyimageC1.a1Suspect
D160427.7ENA/C1 - Reprocess: Slightly incorrect location fieldsenaceilC1.b1, enatsiskycoverC1.b1Suspect
D160713.3AWR/TSI/S1 - Reprocessed and Corrected: Sky filter thresholdsawrtsicldmaskS1.a1Does not affect quality
D160718.2NSA/ECOR/TSI/C1/E10 - Data MissingnsatsiskyimageC1.a1Missing
D160718.3NSA/CEIL/C1 - Data MissingnsaceilC1.b1Missing
D160824.11NSA/TSI/C1 - Re-installationnsatsiskyimageC1.a1Incorrect
D160907.4ENA/CEIL/C1 - Data system upgradeenaceilC1.b1Missing
D160907.8ENA/TSI/C1 - Data system upgradeenatsicldmaskC1.a1, enatsiskyimageC1.a1, enatsiskycoverC1.b1Missing
D161005.3SGP/TSI/C1 - Reprocess: Corrupt properties filesgptsiskycoverC1.b1Incorrect
D170110.1OLI/M1 - Severe StormoliceilM1.b1Does not affect quality
D170110.4NSA/CEIL/C1 - EnvironmentalnsaceilC1.b1Suspect
D170117.3SGP/TSI/C1 - ice stormsgptsiskycoverC1.b1Incorrect


DQRID : D160105.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
12/27/2015000001/03/20161959Suspect
Subject:
SGP/TSI/C1 - Ice storm
DataStreams:sgptsiskyimageC1.a1, sgptsiskycoverC1.b1
Description:
The TSI images were affected by an ice storm that caused the mirror to be covered with 
ice, the shadowband to stop rotating, and condensation to blur the images.
Measurements:sgptsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available

sgptsiskycoverC1.b1:
  • region.horizon.count.opaque
  • region.horizon.count.thin
  • region.zenith.count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • count.thin
  • region.zenith.count.opaque
  • Sunshine Meter(sunny)
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count.thin
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength


Back To Table of Contents

DQRID : D160212.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/26/2016180001/27/20162145Missing
Subject:
SGP - Data System Upgrades: Data Missing
DataStreams:sgptsiskyimageC1.a1, sgpceilC1.b1, sgptsiskycoverC1.b1
Description:
The data system was undergoing upgrades.  Data were lost during this period.
Measurements:sgpceilC1.b1:
  • qc_second_cbh
  • measurement_parameters
  • qc_first_cbh
  • vertical_visibility
  • background_light
  • qc_third_cbh
  • East longitude(lon)
  • Third cloud base height(third_cbh)
  • window_contamination
  • window_transmission
  • tilt_angle
  • range_bounds
  • base_time
  • detection_status
  • range
  • laser_temperature
  • Backscatter, ceilometer, range and sensitivity corrected(backscatter)
  • receiver_sensitivity
  • alt_highest_signal
  • Cloud, base height, second lowest base sensed(second_cbh)
  • qc_background_light
  • status_flag
  • time_bounds
  • qc_sum_backscatter
  • qc_receiver_sensitivity
  • qc_laser_temperature
  • qc_vertical_visibility
  • Altitude above mean sea level(alt)
  • North latitude(lat)
  • time_offset
  • qc_window_contamination
  • sum_backscatter
  • qc_laser_pulse_energy
  • qc_alt_highest_signal
  • laser_pulse_energy
  • Cloud, base height, lowest base sensed(first_cbh)
  • qc_tilt_angle
  • time
  • status_string
  • qc_window_transmission

sgptsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available

sgptsiskycoverC1.b1:
  • solar.altitude
  • count_thin
  • count.unknown
  • count.sub.proczen
  • qc_count_box
  • region_zenith_count_thin
  • count_sub_horz
  • count.sub.horz
  • count_unknown
  • Cloud amount, thin (percent)(percent.thin)
  • Sunshine Meter(sunny)
  • solar_azimuth
  • region_sun_count_thin
  • qc_count_sky
  • count_box
  • sun_strength
  • time
  • qc_count_unknown
  • region.zenith.count.thin
  • qc_region_zenith_count
  • region.sun.count.thin
  • region.horizon.count
  • count_sub_proczen
  • qc_region_zenith_count_opaque
  • qc_solar_altitude
  • region_sun_count
  • Altitude above mean sea level(alt)
  • qc_region_horizon_count
  • qc_sunny
  • qc_time
  • qc_count_sub_horz
  • Cloud amount, opaque (percent)(percent.opaque)
  • qc_region_horizon_count_opaque
  • qc_count_thin
  • qc_count_opaque
  • time_offset
  • count_sky
  • region.horizon.count.opaque
  • count.mask
  • region.zenith.count
  • Cloud amount, thin (percent)(percent_thin)
  • North latitude(lat)
  • region.zenith.count.opaque
  • count.sky
  • region.sun.count.opaque
  • region_sun_count_opaque
  • qc_region_zenith_count_thin
  • qc_region_sun_count_thin
  • qc_percent_thin
  • region.sun.count
  • count.box
  • region_horizon_count_opaque
  • qc_region_sun_count_opaque
  • count_opaque
  • qc_solar_azimuth
  • qc_region_sun_count
  • qc_region_horizon_count_thin
  • qc_sun_strength
  • count.opaque
  • qc_percent_opaque
  • solar_altitude
  • region_horizon_count
  • East longitude(lon)
  • count_mask
  • solar.azimuth
  • region_zenith_count
  • region_zenith_count_opaque
  • region.horizon.count.thin
  • qc_count_mask
  • count.thin
  • qc_count_sub_proczen
  • base_time
  • Cloud amount, opaque (percent)(percent_opaque)
  • sun.strength
  • region_horizon_count_thin


Back To Table of Contents

DQRID : D160401.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/27/2016155703/31/20160021Incorrect
Subject:
NSA/TSI/C1 - frost on lens
DataStreams:nsatsiskyimageC1.a1
Description:
The camera lens window was covered with frost because the thermal pad in camera housing 
was not powered on.
Measurements:nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D160422.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
04/05/2016151204/14/20161823Suspect
Subject:
NSA/TSI/C1 - Condensation on lens
DataStreams:nsatsiskyimageC1.a1
Description:
The images and fractional sky cover values are affected by moisture inside the camera 
housing. The desiccant was added.
Measurements:nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D160427.7
Start DateStart TimeEnd DateEnd Time Data Quality Metric
09/29/2013094104/30/20162359Suspect
Subject:
ENA/C1 - Reprocess: Slightly incorrect location fields
DataStreams:enaceilC1.b1, enatsiskycoverC1.b1
Description:
Some of the instruments are being processed with the previous "GRW-Azores" lat/lon/alt 
instead of the new "ENA-Azores" lat/lon/alt. The differences are minor, but will be 
corrected. The respective GRW and ENA lat, lon, and alt values are as follows:
 
GRW  lat = 39.0911 ;
ENA lat = 39.0916 ;
GRW  lon = -28.0297 ;
ENA  lon = -28.0257 ;
GRW  alt = 26 ;
ENA  alt = 30.48 ;
Measurements:enaceilC1.b1:
  • North latitude(lat)
  • Altitude above mean sea level(alt)
  • East longitude(lon)

enatsiskycoverC1.b1:
  • North latitude(lat)
  • Altitude above mean sea level(alt)
  • East longitude(lon)


Back To Table of Contents

DQRID : D160713.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
12/03/2015200301/17/20160003Does not affect quality
Subject:
AWR/TSI/S1 - Reprocessed and Corrected: Sky filter thresholds
DataStreams:awrtsicldmaskS1.a1
Description:
DATA REPROCESSED and CORRECTED: 


The data were reprocessed after changing the sky filter thresholds from clear/thin = 50 
and thin/opaque= 70 to 40 and 60, respectively.

The data were archived November 2016. Please retrieve the reprocessed data for use in your 
analysis. 


ORIGINAL DQR CATEGORY: Red( Incorrect)

REPROCESSED and CORRECTED DATA ARCHIVED:2016-11

REPROCESS IDENTIFICATION NUMBER: RID 1484

---------------------------------------------------
--- ORIGINAL DQR DESCRIPTION ---
---------------------------------------------------

The sky filter thresholds for determining fractional sky cover were incorrect.
Measurements:awrtsicldmaskS1.a1:
  • Documentation not available


Back To Table of Contents

DQRID : D160718.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/12/2016151007/15/20160000Missing
Subject:
NSA/ECOR/TSI/C1/E10 - Data Missing
DataStreams:nsatsiskyimageC1.a1
Description:
Site data systems were being upgraded during this time.
Measurements:nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D160718.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/12/2016112007/14/20161614Missing
Subject:
NSA/CEIL/C1 - Data Missing
DataStreams:nsaceilC1.b1
Description:
Site data system was being upgraded during this time frame.
Measurements:nsaceilC1.b1:
  • qc_sum_backscatter
  • window_contamination
  • range
  • laser_temperature
  • qc_vertical_visibility
  • qc_laser_pulse_energy
  • range_bounds
  • detection_status
  • alt_highest_signal
  • qc_receiver_sensitivity
  • base_time
  • qc_background_light
  • Cloud, base height, lowest base sensed(first_cbh)
  • time
  • time_bounds
  • qc_third_cbh
  • Backscatter, ceilometer, range and sensitivity corrected(backscatter)
  • sum_backscatter
  • qc_laser_temperature
  • receiver_sensitivity
  • qc_first_cbh
  • tilt_angle
  • laser_pulse_energy
  • measurement_parameters
  • East longitude(lon)
  • North latitude(lat)
  • qc_window_contamination
  • qc_window_transmission
  • qc_second_cbh
  • background_light
  • Third cloud base height(third_cbh)
  • status_string
  • qc_alt_highest_signal
  • time_offset
  • window_transmission
  • qc_tilt_angle
  • status_flag
  • Altitude above mean sea level(alt)
  • Cloud, base height, second lowest base sensed(second_cbh)
  • vertical_visibility


Back To Table of Contents

DQRID : D160824.11
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/12/2016002803/14/20161958Incorrect
Subject:
NSA/TSI/C1 - Re-installation
DataStreams:nsatsiskyimageC1.a1
Description:
The TSI required maintenance and configuration after being re-installed after winter.
Measurements:nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D160907.4
Start DateStart TimeEnd DateEnd Time Data Quality Metric
08/22/2016094308/23/20161849Missing
Subject:
ENA/CEIL/C1 - Data system upgrade
DataStreams:enaceilC1.b1
Description:
Data lost during the site data system upgrade.
Measurements:enaceilC1.b1:
  • qc_background_light
  • base_time
  • qc_laser_temperature
  • Cloud, base height, second lowest base sensed(second_cbh)
  • Cloud, base height, lowest base sensed(first_cbh)
  • qc_window_transmission
  • measurement_parameters
  • time_offset
  • background_light
  • Backscatter, ceilometer, range and sensitivity corrected(backscatter)
  • window_transmission
  • qc_sum_backscatter
  • North latitude(lat)
  • qc_alt_highest_signal
  • Altitude above mean sea level(alt)
  • qc_third_cbh
  • status_string
  • qc_vertical_visibility
  • status_flag
  • qc_tilt_angle
  • range_bounds
  • qc_second_cbh
  • laser_pulse_energy
  • sum_backscatter
  • Third cloud base height(third_cbh)
  • vertical_visibility
  • qc_laser_pulse_energy
  • East longitude(lon)
  • tilt_angle
  • laser_temperature
  • detection_status
  • qc_first_cbh
  • time
  • range
  • alt_highest_signal
  • time_bounds


Back To Table of Contents

DQRID : D160907.8
Start DateStart TimeEnd DateEnd Time Data Quality Metric
08/22/2016094308/23/20161827Missing
Subject:
ENA/TSI/C1 - Data system upgrade
DataStreams:enatsicldmaskC1.a1, enatsiskyimageC1.a1, enatsiskycoverC1.b1
Description:
Data lost during the site data system upgrade.
Measurements:enatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available

enatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)

enatsiskycoverC1.b1:
  • time
  • count_unknown
  • Sunshine Meter(sunny)
  • qc_sunny
  • qc_region_horizon_count_opaque
  • qc_count_sub_horz
  • count_thin
  • qc_solar_altitude
  • qc_count_mask
  • region_sun_count_thin
  • qc_region_horizon_count
  • qc_count_sky
  • Cloud amount, thin (percent)(percent_thin)
  • qc_time
  • sun_strength
  • qc_count_unknown
  • qc_region_sun_count_thin
  • solar_altitude
  • qc_count_sub_proczen
  • region_zenith_count_thin
  • qc_region_zenith_count
  • region_zenith_count
  • qc_region_horizon_count_thin
  • qc_region_zenith_count_opaque
  • region_zenith_count_opaque
  • count_sub_horz
  • count_mask
  • region_sun_count
  • qc_sun_strength
  • time_offset
  • solar_azimuth
  • region_horizon_count_opaque
  • qc_solar_azimuth
  • base_time
  • count_box
  • count_sky
  • qc_percent_opaque
  • Altitude above mean sea level(alt)
  • qc_region_sun_count
  • qc_region_sun_count_opaque
  • qc_percent_thin
  • count_opaque
  • qc_count_box
  • qc_count_thin
  • region_horizon_count
  • qc_region_zenith_count_thin
  • qc_count_opaque
  • North latitude(lat)
  • count_sub_proczen
  • region_sun_count_opaque
  • region_horizon_count_thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • East longitude(lon)


Back To Table of Contents

DQRID : D161005.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
05/14/2014140209/23/20162201Incorrect
Subject:
SGP/TSI/C1 - Reprocess: Corrupt properties file
DataStreams:sgptsiskycoverC1.b1
Description:
The YYYMMDDHHMMSS_tsi.properties files were corrupted when the computer operating system 
was upgraded, causing the ingest to assign incorrect values to attributes opaque_thresh, 
thin_thresh, cam_mir_dist, and center_x. A default properties file from 5/25/2004 was 
briefly used and then a properties file from 10/11/2013 was being concatenated to the current 
properties file before it was moved to the ingest directory, so that the last values 
read were from the earlier date.
Measurements:sgptsiskycoverC1.b1:
  • base_time


Back To Table of Contents

DQRID : D170110.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/05/2017100001/08/20171200Does not affect quality
Subject:
OLI/M1 - Severe Storm
DataStreams:oliceilM1.b1
Description:
The site lost power during a severe winter storm.  Operators on site were not able to get 
out and restart the generators to bring things back up until 1/7/2017.  Most of the 
instruments were brought up at this time, but some problems remained until 1/8/2017
Measurements:oliceilM1.b1:
  • window_transmission
  • Altitude above mean sea level(alt)
  • measurement_parameters
  • qc_alt_highest_signal
  • qc_window_transmission
  • status_flag
  • base_time
  • Third cloud base height(third_cbh)
  • background_light
  • time_offset
  • time
  • laser_temperature
  • tilt_angle
  • qc_first_cbh
  • Backscatter, ceilometer, range and sensitivity corrected(backscatter)
  • time_bounds
  • qc_background_light
  • North latitude(lat)
  • qc_laser_temperature
  • sum_backscatter
  • vertical_visibility
  • qc_third_cbh
  • qc_laser_pulse_energy
  • laser_pulse_energy
  • Cloud, base height, lowest base sensed(first_cbh)
  • qc_second_cbh
  • range
  • alt_highest_signal
  • detection_status
  • qc_tilt_angle
  • Cloud, base height, second lowest base sensed(second_cbh)
  • qc_vertical_visibility
  • range_bounds
  • East longitude(lon)
  • status_string
  • qc_sum_backscatter


Back To Table of Contents

DQRID : D170110.4
Start DateStart TimeEnd DateEnd Time Data Quality Metric
12/30/2016234312/31/20161152Suspect
Subject:
NSA/CEIL/C1 - Environmental
DataStreams:nsaceilC1.b1
Description:
There appears to have been snow or ice on the window.
Measurements:nsaceilC1.b1:
  • Third cloud base height(third_cbh)
  • sum_backscatter
  • Cloud, base height, lowest base sensed(first_cbh)
  • vertical_visibility
  • Cloud, base height, second lowest base sensed(second_cbh)


Back To Table of Contents

DQRID : D170117.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
01/13/2017204401/16/20172335Incorrect
01/13/2017134601/13/20171621Incorrect
Subject:
SGP/TSI/C1 - ice storm
DataStreams:sgptsiskycoverC1.b1
Description:
An ice storm caused the mirror to freeze so the shadowband was not in the correct 
position.
Measurements:sgptsiskycoverC1.b1:
  • region_zenith_count_thin
  • sun_strength
  • region_zenith_count_opaque
  • region.zenith.count.thin
  • count_thin
  • Cloud amount, thin (percent)(percent_thin)
  • count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • region.zenith.count.opaque
  • count.sky
  • Sunshine Meter(sunny)
  • region.sun.count.opaque
  • count.opaque
  • region.sun.count.thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • region_sun_count_opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • region_sun_count_thin
  • count_opaque
  • count_sky


Back To Table of Contents



END OF DATA