Data Quality Reports for Session: 183806 User: runcimank1 Completed: 02/28/2017


TABLE OF CONTENTS

DQR IDSubjectData Streams Affected Data Quality Metric
D130703.2NSA/TSI/C1/X1 - data processing problemnsatsiskycoverC1.b1Does not affect quality
D130807.3NSA/TSI/C1 - Reprocessing Notice (RID 951)nsatsiskycoverC1.b1Does not affect quality
D130903.5NSA/TSI/C1 - Camera misalignednsatsicldmaskC1.a1, nsatsiskycoverC1.b1Suspect
D140326.4NSA/TSI/C1 - Software problemnsatsimovieC1.a1, nsatsicldmaskC1.a1Suspect
D140806.1NSA/TSI/C1 - ObstructionnsatsiskycoverC1.b1Incorrect
D140827.1NSA/TSI/C1 - ObstructionnsatsiskycoverC1.b1Suspect
D140911.1NSA/TSI/C1 - Reprocessing Notice (RID 1228)nsatsimovieC1.a1Does not affect quality
D150408.4NSA/TSI/C1 - Shadowband misalignmentnsatsiskycoverC1.b1Suspect
D150428.1NSA/TSI/C1 - CommunicationnsatsicldmaskC1.a1, nsatsimovieC1.a1, nsatsiskycoverC1.b1, nsatsiskyimageC1.a1Missing
D160401.1NSA/TSI/C1 - frost on lensnsatsicldmaskC1.a1, nsatsiskyimageC1.a1, nsatsiskycoverC1.b1Incorrect
D160404.5NSA/TSI/C1 - Reprocess: Sky filter thresholdsnsatsicldmaskC1.a1, nsatsiskycoverC1.b1Incorrect
D160422.1NSA/TSI/C1 - Condensation on lensnsatsicldmaskC1.a1, nsatsiskyimageC1.a1, nsatsiskycoverC1.b1Suspect
D160718.2NSA/ECOR/TSI/C1/E10 - Data MissingnsatsimovieC1.a1, nsatsiskyimageC1.a1, nsatsiskycoverC1.b1, nsatsicldmaskC1.a1Missing
D160824.11NSA/TSI/C1 - Re-installationnsatsicldmaskC1.a1, nsatsimovieC1.a1, nsatsiskyimageC1.a1, nsatsiskycoverC1.b1Incorrect
D170216.22NSA/TSI/C1- winter seasonnsatsimovieC1.a1, nsatsiskycoverC1.b1, nsatsiskyimageC1.a1, nsatsicldmaskC1.a1Missing
D170216.27NSA/TSI/C1 - Re-installationnsatsiskycoverC1.b1Suspect


DQRID : D130703.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/30/2005000010/19/20132359Does not affect quality
Subject:
NSA/TSI/C1/X1 - data processing problem
DataStreams:nsatsiskycoverC1.b1
Description:
Values of count_opaque and count_thin are reals but should be integers  (units = pixels).
Measurements:nsatsiskycoverC1.b1:
  • count.opaque
  • count.thin


Back To Table of Contents

DQRID : D130807.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
08/01/2010000010/21/20132359Does not affect quality
Subject:
NSA/TSI/C1 - Reprocessing Notice (RID 951)
DataStreams:nsatsiskycoverC1.b1
Description:
See below for details of reprocessing that was completed on 20140922.  Original 
DQR category: 5 (Transparent - Does not affect quality).

-----------------------------------------------------------


The units of global attributes region_sun_radius and region_zenith_radius should be 
degrees, not pixels.
Measurements:nsatsiskycoverC1.b1:
  • base_time


Back To Table of Contents

DQRID : D130903.5
Start DateStart TimeEnd DateEnd Time Data Quality Metric
06/24/2013224608/29/20132205Suspect
Subject:
NSA/TSI/C1 - Camera misaligned
DataStreams:nsatsicldmaskC1.a1, nsatsiskycoverC1.b1
Description:
The camera lens was not centered over the middle of mirror. The position of the camera 
enclosure was adjusted.
Measurements:nsatsiskycoverC1.b1:
  • region.zenith.count.opaque
  • count.sub.proczen
  • count.sub.horz
  • Cloud amount, thin (percent)(percent.thin)
  • count.opaque
  • count.thin
  • region.horizon.count.opaque
  • region.sun.count
  • region.horizon.count.thin
  • count.unknown
  • region.horizon.count
  • region.zenith.count
  • region.sun.count.thin
  • region.zenith.count.thin
  • count.box
  • region.sun.count.opaque
  • count.sky
  • count.mask
  • Cloud amount, opaque (percent)(percent.opaque)

nsatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D140326.4
Start DateStart TimeEnd DateEnd Time Data Quality Metric
11/01/2013170003/17/20141858Suspect
Subject:
NSA/TSI/C1 - Software problem
DataStreams:nsatsimovieC1.a1, nsatsicldmaskC1.a1
Description:
When the TSI computer was upgraded to a Windows 7 virtual machine, the scheduled task to 
stop the software each day was not configured correctly. Image processing became 
back-logged requiring manual intervention and use of the batch processing feature. This resulted 
in missing cldmask files and out-of-sequence movie files. The scheduled task was corrected.
Measurements:nsatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)

nsatsimovieC1.a1:
  • MPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D140806.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/31/2014003707/31/20140311Incorrect
Subject:
NSA/TSI/C1 - Obstruction
DataStreams:nsatsiskycoverC1.b1
Description:
The electrical tape serving as a drip edge for the camera housing came loose and blocked 
the view of the camera.
Measurements:nsatsiskycoverC1.b1:
  • region.zenith.count.opaque
  • region.sun.count.thin
  • region.zenith.count.thin
  • Sunshine Meter(sunny)
  • Cloud amount, thin (percent)(percent.thin)
  • count.opaque
  • sun.strength
  • region.sun.count.opaque
  • count.sky
  • region.horizon.count.opaque
  • count.mask
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count.thin


Back To Table of Contents

DQRID : D140827.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/31/2014042507/31/20141856Suspect
Subject:
NSA/TSI/C1 - Obstruction
DataStreams:nsatsiskycoverC1.b1
Description:
The electrical tape serving as a drip edge for the camera housing came loose and was in 
the zenith view of the camera.
Measurements:nsatsiskycoverC1.b1:
  • region.zenith.count.opaque
  • region.zenith.count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • count.opaque
  • count.sky
  • Cloud amount, opaque (percent)(percent.opaque)


Back To Table of Contents

DQRID : D140911.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/31/2014211308/16/20141326Does not affect quality
Subject:
NSA/TSI/C1 - Reprocessing Notice (RID 1228)
DataStreams:nsatsimovieC1.a1
Description:
See below for details of reprocessing that was completed on 20150820.  Original DQR 
category: 4 (Red, Incorrect).

-----------------------------------------------------------

The start and end times of the TSI daily movie were not correct and do not correspond to 
local sunrise and sunset.
Measurements:nsatsimovieC1.a1:
  • MPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D150408.4
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/18/2015000004/07/20152227Suspect
Subject:
NSA/TSI/C1 - Shadowband misalignment
DataStreams:nsatsiskycoverC1.b1
Description:
The shadowband was slightly misaligned. When the TSI was reinstalled after the Arctic 
night, communication with the mirror control board was not re-established and the time of the 
board's RTC was 56m 55s slow.
Measurements:nsatsiskycoverC1.b1:
  • region.zenith.count.opaque
  • region.sun.count.thin
  • region.zenith.count.thin
  • Cloud amount, thin (percent)(percent.thin)
  • count.opaque
  • count.thin
  • region.sun.count.opaque
  • count.sky
  • region.horizon.count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count.thin


Back To Table of Contents

DQRID : D150428.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
04/13/2015213504/27/20152302Missing
Subject:
NSA/TSI/C1 - Communication
DataStreams:nsatsicldmaskC1.a1, nsatsimovieC1.a1, nsatsiskycoverC1.b1, nsatsiskyimageC1.a1
Description:
A software communication error occurred with the camera. The problem was corrected by 
power-cycling the instrument.
Measurements:nsatsiskycoverC1.b1:
  • region.zenith.count.opaque
  • count.sub.horz
  • count.thin
  • base_time
  • region.horizon.count.opaque
  • region.sun.count
  • region.horizon.count.thin
  • North latitude(lat)
  • region.sun.count.thin
  • solar.altitude
  • sun.strength
  • count.box
  • region.sun.count.opaque
  • count.mask
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.sub.proczen
  • solar.azimuth
  • East longitude(lon)
  • count.opaque
  • Cloud amount, thin (percent)(percent.thin)
  • count.unknown
  • Altitude above mean sea level(alt)
  • time
  • region.horizon.count
  • time_offset
  • region.zenith.count
  • Sunshine Meter(sunny)
  • region.zenith.count.thin
  • count.sky

nsatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)

nsatsimovieC1.a1:
  • MPEG data stream - documentation not yet available

nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D160401.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/27/2016155703/31/20160021Incorrect
Subject:
NSA/TSI/C1 - frost on lens
DataStreams:nsatsicldmaskC1.a1, nsatsiskyimageC1.a1, nsatsiskycoverC1.b1
Description:
The camera lens window was covered with frost because the thermal pad in camera housing 
was not powered on.
Measurements:nsatsiskycoverC1.b1:
  • region.zenith.count.opaque
  • Cloud amount, thin (percent)(percent_thin)
  • region_horizon_count_opaque
  • Cloud amount, thin (percent)(percent.thin)
  • count_sky
  • count.opaque
  • count.thin
  • region_sun_count_opaque
  • count_opaque
  • region_zenith_count_thin
  • region_horizon_count_thin
  • region.horizon.count.opaque
  • region.horizon.count.thin
  • count_thin
  • region.sun.count.thin
  • region.zenith.count.thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • region_sun_count_thin
  • region.sun.count.opaque
  • count.sky
  • Cloud amount, opaque (percent)(percent.opaque)
  • region_zenith_count_opaque

nsatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)

nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D160404.5
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/14/2016195805/06/20162216Incorrect
Subject:
NSA/TSI/C1 - Reprocess: Sky filter thresholds
DataStreams:nsatsicldmaskC1.a1, nsatsiskycoverC1.b1
Description:
The sky filter thresholds are incorrect causing poor fractional cloud cover values.

The cldmask images and fractional sky cover values will be reprocessed by changing the sky 
filter thresholds thin_thresh from 45 to 50 and opaque_thresh from 70 to 90.
Measurements:nsatsiskycoverC1.b1:
  • region.zenith.count.opaque
  • Cloud amount, thin (percent)(percent_thin)
  • region_horizon_count_opaque
  • Cloud amount, thin (percent)(percent.thin)
  • count_sky
  • count.opaque
  • count.thin
  • region_sun_count_opaque
  • count_opaque
  • region_zenith_count_thin
  • region_horizon_count_thin
  • region.horizon.count.opaque
  • region.horizon.count.thin
  • count_thin
  • region.sun.count.thin
  • region.zenith.count.thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • region_sun_count_thin
  • region.sun.count.opaque
  • count.sky
  • Cloud amount, opaque (percent)(percent.opaque)
  • region_zenith_count_opaque

nsatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D160422.1
Start DateStart TimeEnd DateEnd Time Data Quality Metric
04/05/2016151204/14/20161823Suspect
Subject:
NSA/TSI/C1 - Condensation on lens
DataStreams:nsatsicldmaskC1.a1, nsatsiskyimageC1.a1, nsatsiskycoverC1.b1
Description:
The images and fractional sky cover values are affected by moisture inside the camera 
housing. The desiccant was added.
Measurements:nsatsiskycoverC1.b1:
  • region.zenith.count.opaque
  • count.sub.horz
  • Cloud amount, thin (percent)(percent_thin)
  • count_sky
  • count.thin
  • region_sun_count_opaque
  • region_zenith_count_thin
  • region_horizon_count_thin
  • region.horizon.count.opaque
  • region.sun.count
  • region.horizon.count.thin
  • region.sun.count.thin
  • region_zenith_count
  • region_sun_count_thin
  • region_sun_count
  • region.sun.count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • region_zenith_count_opaque
  • region_horizon_count_opaque
  • count.opaque
  • Cloud amount, thin (percent)(percent.thin)
  • count_opaque
  • region.horizon.count
  • count_thin
  • region.zenith.count
  • region.zenith.count.thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • count_sub_horz
  • count.sky
  • region_horizon_count

nsatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)

nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D160718.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
07/12/2016151007/15/20160000Missing
Subject:
NSA/ECOR/TSI/C1/E10 - Data Missing
DataStreams:nsatsimovieC1.a1, nsatsiskyimageC1.a1, nsatsiskycoverC1.b1, nsatsicldmaskC1.a1
Description:
Site data systems were being upgraded during this time.
Measurements:nsatsiskycoverC1.b1:
  • count.sub.horz
  • Cloud amount, thin (percent)(percent_thin)
  • count_sky
  • count.thin
  • qc_count_sky
  • region_sun_count_opaque
  • region.sun.count
  • qc_percent_opaque
  • region.sun.count.thin
  • count_sub_proczen
  • region_zenith_count
  • solar.altitude
  • qc_sunny
  • region.sun.count.opaque
  • qc_region_zenith_count_thin
  • count.mask
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.sub.proczen
  • solar_altitude
  • qc_percent_thin
  • Cloud amount, thin (percent)(percent.thin)
  • qc_count_sub_horz
  • qc_solar_azimuth
  • Altitude above mean sea level(alt)
  • count_thin
  • time
  • qc_count_mask
  • count.sky
  • qc_time
  • region_horizon_count
  • region.zenith.count.opaque
  • qc_count_sub_proczen
  • qc_region_horizon_count_opaque
  • base_time
  • qc_region_sun_count
  • region_zenith_count_thin
  • region.horizon.count.opaque
  • region_horizon_count_thin
  • region.horizon.count.thin
  • North latitude(lat)
  • count_mask
  • qc_region_zenith_count_opaque
  • region_sun_count_thin
  • region_sun_count
  • qc_region_zenith_count
  • sun.strength
  • qc_solar_altitude
  • count.box
  • qc_region_horizon_count_thin
  • region_zenith_count_opaque
  • solar.azimuth
  • region_horizon_count_opaque
  • East longitude(lon)
  • count.opaque
  • count_box
  • qc_region_sun_count_thin
  • qc_count_opaque
  • count_opaque
  • qc_region_horizon_count
  • qc_sun_strength
  • count.unknown
  • region.horizon.count
  • time_offset
  • region.zenith.count
  • solar_azimuth
  • region.zenith.count.thin
  • Sunshine Meter(sunny)
  • qc_count_thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • qc_count_unknown
  • qc_region_sun_count_opaque
  • sun_strength
  • count_sub_horz
  • count_unknown
  • qc_count_box

nsatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)

nsatsimovieC1.a1:
  • MPEG data stream - documentation not yet available

nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D160824.11
Start DateStart TimeEnd DateEnd Time Data Quality Metric
03/12/2016002803/14/20161958Incorrect
Subject:
NSA/TSI/C1 - Re-installation
DataStreams:nsatsicldmaskC1.a1, nsatsimovieC1.a1, nsatsiskyimageC1.a1, nsatsiskycoverC1.b1
Description:
The TSI required maintenance and configuration after being re-installed after winter.
Measurements:nsatsiskycoverC1.b1:
  • count.sub.horz
  • region.zenith.count.opaque
  • Cloud amount, thin (percent)(percent_thin)
  • count_sky
  • count.thin
  • region_sun_count_opaque
  • region_zenith_count_thin
  • region_horizon_count_thin
  • region.horizon.count.opaque
  • region.sun.count
  • region.horizon.count.thin
  • count_sub_proczen
  • region.sun.count.thin
  • count_mask
  • region_zenith_count
  • region_sun_count_thin
  • region_sun_count
  • sun.strength
  • count.box
  • region.sun.count.opaque
  • count.mask
  • Cloud amount, opaque (percent)(percent.opaque)
  • region_zenith_count_opaque
  • count.sub.proczen
  • region_horizon_count_opaque
  • count.opaque
  • Cloud amount, thin (percent)(percent.thin)
  • count_box
  • count_opaque
  • count.unknown
  • count_thin
  • region.horizon.count
  • region.zenith.count
  • Sunshine Meter(sunny)
  • region.zenith.count.thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • sun_strength
  • count_sub_horz
  • count.sky
  • count_unknown
  • region_horizon_count

nsatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)

nsatsimovieC1.a1:
  • MPEG data stream - documentation not yet available

nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D170216.22
Start DateStart TimeEnd DateEnd Time Data Quality Metric
11/10/2016000002/07/20172011Missing
Subject:
NSA/TSI/C1- winter season
DataStreams:nsatsimovieC1.a1, nsatsiskycoverC1.b1, nsatsiskyimageC1.a1, nsatsicldmaskC1.a1
Description:
The TSI was shutdown and removed for the winter solar night.
Measurements:nsatsiskycoverC1.b1:
  • count.sub.horz
  • Cloud amount, thin (percent)(percent_thin)
  • count_sky
  • count.thin
  • qc_count_sky
  • region_sun_count_opaque
  • region.sun.count
  • qc_percent_opaque
  • region.sun.count.thin
  • count_sub_proczen
  • region_zenith_count
  • solar.altitude
  • qc_sunny
  • region.sun.count.opaque
  • qc_region_zenith_count_thin
  • count.mask
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.sub.proczen
  • solar_altitude
  • qc_percent_thin
  • Cloud amount, thin (percent)(percent.thin)
  • qc_count_sub_horz
  • qc_solar_azimuth
  • Altitude above mean sea level(alt)
  • count_thin
  • time
  • qc_count_mask
  • count.sky
  • qc_time
  • region_horizon_count
  • region.zenith.count.opaque
  • qc_count_sub_proczen
  • qc_region_horizon_count_opaque
  • base_time
  • qc_region_sun_count
  • region_zenith_count_thin
  • region.horizon.count.opaque
  • region_horizon_count_thin
  • region.horizon.count.thin
  • North latitude(lat)
  • count_mask
  • qc_region_zenith_count_opaque
  • region_sun_count_thin
  • region_sun_count
  • qc_region_zenith_count
  • sun.strength
  • qc_solar_altitude
  • count.box
  • qc_region_horizon_count_thin
  • region_zenith_count_opaque
  • solar.azimuth
  • region_horizon_count_opaque
  • East longitude(lon)
  • count.opaque
  • count_box
  • qc_region_sun_count_thin
  • qc_count_opaque
  • count_opaque
  • qc_region_horizon_count
  • qc_sun_strength
  • count.unknown
  • region.horizon.count
  • time_offset
  • region.zenith.count
  • solar_azimuth
  • region.zenith.count.thin
  • Sunshine Meter(sunny)
  • qc_count_thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • qc_count_unknown
  • qc_region_sun_count_opaque
  • sun_strength
  • count_sub_horz
  • count_unknown
  • qc_count_box

nsatsicldmaskC1.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)

nsatsimovieC1.a1:
  • MPEG data stream - documentation not yet available

nsatsiskyimageC1.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D170216.27
Start DateStart TimeEnd DateEnd Time Data Quality Metric
02/07/2017201102/14/20170014Suspect
Subject:
NSA/TSI/C1 - Re-installation
DataStreams:nsatsiskycoverC1.b1
Description:
The TSI was being configured upon re-installation after the winter.
Measurements:nsatsiskycoverC1.b1:
  • region.zenith.count.opaque
  • Cloud amount, thin (percent)(percent_thin)
  • region_horizon_count_opaque
  • Cloud amount, thin (percent)(percent.thin)
  • count.opaque
  • count.thin
  • region_sun_count_opaque
  • count_opaque
  • region_zenith_count_thin
  • region_horizon_count_thin
  • region.horizon.count.opaque
  • region.horizon.count.thin
  • count_thin
  • region.sun.count.thin
  • region.zenith.count.thin
  • Cloud amount, opaque (percent)(percent_opaque)
  • region_sun_count_thin
  • region.sun.count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • region_zenith_count_opaque


Back To Table of Contents



END OF DATA