Data Quality Report for Order ID: 187936
User ID: karpinskim1    Date completed: 2017-09-25
All DQRs
DQR ID Subject Affected Data Streams Data Quality Metric
D160923.5 AWR/TSI/M1 - Collection awrtsiskycoverM1.b1 Note
D160921.1 AWR/TSI/M1 - polar night awrtsiskycoverM1.b1 Missing
D160322.3 AWR/TSI/M1 - Reprocessed and Corrected: Sky filter thresholds awrtsiskycoverM1.b1 Reprocessed
D161216.8 AWR/TSI/M1 - Shadowband misalignment awrtsiskycoverM1.b1 Suspect
D161021.8 AWR/TSI/M1 - Snow infiltration awrtsiskycoverM1.b1 Incorrect
D160928.1 AWR/TSI/M1 - Shadowband misalignment awrtsiskycoverM1.b1 Incorrect
D160826.2 AWR/CEIL/M1 - Window contamination awrceilM1.b1 Suspect
D170301.22 AWR/TSI/M1 - Reprocess: Global attribute units incorrect for cam_mir_dist awrtsiskycoverM1.b1 Incorrect
 
DQR ID: D160923.5    (Back to Top)
Start Date Start Time End Date End Time Data Quality Metric
2016-09-07 00:00:00 2016-09-20 16:20:59 Note
Subject: AWR/TSI/M1 - Collection
Affected Datastreams: awrtsiskycoverM1.b1
Description The scheduled task that starts the software each day at 12:58, was not enabled. This resulted in intermittent loss of data.
Measurements
  • qc_count_sub_proczen (Quality check results on field: Pixel count: number total between horizon and processed circle)
  • qc_percent_opaque (Quality check results on field: Percent opaque cloud)
  • count_sub_horz (Pixel count: number below horizon in image)
  • count_opaque (Pixel count: number total opaque)
  • count_unknown (Pixel count: number total indeterminate)
  • qc_region_zenith_count_thin (Quality check results on field: Pixel count: number thin in zenith circle)
  • qc_percent_thin (Quality check results on field: Percent thin cloud)
  • count_thin (Pixel count: number total thin)
  • lon (East longitude)
  • qc_region_horizon_count (Quality check results on field: Pixel count: number total in horizon area)
  • qc_count_box (Quality check results on field: Pixel count: number in box, outside mirror area)
  • qc_count_sky (Quality check results on field: Pixel count: number total in processed circle)
  • region_horizon_count_opaque (Pixel count: number opaque in horizon area)
  • qc_region_horizon_count_opaque (Quality check results on field: Pixel count: number opaque in horizon area)
  • qc_count_thin (Quality check results on field: Pixel count: number total thin)
  • qc_sunny (Quality check results on field: Sunshine meter)
  • qc_count_opaque (Quality check results on field: Pixel count: number total opaque)
  • region_sun_count_opaque (Pixel count: number opaque in sun circle)
  • region_sun_count_thin (Pixel count: number thin in sun circle)
  • count_sub_proczen (Pixel count: number total between horizon and processed circle)
  • region_horizon_count_thin (Pixel count: number thin in horizon area)
  • region_zenith_count_opaque (Pixel count: number opaque in zenith circle)
  • qc_region_sun_count (Quality check results on field: Pixel count: number total in sun circle)
  • qc_time (Quality check results on field: Time offset from midnight)
  • qc_count_unknown (Quality check results on field: Pixel count: number total indeterminate)
  • qc_sun_strength (Quality check results on field: Relative 'strength' of direct sun)
  • qc_region_zenith_count_opaque (Quality check results on field: Pixel count: number opaque in zenith circle)
  • region_sun_count (Pixel count: number total in sun circle)
  • region_zenith_count (Pixel count: number total in zenith circle)
  • region_zenith_count_thin (Pixel count: number thin in zenith circle)
  • percent_opaque (Percent opaque cloud)
  • alt (Altitude above mean sea level)
  • count_box (Pixel count: number in box, outside mirror area)
  • sunny (Sunshine meter)
  • qc_count_mask (Quality check results on field: Pixel count: number in camera and sun strip mask)
  • qc_solar_azimuth (Quality check results on field: Solar azimuth angle)
  • qc_region_horizon_count_thin (Quality check results on field: Pixel count: number thin in horizon area)
  • count_sky (Pixel count: number total in processed circle)
  • time_offset (Time offset from base_time)
  • time (Time offset from midnight)
  • sun_strength (Relative 'strength' of direct sun)
  • qc_region_zenith_count (Quality check results on field: Pixel count: number total in zenith circle)
  • percent_thin (Percent thin cloud)
  • qc_region_sun_count_thin (Quality check results on field: Pixel count: number thin in sun circle)
  • qc_count_sub_horz (Quality check results on field: Pixel count: number below horizon in image)
  • region_horizon_count (Pixel count: number total in horizon area)
  • base_time (Base time in Epoch)
  • solar_azimuth (Solar azimuth angle)
  • solar_altitude (Sun altitude above horizon)
  • qc_solar_altitude (Quality check results on field: Sun altitude above horizon)
  • qc_region_sun_count_opaque (Quality check results on field: Pixel count: number opaque in sun circle)
  • count_mask (Pixel count: number in camera and sun strip mask)
  • lat (North latitude)
 
DQR ID: D160921.1    (Back to Top)
Start Date Start Time End Date End Time Data Quality Metric
2016-04-13 01:03:00 2016-08-29 02:37:00 Missing
Subject: AWR/TSI/M1 - polar night
Affected Datastreams: awrtsiskycoverM1.b1
Description The sun did not rise above 3 deg elevation, required for image processing, due to the polar night.
Measurements
  • qc_count_sub_proczen (Quality check results on field: Pixel count: number total between horizon and processed circle)
  • qc_percent_opaque (Quality check results on field: Percent opaque cloud)
  • count_sub_horz (Pixel count: number below horizon in image)
  • count_opaque (Pixel count: number total opaque)
  • count_unknown (Pixel count: number total indeterminate)
  • qc_region_zenith_count_thin (Quality check results on field: Pixel count: number thin in zenith circle)
  • qc_percent_thin (Quality check results on field: Percent thin cloud)
  • count_thin (Pixel count: number total thin)
  • lon (East longitude)
  • qc_region_horizon_count (Quality check results on field: Pixel count: number total in horizon area)
  • qc_count_box (Quality check results on field: Pixel count: number in box, outside mirror area)
  • region_horizon_count_opaque (Pixel count: number opaque in horizon area)
  • qc_count_sky (Quality check results on field: Pixel count: number total in processed circle)
  • qc_sunny (Quality check results on field: Sunshine meter)
  • qc_count_thin (Quality check results on field: Pixel count: number total thin)
  • qc_region_horizon_count_opaque (Quality check results on field: Pixel count: number opaque in horizon area)
  • qc_count_opaque (Quality check results on field: Pixel count: number total opaque)
  • region_sun_count_opaque (Pixel count: number opaque in sun circle)
  • region_sun_count_thin (Pixel count: number thin in sun circle)
  • count_sub_proczen (Pixel count: number total between horizon and processed circle)
  • region_horizon_count_thin (Pixel count: number thin in horizon area)
  • region_zenith_count_opaque (Pixel count: number opaque in zenith circle)
  • qc_region_sun_count (Quality check results on field: Pixel count: number total in sun circle)
  • qc_time (Quality check results on field: Time offset from midnight)
  • qc_count_unknown (Quality check results on field: Pixel count: number total indeterminate)
  • qc_sun_strength (Quality check results on field: Relative 'strength' of direct sun)
  • qc_region_zenith_count_opaque (Quality check results on field: Pixel count: number opaque in zenith circle)
  • region_sun_count (Pixel count: number total in sun circle)
  • region_zenith_count (Pixel count: number total in zenith circle)
  • region_zenith_count_thin (Pixel count: number thin in zenith circle)
  • percent_opaque (Percent opaque cloud)
  • alt (Altitude above mean sea level)
  • count_box (Pixel count: number in box, outside mirror area)
  • sunny (Sunshine meter)
  • qc_count_mask (Quality check results on field: Pixel count: number in camera and sun strip mask)
  • qc_solar_azimuth (Quality check results on field: Solar azimuth angle)
  • qc_region_horizon_count_thin (Quality check results on field: Pixel count: number thin in horizon area)
  • count_sky (Pixel count: number total in processed circle)
  • time_offset (Time offset from base_time)
  • sun_strength (Relative 'strength' of direct sun)
  • time (Time offset from midnight)
  • qc_region_zenith_count (Quality check results on field: Pixel count: number total in zenith circle)
  • percent_thin (Percent thin cloud)
  • qc_region_sun_count_thin (Quality check results on field: Pixel count: number thin in sun circle)
  • qc_count_sub_horz (Quality check results on field: Pixel count: number below horizon in image)
  • region_horizon_count (Pixel count: number total in horizon area)
  • solar_altitude (Sun altitude above horizon)
  • solar_azimuth (Solar azimuth angle)
  • base_time (Base time in Epoch)
  • qc_solar_altitude (Quality check results on field: Sun altitude above horizon)
  • qc_region_sun_count_opaque (Quality check results on field: Pixel count: number opaque in sun circle)
  • count_mask (Pixel count: number in camera and sun strip mask)
  • lat (North latitude)
 
DQR ID: D160322.3    (Back to Top)
Start Date Start Time End Date End Time Data Quality Metric
2015-12-01 00:00:00 2016-03-18 22:19:00 Reprocessed
Subject: AWR/TSI/M1 - Reprocessed and Corrected: Sky filter thresholds
Affected Datastreams: awrtsiskycoverM1.b1
Description DATA REPROCESSED and CORRECTED: The sky filter thresholds were incorrect causing poor fractional cloud cover values. The filter threshold thin_thresh was changed from 50 to 10 and opaque_thresh was changed from 70 to 90. 
The data were archived in July 2017. Please retrieve the reprocessed data for use in your analysis. You may find these data using the ARM Discovery tool at the following link: http://www.archive.arm.gov/discovery/#v/results/s/finst::tsi/ffac::awr.M1 ORIGINAL DQR CATEGORY: Red-Incorrect REPROCESSED and CORRECTED DATA ARCHIVED: 2017-07 REPROCESS IDENTIFICATION NUMBER: RID 1448 --------------------------------------------------- --- ORIGINAL DQR DESCRIPTION --- --------------------------------------------------- The sky filter thresholds incorrect. --------------------------------------------------- --- ORIGINAL DQR SUGGESTIONS --- --------------------------------------------------- The cldmask images and fractional sky cover values cane be reprocessed by changing the sky filter thresholds from thin_thresh=50 and opaque_thresh=70 to 10 and 90, respectively.
Measurements
  • percent_opaque (Percent opaque cloud)
  • percent_thin (Percent thin cloud)
  • region_sun_count_opaque (Pixel count: number opaque in sun circle)
  • region_sun_count_thin (Pixel count: number thin in sun circle)
  • count_opaque (Pixel count: number total opaque)
  • region_horizon_count_thin (Pixel count: number thin in horizon area)
  • count_thin (Pixel count: number total thin)
  • region_zenith_count_opaque (Pixel count: number opaque in zenith circle)
  • region_horizon_count_opaque (Pixel count: number opaque in horizon area)
  • region_zenith_count_thin (Pixel count: number thin in zenith circle)
 
DQR ID: D161216.8    (Back to Top)
Start Date Start Time End Date End Time Data Quality Metric
2016-12-07 00:44:30 2016-12-10 01:46:00 Suspect
Subject: AWR/TSI/M1 - Shadowband misalignment
Affected Datastreams: awrtsiskycoverM1.b1
Description The shadowband was slightly misaligned so the sun was not being masked completely.
Measurements
  • percent_opaque (Percent opaque cloud)
  • percent_thin (Percent thin cloud)
  • region_sun_count_opaque (Pixel count: number opaque in sun circle)
  • region_sun_count_thin (Pixel count: number thin in sun circle)
  • count_opaque (Pixel count: number total opaque)
  • region_horizon_count_thin (Pixel count: number thin in horizon area)
  • count_thin (Pixel count: number total thin)
  • region_zenith_count_opaque (Pixel count: number opaque in zenith circle)
  • count_sky (Pixel count: number total in processed circle)
  • region_horizon_count_opaque (Pixel count: number opaque in horizon area)
  • region_zenith_count_thin (Pixel count: number thin in zenith circle)
 
DQR ID: D161021.8    (Back to Top)
Start Date Start Time End Date End Time Data Quality Metric
2016-10-12 01:06:00 2016-10-15 01:41:00 Incorrect
Subject: AWR/TSI/M1 - Snow infiltration
Affected Datastreams: awrtsiskycoverM1.b1
Description The lid of the TSI enclosure was not secured properly on 9/23 allowing snow infiltration which caused the mirror control board to malfunction on 10/12 so the shadowband did not mask the sun. The TSI was shutdown on 10/14, brought inside on to thaw and dry out, and reinstalled on 10/15.
Measurements
  • percent_opaque (Percent opaque cloud)
  • percent_thin (Percent thin cloud)
  • region_sun_count_opaque (Pixel count: number opaque in sun circle)
  • region_sun_count_thin (Pixel count: number thin in sun circle)
  • region_horizon_count_thin (Pixel count: number thin in horizon area)
  • count_opaque (Pixel count: number total opaque)
  • count_thin (Pixel count: number total thin)
  • region_zenith_count_opaque (Pixel count: number opaque in zenith circle)
  • region_horizon_count_opaque (Pixel count: number opaque in horizon area)
  • sun_strength (Relative 'strength' of direct sun)
  • region_zenith_count_thin (Pixel count: number thin in zenith circle)
 
DQR ID: D160928.1    (Back to Top)
Start Date Start Time End Date End Time Data Quality Metric
2016-09-23 01:05:00 2016-09-23 23:38:00 Incorrect
Subject: AWR/TSI/M1 - Shadowband misalignment
Affected Datastreams: awrtsiskycoverM1.b1
Description The mirror became loose from the shaft, probably due to high winds and cold temperatures, so that the shadowband was not masking the sun. The mirror was secured and the shadowband realigned.
Measurements
  • percent_thin (Percent thin cloud)
  • percent_opaque (Percent opaque cloud)
  • region_sun_count_opaque (Pixel count: number opaque in sun circle)
  • region_sun_count_thin (Pixel count: number thin in sun circle)
  • region_horizon_count_thin (Pixel count: number thin in horizon area)
  • count_opaque (Pixel count: number total opaque)
  • count_thin (Pixel count: number total thin)
  • region_zenith_count_opaque (Pixel count: number opaque in zenith circle)
  • count_sky (Pixel count: number total in processed circle)
  • region_horizon_count_opaque (Pixel count: number opaque in horizon area)
  • region_zenith_count_thin (Pixel count: number thin in zenith circle)
 
DQR ID: D160826.2    (Back to Top)
Start Date Start Time End Date End Time Data Quality Metric
2016-08-21 21:13:00 2016-08-26 00:00:00 Suspect
Subject: AWR/CEIL/M1 - Window contamination
Affected Datastreams: awrceilM1.b1
Description The blower failed allowing contamination of the window. The blower was replaced.
Measurements
  • first_cbh (Lowest cloud base height detected)
  • vertical_visibility (Vertical visibility)
  • alt_highest_signal (Altitude of highest signal)
  • second_cbh (Second lowest cloud base height)
  • third_cbh (Third cloud base height)
  • sum_backscatter (Sum of detected and normalized backscatter)
  • background_light (Background light)
  • backscatter (Backscatter)
 
DQR ID: D170301.22    (Back to Top)
Start Date Start Time End Date End Time Data Quality Metric
2015-12-01 00:00:00 2017-01-01 23:59:59 Incorrect
Subject: AWR/TSI/M1 - Reprocess: Global attribute units incorrect for cam_mir_dist
Affected Datastreams: awrtsiskycoverM1.b1
Description The global attribute cam_mir_dist was converted incorrectly. The raw camera.mirror.distance, in inches, was multiplied by 10 and assigned a unit of mm.
Measurements
  • base_time (Base time in Epoch)