Data Quality Report

Data Quality Report for Order ID: 187496
User ID: schenkelsm1 Date completed: 2017-08-31

All DQRs

DQR ID	Subject	Affected Data Streams	Data Quality Metric
D170215.2	ASI/MPL/M1 - Reprocess: Ingest now includes afterpulse	asimplpolfsM1.b1	Note
D170802.3	ASI/MPLCMASK/M1 - Reprocess: Instrument correction error	asi30smplcmask1zwangM1.c1	Suspect
D161019.2	ASI/MPL/M1 - Reprocessed and Corrected: New overlap correction	asimplpolfsM1.b1	Note
D170316.1	ASI/CEIL/S1 - Reprocessed and Corrected: Incorrect averaging_inverval global attribute	asiceilS1.b1	Note

DQR ID: D170215.2 (Back to Top)

Start Date	Start Time	End Date	End Time	Data Quality Metric
2016-09-01	00:00:00	2017-02-15	23:59:59	Note

Subject:	ASI/MPL/M1 - Reprocess: Ingest now includes afterpulse
Affected Datastreams:	asimplpolfsM1.b1
Description	Afterpulse calibration procedures are being performed every quarter starting September 2016. Ingest has been modified to include afterpulse corrections in netcdf data files. Data needs to be re-processed to reflect these changes.
Measurements	lon (East longitude) num_bins (Number of bins stored in data block) num_channels (Number of detector channels) laser_temp (Laser temperature) overlap_correction (Overlap correction factor) qc_laser_temp (Quality check results on field: Laser temperature) height (Height above ground of the center of corresponding range_bin) background_signal_std_co_pol (Background signal standard deviation, copol data) time (Time offset from midnight) base_time (Base time in Epoch) energy_monitor (Energy output per pulse of transmitted laser beam at 532 nm (Doubled Nd-YLF)) range_offset (Distance between initial range_bin and the laser flash) deadtime_correction_counts (Laboratory measured counts used to calculate the deadtime correction samples) time_offset (Time offset from base_time) qc_detector_temp (Quality check results on field: Detector temperature) shots_per_avg (Number of laser pulses summed during averaging interval) polarization_control_voltage (Polarization control voltage setting) background_signal_co_pol (Background signal, copol data) qc_range_offset (Quality check results on field: Distance between initial range_bin and the laser flash) signal_return_co_pol (Attenuated backscatter, copol) range (Distance to the center of the corresponding range bin) overlap_correction_heights (Heights for overlap correction) polarization_control (Polarization control enabled flag) range_bin_time (Time in seconds for each range bin of multichannel scalar card.) range_bins (Distance from leading edge of first range bin to the center of each bin.) background_signal_std_cross_pol (Background signal standard deviation, cross pol data) range (Distance from transceiver to center of corresponding range_bin) dead_time_corrected (Dead time correction flag) qc_signal_return_cross_pol (Quality check results on field: Attenuated backscatter, cross pol) pulse_rep (Repetition rate, or Trigger Frequency of the laser) mcs_mode (MCS mode register.) lat (North latitude) deadtime_correction (Deadtime correction factor) qc_scope_temp (Quality check results on field: Telescope temperature) first_data_bin (Bin number of first data. Tells where pretrigger timing ends and end of region for background data sampling) range_bin_width (Width of range-bins calculated from range_bin_time) qc_energy_monitor (Quality check results on field: Energy output per pulse of transmitted laser beam at 532 nm (Doubled Nd-YLF)) qc_signal_return_co_pol (Quality check results on field: Attenuated backscatter, copol) scope_temp (Telescope temperature) detector_temp (Detector temperature) laser_fire_bin (Bin number associated with zero height and time where laser transmit occurs) alt (Altitude above mean sea level) overlap_correction (Overlap correction) signal_return_cross_pol (Attenuated backscatter, cross pol) max_altitude (Maximum altitude retrieved from multichannel scalar card.) background_signal_cross_pol (Background signal, cross pol data) height (Vertical height above ground level (AGL) corresponding to the bottom of height bin)

DQR ID: D170802.3 (Back to Top)

Start Date	Start Time	End Date	End Time	Data Quality Metric
2016-07-02	00:00:00	2017-07-25	23:59:59	Suspect

Subject:	ASI/MPLCMASK/M1 - Reprocess: Instrument correction error
Affected Datastreams:	asi30smplcmask1zwangM1.c1
Description	Overlap and dead-time instrument corrections in the 30smplcmask1zwang VAP were not applied in the correct order. As a result, very high backscatter signals near 500 m can sometimes exceed the acceptable maximum signal for applying a dead-time correction. Regions, where the dead-time correction is not applied, appear as an artificial band or artifact. Cloud detection is not impacted by this issue.
Measurements	linear_depol_ratio (Linear depolarization ratio) backscatter (Backscatter) linear_depol_snr (Signal to noise ratio for the linear depolarization ratio) backscatter (Total attenuated backscatter) backscatter_snr (Signal to noise ratio of backscatter)

DQR ID: D161019.2 (Back to Top)

Start Date	Start Time	End Date	End Time	Data Quality Metric
2016-07-02	13:00:00	2016-10-27	23:59:59	Note

Subject:	ASI/MPL/M1 - Reprocessed and Corrected: New overlap correction
Affected Datastreams:	asimplpolfsM1.b1
Description	DATA REPROCESSED and CORRECTED: Vendor recently provided an updated overlap correction file which needed to replace the current overlap correction file in use. Data were reprocessed to reflect this new file. This does not affect MPL data quality.  The data were archived in December 2016. Please retrieve the reprocessed data for use in your analysis. You may find these data using the ARM Discovery tool at the following link: http://www.archive.arm.gov/discovery/#v/results/s/finst::{inst}/fsite::{site}/ffac::{site}.{fac} ORIGINAL DQR CATEGORY: Transparent - Does not affect quality REPROCESSED and CORRECTED DATA ARCHIVED:2016-12 REPROCESS IDENTIFICATION NUMBER: RID 1510 --------------------------------------------------- --- ORIGINAL DQR DESCRIPTION --- --------------------------------------------------- Vendor has recently provided an overlap correction which needs to replace the overlap currently being included in the data files. This does not affect MPL data quality.
Measurements	overlap_correction (Overlap correction) overlap_correction (Overlap correction factor) overlap_correction_heights (Heights for overlap correction)

DQR ID: D170316.1 (Back to Top)

Start Date	Start Time	End Date	End Time	Data Quality Metric
2016-05-24	17:30:00	2016-11-14	15:59:59	Note

Subject:	ASI/CEIL/S1 - Reprocessed and Corrected: Incorrect averaging_inverval global attribute
Affected Datastreams:	asiceilS1.b1
Description	DATA REPROCESSED and CORRECTED: When the ceilometer software was changed from CT-View to CL-View, several firmware configuration changes were made to the model CT25K for consistency with the CL31 at other sites, including the data acquisition interval which was changed from 15 to 16 seconds. However, the global attribute "averaging_interval" in the ceil datastream was not changed. Reprocessing has corrected the global attribute averaging_interval to reflect this change. The data were archived in August 2017. Please retrieve the reprocessed data for use in your analysis. You may find these data using the ARM Discovery tool at the following link: http://www.archive.arm.gov/discovery/#v/results/s/finst::ceil/ffac::asi.S1 ORIGINAL DQR CATEGORY: Note (Important information about data or metadata ) REPROCESSED and CORRECTED DATA ARCHIVED: 2017-08 REPROCESS IDENTIFICATION NUMBER: RID 1573 --------------------------------------------------- --- ORIGINAL DQR DESCRIPTION --- --------------------------------------------------- When the ceilometer software was changed from CT-View to CL-View, several firmware configuration changes were made to the model CT25K for consistency with the CL31 at other sites, including the data acquisition interval which was changed from 15 to 16 seconds. However, the global attribute "averaging_interval" in the ceil datastream was not changed. --------------------------------------------------- --- ORIGINAL DQR SUGGESTIONS --- --------------------------------------------------- These data can be reprocessed to correct the attribute "averaging_interval" from 11.5 seconds to 16 seconds.
Measurements	base_time (Base time in Epoch)