DQR ID | Subject | Data Streams Affected |
---|---|---|
D020905.3 | SGP/MWR/C1 - Reprocess: IRT insufficiently insulated | sgpmwrlosC1.a1, sgpmwrlosC1.b1 |
D020905.4 | SGP/IRT10m/C1 - Reprocess: IRT insufficiently insulated | sgpirt10mC1.b1 |
D050502.2 | SGP/SIRS/C1 - SWFANAL Data description error | sgp15swfanalsirs1longC1.c1, sgp1swfanalsirs1longC1.c1 |
D970317.1 | downwelling solar irradiance measurement adjustments | sgpbsrnC1.a1, sgpsirosE13.a1 |
D990106.1 | SGP/MWR/B1/B4/B6/C1 - software change | sgpmwrlosB1.a0, sgpmwrlosB1.a1, sgpmwrlosB4.a0, sgpmwrlosB4.a1, sgpmwrlosB6.a0, sgpmwrlosB6.a1, sgpmwrlosC1.a1, sgpmwrlosC1.b1, sgpmwrtipB1.a0, sgpmwrtipB4.a0, sgpmwrtipB6.a0 |
D990113.1 | SGP/MWR/B1/B4/B5/B6/C1 - software upgrade (version 3.27) | sgpmwrlosB1.a1, sgpmwrlosB4.a1, sgpmwrlosB5.a1, sgpmwrlosB6.a1, sgpmwrlosC1.a1, sgpmwrlosC1.b1, sgpmwrtipB1.a0, sgpmwrtipB4.a0, sgpmwrtipB5.a0, sgpmwrtipB6.a0 |
Start Date | Start Time | End Date | End Time |
---|---|---|---|
01/19/1994 | 0000 | 11/27/1998 | 1930 |
Subject: | SGP/MWR/C1 - Reprocess: IRT insufficiently insulated |
DataStreams: | sgpmwrlosC1.a1, sgpmwrlosC1.b1 |
Description: | The downwelling IRT was insufficiently insulated to maintain an internal reference temperature above 0 degrees C. Measurements of sky temperature were over-estimated when instrument was below freezing. Data will be reprocessed, but users can correct data using the following correction factor: If T_reference < -5?C, then IRT_corrected = (IRT_original - 32.993K)/0.87238 where T_reference can be estimated with the ambient temperature (e.g. tkair) |
Measurements: | sgpmwrlosC1.a1:
sgpmwrlosC1.b1:
|
Start Date | Start Time | End Date | End Time |
---|---|---|---|
05/19/1997 | 0000 | 12/24/1998 | 1845 |
Subject: | SGP/IRT10m/C1 - Reprocess: IRT insufficiently insulated |
DataStreams: | sgpirt10mC1.b1 |
Description: | The upwelling IRT on the 10m tower was insufficiently insulated to maintain an internal reference temperature above 0 degrees C. Measurements of surface temperature were over-estimated when instrument was below freezing. Data will be reprocessed, but users can correct data using the following correction factor: If T_reference < -5?C, then IRT_corrected = (IRT_original - 32.993K)/0.87238 where T_reference can be estimated with ambient temperature (e.g. inst_up_long_hemisp_dome_temp or inst_up_long_dome_temp from SGP.E13 SIRS) |
Measurements: | sgpirt10mC1.b1:
|
Start Date | Start Time | End Date | End Time |
---|---|---|---|
03/25/1997 | 0000 | 12/10/2003 | 2359 |
Subject: | SGP/SIRS/C1 - SWFANAL Data description error |
DataStreams: | sgp15swfanalsirs1longC1.c1, sgp1swfanalsirs1longC1.c1 |
Description: | The long name attribute for the cloud effect fields incorrectly defines the cloud effect to be the difference between the clearskyfit and measured values: "Difference: ***fluxdn_clearskyfit - ***fluxdn_measured (***fcg)" ; The cloud effects are correctly calculated by subtracting the irradiance calculated in the clear sky fit from the measured irradiance. "Difference: ***fluxdn_measured - ***fluxdn_clearskyfit (***fcg)" ; NOTE: this is just a documentation error. The data are correctly calculated. |
Measurements: | sgp1swfanalsirs1longC1.c1:
sgp15swfanalsirs1longC1.c1:
|
Start Date | Start Time | End Date | End Time |
---|---|---|---|
10/13/1995 | 0000 | 08/20/1997 | 2359 |
Subject: | downwelling solar irradiance measurement adjustments |
DataStreams: | sgpbsrnC1.a1, sgpsirosE13.a1 |
Description: | A comparison of BSRN and SIROS solar radiometers for measuring downwelling irradiances at the SGP central facility was made with field standards and two absolute cavity radiometers brought to the site or a two-week period in April 1996 by Mike Rubes (formerly of the National and Oceanic Atmospheric Administration, Air Resources Laboratory, Surface Radiation Research Branch in Boulder, CO). A description of this effort can currently be found on the World Wide Web at http://www.srrb.noaa.gov/apr96iop/hagsie.html. Analyses of the data from these comparisons have resulted in several observations on the quality of data collected at the BSRN and SIROS platforms since October 13, 1995, which are probably valid to the present time, until these sensors are replaced with more recently calibrated sensors. On Oct. 13, 1995, the two BSRN pyranometers (PSPs) were replaced, so the observations do not apply to the BSRN measurements of global and diffuse irradiation before that date. Another source of information is inspection of the SIROS and BSRN equipment by Joe Michalsky (Atmospheric Science Research Center, State University of New York at Albany) at various times. The results of the findings are summarized as recommendations in the following several paragraphs. Some explanation and further comments are provided in the parenthetical remarks. ANALYSIS WHEN THE DIRECT BEAM WAS NOT OBSCURED BY CLOUDS Direct-beam solar irradiance measured with the BSRN pyrheliometer (NIP) are too large by approximately 0.5% compared to the two absolute cavity radiometers. (This small underestimate is within the expected level of uncertainty.) Direct-beam solar irradiance measured with the SIROS pyrheliometer are too small by approximately 2.1% compared to the two absolute cavity radiometers. (This large discrepancy is unexplained and will be explored during future calibration activities at the SGP Radiation Calibration Facility.) Possibly the best estimate of downwelling total hemispherical solar (global) irradiance can be made by summing the SIROS pyrheliometer irradiance reading multiplied by 1.021 (and by the cosine of the solar zenith angle) and the average of the readings for diffuse irradiance from the shaded BSRN and SIROS pyranometers. The direct-beam part can alternatively be computed as 0.995 times the BSRN pyrheliometer reading. For data collected in October before the 13th, when the BSRN shaded pyrheliometer was replaced, the diffuse component is probably best computed directly from the SIROS shaded sensor alone. Downwelling total hemispherical solar (global) irradiance measured by the BSRN unshaded pyranometer is approximately 2% too small (which is within the expected level of uncertainty for unshaded pyranometer measurements) compared to the values computed from the measured direct-beam and diffuse components. (Downwelling total hemispherical solar irradiances measured by the SIROS unshaded pyranometer systematically underestimates the global irradiances by excessive amounts, i.e., by greater than 3%.) The analyses leading to these recommendations are described in an extended abstract presented in early February (J. Michalsky et al., "Optimal Measurements of Surface Shortwave Irradiance Using Current Instrumentation-- The ARM Experience," in Preprint Volume, Ninth Conference on Atmospheric Radiation, Feb. 2-7, Long Beach, California, pp. J5-J9, American Meteorological Society, Boston, MA). Further relevant analyses were conducted by Kato et al., (Seiji Kato, Pennsylvania State University) and are described in a manuscript submitted for publication ("Uncertainties in Modelled and Measured Clear Sky Surface Shortwave Irradiances")." UNSHADED PYRANOMETER PERFORMANCE WHEN THE DIRECT BEAM WAS NOT OBSCURED The above recommendations are based mostly on analyses conducted for cloudless, midday conditions. Because the data reported from the unshaded pyranometer were not corrected for cosine response, slight overestimates of global irradiance from unshaded pyranometers tend to occur in cloudless conditions at solar zenith angles less than 45 deg and slight underestimates tend to occur for zenith angles greater than 55 deg. The maximum deviations occur at extreme solar zenith angles and are about 2%. TRACKER-SHADING PERFORMANCE The data user should note, as has been noted in data release statements, that analyses of the direct, diffuse, and/or direct beam irradiances should be preceded by a check of sensor performances by summing the direct and diffuse components and comparing the result to the directly measured global component. When this is done, problems with solar tracking are usually apparent. Because slight misalignments in the tracking and shading devices can be difficult to detect, small deviations of the component sum from expected behavior are sometimes difficult to explain. If such deviations tend to recur for specific time intervals for several days, one might suspect a tracking or shading problem. For the time period addressed here, the modern tracking- shading assembly used with the SIROS sensors appeared to work well. For the BSRN sensors until January 1996, an older tracking-shading system was used that was not as reliable as the modern assembly used with the SIROS sensors; problems with this BSRN tracking and shading system, were usually evident when they occurred. A modern tracker-shader was installed for the BSRN sensors in January 1996. The tracker was not aligned as well as it could be. Efforts are underway to improve tracker alignment checks and procedures at all SIROS sites and the BSRN site. PARTLY CLOUD CONDITIONS An analysis by Chuck Long (formerly at the Pennsylvania State University and now with the University of Colorado and the National Oceanic and Atmospheric Administration) indicated that data users who are investigating partly cloudy sky conditions will usually find that the BSRN outputs are more reliable for short periods of time, say less than 30 min, than are the SIROS outputs. This tends to occur because the SIROS data are recorded only every 20 s while the BSRN data represent one-minute averages computed on the basis of sampling once per second. Under partly cloudy conditions, sampling only once every 20 s tends to provide inadequate statistical representation of downwelling irradiances. ESTIMATES FOR CLOUDY CONDITIONS The component sum technique is not applicable for overcast conditions. For the time period addressed here, the SIROS shaded sensor appears most reliable before October 13, 1995. Thereafter, an average of data from the SIROS shaded pyranometer, the shaded BSRN sensor, and the shaded BSRN sensor multiplied by 1.02 might be the best estimate of global irradiance for cloudy conditions. However, a rigorous analysis on the results of this procedure has not been carried out, so the data user should approach this technique with caution. SOME ADDITIONAL INFORMATION The excessively large deviations noted above for the pyranometers result in part from a mixture of different sources of calibration procedures. The following table lists the sources of calibration: Sensor Coefficient used Calibration Installation to process data date date BSRN PSP DS BORCAL Sept. 1995 Oct. 13, 1995 BSRN PSP DD Eppley June 1995 Oct. 13, 1995 BSRN NIP BORCAL July 1993 March 17, 1994 SIROS PSP DS Eppley June 1995 July 25, 1995 SIROS PSP DD Eppley June 1995 July 25, 1995 SIROS NIP BORCAL Sept. 1994 July 25, 1995 DS = downwelling solar or global DD = downwelling diffuse PSP = precision spectral pyranometer NIP = normal incidence pyrheliometer for direct-beam solar BORCAL = broadband outdoor radiometer calibration, conducted by the National Renewable Energy Laboratory (NREL) Eppley = denotes calibrations in an integrating sphere by the manufacturer, Eppley Laboratory, Inc. The BORCAL calibrations result in estimates of solar irradiances that are typically 1.5% larger than Eppley calibrations, a situation which is under investigation by Tom Stoffel at NREL and John Hickey at Eppley. They are working together to document this difference. This difference helps to explain the larger estimates of global irradiance measurement with the BSRN sensor than with the SIROS sensor. A greater source of concern than over differences between the NREL versus the Eppley calibrations at this time is the insufficiently frequent recalibrations of sensors in operation at the SGP site. Although the NIPs are expected to hold their calibrations for rather long periods of time, the pyranometers typically should be recalibrated at least once every 12 months. Change out with freshly calibrated pyranometers and pyrheliometers at the SGP site will begin in 1997, with the goal of routinely replacing every pyranometer and pyrheliometer with freshly calibrated sensors once every year. Data users can inspect metrics provided on the World Wide Web by the SGP site scientist team on data quality at the following address: http://manatee.gcn.uoknor.edu/metrics/METRICS.html Other observations/measurements impacted by this problem: Any derived estimates of downwelling solar radiation components using data from central facility SIROS or BSRN sensors (for downwelling solar radiation) for the time period indicated. Suggested Corrections of the Problem: (e.g. change calibration factor and recompute, flag data with this comment, etc.) Use of these recommendations by data users. Ideally, the component sum technique would be applied in a value-added product (VAP) implemented at the Experiment Center, but this has not been done yet. In the meantime, users of recent data can inspect plots of component sum technique on the World Wide Web site noted above. |
Measurements: | sgpsirosE13.a1:
sgpbsrnC1.a1:
|
Start Date | Start Time | End Date | End Time |
---|---|---|---|
04/03/1995 | 0000 | 10/12/1998 | 1900 |
Subject: | SGP/MWR/B1/B4/B6/C1 - software change |
DataStreams: | sgpmwrlosB1.a0, sgpmwrlosB1.a1, sgpmwrlosB4.a0, sgpmwrlosB4.a1, sgpmwrlosB6.a0, sgpmwrlosB6.a1, sgpmwrlosC1.a1, sgpmwrlosC1.b1, sgpmwrtipB1.a0, sgpmwrtipB4.a0, sgpmwrtipB6.a0 |
Description: | The MWR operating software was changed on 12 October 1998 to provide additional functionality as described below. This change affects the format of the raw and ingested data. NEW FEATURES 1. Faster sampling rate Standard line-of-sight (LOS) observations can now be acquired at 15-second intervals vs. 20-second intervals previously. (The standard LOS cycle is comprised of one sky sample per blackbody sample and gain update.) 2. More flexible sampling strategy Multiple sky observations can be acquired during a LOS cycle, up to 1024 per gain update. This permits sky samples to be acquired at intervals of 2.67 seconds for improved temporal resolution of cloud liquid water variations and better coordination with the millimeter cloud radar during IOPs. 3. Separation of zenith LOS observations from TIP data When the radiometer is in TIP mode, the zenith LOS observations are now extracted, the PWV and LWP computed and reported separately in the output file. This eliminates the periods of missing LOS data during calibration checks/updates. 4. Automatic self-calibration The software now permits the calibration to be updated at specified intervals or continuously. In the first case, LOS mode is automatically changed to TIP mode at user-specified intervals or whenever clear sky conditions occur, the tip data reduced, the calibration updated ,and the radiometer returned to LOS mode without operator intervention. In the second case, the radiometer is continuously is TIP mode until changed by the operator. 5. Graphical user display The graphical display is comprised of a status display, a message display, a temperature plot, a plot of the retrieved PWV and LWP, and (in TIP mode) a plot of the latest tip curves. Editor's Note: The SGP.C1 data were reprocessed in 2004 and enhancement #3 described above was applied to the data prior to Oct 1998. The SGP.BF data are queued for reprocessing as well. |
Measurements: | sgpmwrlosB1.a1:
sgpmwrlosB6.a1:
sgpmwrtipB4.a0:
sgpmwrlosB1.a0:
sgpmwrlosB6.a0:
sgpmwrlosB4.a0:
sgpmwrtipB6.a0:
sgpmwrtipB1.a0:
sgpmwrlosC1.a1:
sgpmwrlosC1.b1:
sgpmwrlosB4.a1:
|
Start Date | Start Time | End Date | End Time |
---|---|---|---|
07/21/1993 | 1406 | 01/12/1999 | 2359 |
Subject: | SGP/MWR/B1/B4/B5/B6/C1 - software upgrade (version 3.27) |
DataStreams: | sgpmwrlosB1.a1, sgpmwrlosB4.a1, sgpmwrlosB5.a1, sgpmwrlosB6.a1, sgpmwrlosC1.a1, sgpmwrlosC1.b1, sgpmwrtipB1.a0, sgpmwrtipB4.a0, sgpmwrtipB5.a0, sgpmwrtipB6.a0 |
Description: | At 00:00 GMT on 7 January version 3.27 of the MWR operating program was installed and made operational at the SGP central facility (C1). No problems were noted over the next few days and the boundary facility MWRs (B1, B4, B5, B6) were upgraded at 20:00 GMT on 11 January. This version includes a beam width correction I developed as well as providing the capability to automatically level the elevation mirror (that is, to automatically detect and correct offsets in the elevation angle stepper motor position.) On 12 January I discovered that the '486-based MWR computers at B1, B4 and B6 were not executing the system command to move and rename the data files so that the ARM data system could retrieve them. Reducing the length of the storage arrays in the auto-leveling feature from 1000 to 250 resolved the problem. This results in the auto-leveling being based on only 4 hours of clear sky data rather than 16 hours at B5 and C1. This version of the program is 3.28. Version 3.27 (running at B5 and C1) can be installed if and when these computers are upgraded to Pentium-class machines. The improvement in the quality of the tip curves resulting from the auto-leveling has been dramatic: differences in the brightness temperatures at 3 airmasses (19.5 and 160.5 degrees) have been reduced from +/- 5 K to +/- 0.5 K. The goodness-of-fit coefficient for the tip curves has improved from about 0.995 to over 0.998. In order to take full advantage of this improvement to detect and reject cloudy tip curves, the minimum value of the goodness-of-fit coefficient for a valid tip curve has been increased from 0.995 to 0.998. Editor's Note: The SGP.C1 data were reprocessed in 2004 to produce a common DOD for all time. The 1996-1998 data reprocessing included beam width and mirror-leveling corrections, but the data prior to that range did not have these corrections applied. |
Measurements: | sgpmwrlosB1.a1:
sgpmwrlosB6.a1:
sgpmwrtipB4.a0:
sgpmwrtipB6.a0:
sgpmwrlosC1.a1:
sgpmwrtipB1.a0:
sgpmwrlosC1.b1:
sgpmwrtipB5.a0:
sgpmwrlosB4.a1:
sgpmwrlosB5.a1:
|