On the Misclassification of Dust as Cloud at an AERONET site in the Sonoran Desert

Here we present retrievals of aerosol optical depth τ from an Aerosol Robotic Network (AERONET) station in the southeastern corner of California, an area where dust storms are frequent. By combining AERONET data with collocated ceilometer measurements, camera imagery, and satellite data, we show that during significant dust outbreaks the AERONET cloud-screening algorithm oftentimes classifies dusty measurements as cloud contaminated, thus removing them from the aerosol record. During dust storms we estimate that approximately 85% of all dusty retrievals of τ and more than 95% of retrievals when τ > 0.1 are rejected, resulting in a factor 2 reduction in dust-storm averaged τ. We document the specific components in the screening algorithm responsible for the misclassification. We find that a major reason for the loss of these dusty measurements is the high temporal variability in τ during the passage of dust storms over the site, which itself is related to the proximity of the site to the locations of emission. We describe a method to recover these dusty measurements that is based on collocated ceilometer measurements. These results suggest that AERONET sites located close to dust source regions may require ancillary measurements in order to aid in the identification of dust.

Assessment of the EUMETSAT Multi Decadal Land Surface Albedo Data Record from Meteosat Observations

Surface albedo, defined as the ratio of the surface-reflected irradiance to the incident irradiance, is one of the parameters driving the Earth energy budget and it is for this reason an essential variable in climate studies. Instruments on geostationary satellites provide suitable observations allowing long-term monitoring of surface albedo from space. In 2012, EUMETSAT published Release 1 of the Meteosat Surface Albedo (MSA) data record. The main limitation effecting the quality of this release was non-removed clouds by the incorporated cloud screening procedure that caused too high albedo values, in particular for regions with permanent cloud coverage. For the generation of Release 2, the MSA algorithm has been replaced with the Geostationary Surface Albedo (GSA) one, able to process imagery from any geostationary imager. The GSA algorithm exploits a new, improved, cloud mask allowing better cloud screening, and thus fixing the major limitation of Release 1. Furthermore, the data record has an extended temporal and spatial coverage compared to the previous release. Both Black-Sky Albedo (BSA) and White-Sky Albedo (WSA) are estimated, together with their associated uncertainties. A direct comparison between Release 1 and Release 2 clearly shows that the quality of the retrieval improved significantly with the new cloud mask. For Release 2 the decadal trend is less than 1% over stable desert sites. The validation against Moderate Resolution Imaging Spectroradiometer (MODIS) and the Southern African Regional Science Initiative (SAFARI) surface albedo shows a good agreement for bright desert sites and a slightly worse agreement for urban and rain forest locations. In conclusion, compared with MSA Release 1, GSA Release 2 provides the users with a significantly more longer time range, reliable and robust surface albedo data record.

Reducing cloud contamination in aerosol optical depth (AOD) measurements

We propose a new cloud screening method for sun photometry that is designed to effectively filter thin clouds. Our method is based on a k-nearest-neighbour algorithm instead of scanning time series of aerosol optical depth. Using 10 years of data from a precision filter radiometer in Innsbruck, we compare our new method and the currently employed screening technique. We exemplify the performance of the two routines in different cloud conditions. While both algorithms agree on the classification of a data point as clear or cloudy in a majority of the cases, the new routine is found to be more effective in flagging thin clouds. We conclude that this simple method can serve as a valid alternative for cloud detection, and we discuss the generalizability to other observation sites.

Comment on “Comparison of Cloud Cover Detection Algorithms on Sentinel-2 Images of the Amazon Tropical Forest”

In their recent study, Sanchez et al. compared various cloud detection methods applied to Sentinel-2, specifically on images acquired over the Amazonian region, known for its frequent cloud cover. Comparison of cloud screening methods for optical satellite images is a complex task, which must take several parameters into account, such as the definition of a cloud, which can differ according to the methods, the different coding of the cloud and shadow masks, the possible dilation of masks, and also the way the method must be used to perform in nominal conditions. We found that the otherwise serious and useful comparison of cloud masks by Sanchez et al. is not fair to the real performances of MAJA cloud detection, for two reasons: (i) two thirds of the images used in the comparison were acquired before the launch of Sentinel-2B satellite, when the revisit of the Sentinel-2 mission was 20 days instead of five days for the nominal conditions of the mission, and (ii) there is an error in the understanding of how MAJA cloud masks are coded which also probably artificially degraded the results of MAJA as compared to the other methods.

The methods and automatic technology aimed at imagery georeferencing, cloud screening, atmospheric and radiometric correction of KMSS-M satellite data

In this study we present methods and automatic technology developed for routine processing of satellite imagery acquired by cameras MSU-201 and MSU-202 (KMSS-M) onboard Meteor-M №2. The developed methods were aimed at imagery georeferencing issues fixing, clouds and shadows detection as well as atmospheric and radiometric correction. Basing on these methods we built an automatic technology and complete KMSS-M data processing chain which provided analysis ready dataset for Russian grain belt and adjacent areas of neighboring countries for the year 2020. Method for imagery georeferencing was based on Pearson’s correlation localized maximization when compared to the georefenced and cloudfree coarse-resolution reference image produced in IKI RAS through MOD09 product time series processing. Method for clouds and shadows detection was based both on the spatial analysis of outputs from geocorrection step and auxiliary image, characterizing georeferenced KMSS-M image values relative accordance with the IKI reference image. The atmospheric correction was based on localized histogram matching of KMSS-M and IKI reference date-corresponding imagery, and thereby concurrently performed radiometric correction of KMSS-M data, compensating effects of varying viewing and illumination geometry which explicitly manifest across 960-km-wide swath area. The developed methods are noticeably minimalistic, requiring only one target spectral band to perform properly. Due to high flexibility and robustness, they also may be applied to raw satellite imagery acquired from various Earth observation systems, including Russian systems of high and moderate spatial resolution. The technology is currently being deployed in an operative mode for several test sites of Russia since the year 2021 onwards.

Global cloud property models for real-time triage on board visible–shortwave infrared spectrometers

New methods for optimizing data storage and transmission are required as orbital imaging spectrometers collect ever-larger data volumes due to increases in optical efficiency and resolution. In Earth surface investigations, storage and downlink volumes are the most important bottleneck in the mission's total data yield. Excising cloud-contaminated data on board, during acquisition, can increase the value of downlinked data and significantly improve the overall science performance of the mission. Threshold-based screening algorithms can operate at the acquisition rate of the instrument but require accurate and comprehensive predictions of cloud and surface brightness. To date, the community lacks a comprehensive analysis of global data to provide appropriate thresholds for screening clouds or to predict performance. Moreover, prior cloud-screening studies have used universal screening criteria that do not account for the unique surface and cloud properties at different locations. To address this gap, we analyzed the Hyperion imaging spectrometer's historical archive of global Earth reflectance data. We selected a diverse subset spanning space (with tropical, midlatitude, Arctic, and Antarctic latitudes), time (2005–2017), and wavelength (400–2500 nm) to assure that the distributions of cloud data are representative of all cases. We fit models of cloud reflectance properties gathered from the subset to predict locally and globally applicable thresholds. The distributions relate cloud reflectance properties to various surface types (land, water, and snow) and latitudinal zones. We find that taking location into account can significantly improve the efficiency of onboard cloud-screening methods. Models based on this dataset will be used to screen clouds on board orbital imaging spectrometers, effectively doubling the volume of usable science data per downlink. Models based on this dataset will be used to screen clouds on board NASA's forthcoming mission, the Earth Mineral Dust Source Investigation (EMIT).

Improved cloud detection over sea ice and snow during Arctic summer using MERIS data

The historic MERIS (Medium Resolution Imaging Spectrometer) sensor on board Envisat (Environmental Satellite, operation 2002–2012) provides valuable remote sensing data for the retrievals of summer sea ice in the Arctic. MERIS data together with the data of recently launched successor OLCI (Ocean and Land Colour Instrument) on board Sentinel 3A and 3B (2016 onwards) can be used to assess the long-term change of the Arctic summer sea ice. An important prerequisite to a high-quality remote sensing dataset is an accurate separation of cloudy and clear pixels to ensure lowest cloud contamination of the resulting product. The presence of 15 visible and near-infrared spectral channels of MERIS allows high-quality retrievals of sea ice albedo and melt pond fraction, but it makes cloud screening a challenge as snow, sea ice and clouds have similar optical features in the available spectral range of 412.5–900 nm. In this paper, we present a new cloud screening method MECOSI (MERIS Cloud Screening Over Sea Ice) for the retrievals of spectral albedo and melt pond fraction (MPF) from MERIS. The method utilizes all 15 MERIS channels, including the oxygen A absorption band. For the latter, a smile effect correction has been developed to ensure high-quality screening throughout the whole swath. A total of 3 years of reference cloud mask from AATSR (Advanced Along-Track Scanning Radiometer) (Istomina et al., 2010) have been used to train the Bayesian cloud screening for the available limited MERIS spectral range. Whiteness and brightness criteria as well as normalized difference thresholds have been used as well. The comparison of the developed cloud mask to the operational AATSR and MODIS (Moderate Resolution Imaging Spectroradiometer) cloud masks shows a considerable improvement in the detection of clouds over snow and sea ice, with about 10 % false clear detections during May–July and less than 5 % false clear detections in the rest of the melting season. This seasonal behavior is expected as the sea ice surface is generally brighter and more challenging for cloud detection in the beginning of the melting season. The effect of the improved cloud screening on the MPF–albedo datasets is demonstrated on both temporal and spatial scales. In the absence of cloud contamination, the time sequence of MPFs displays a greater range of values throughout the whole summer. The daily maps of the MPF now show spatially uniform values without cloud artifacts, which were clearly visible in the previous version of the dataset. The developed cloud screening routine can be applied to address cloud contamination in remote sensing data over sea ice. The resulting cloud mask for the MERIS operating time, as well as the improved MPF–albedo datasets for the Arctic region, is available at https://www.seaice.uni-bremen.de/start/ (Istomina et al., 2017).

Assessment of Extreme Diurnal Warming in Operational Geosynchronous Satellite Sea Surface Temperature Products

We evaluate the reliability and basic characteristics of observations of extreme DW events from current operational geostationary satellite sea surface temperature (SST) products through examination of three months of diurnal warming (DW) estimates derived by different methodologies from the Spinning Enhanced Visible and Infrared Imager on Meteosat-11, Advanced Himawari Imager on Himawari-8, and Advanced Baseline Imager on the Geostationary Operational Environmental Satellite (GOES)-16. This work primarily focuses on the following research questions: (1) Can these operational SST products accurately characterize extreme DW events? (2) What are the amplitudes and frequencies of these events? To answer these, we compute distributions of DW and DW exceedance and compare them amongst the different methods and geostationary sensors. Examination of the DW estimates demonstrates several challenges in accurately deriving distributions of the DW amplitude, particularly associated with estimating the “foundation” temperature and uncertainties in cloud screening. Overall, the results suggest that current geostationary sensors can reliably assess extreme DW, but the estimates are sensitive to the computational methods applied. We thus suggest careful processing/screening of the SST retrievals. We find a value of 3 K, corresponding to the 99th percentile, provides a potential practical threshold for extreme warming, but events of at least 6 K were reliably observed. Warming in excess of 6 K occurred somewhere an average of 47% of the time, and its probability at a given location was of O(10−6).

Daytime and nighttime aerosol optical depth implementation in CÆLIS

The University of Valladolid (UVa, Spain) has managed a calibration center of the AErosol RObotic NETwork (AERONET) since 2006. The CÆLIS software tool, developed by UVa, was created to manage the data generated by AERONET photometers for calibration, quality control and data processing purposes. This paper exploits the potential of this tool in order to obtain products like the aerosol optical depth (AOD) and Ångström exponent (AE), which are of high interest for atmospheric and climate studies, as well as to enhance the quality control of the instruments and data managed by CÆLIS. The AOD and cloud screening algorithms implemented in CÆLIS, both based on AERONET version 3, are described in detail. The obtained products are compared with the AERONET database. In general, the differences in daytime AOD between CÆLIS and AERONET are far below the expected uncertainty of the instrument, ranging in mean differences between -1.3×10-4 at 870 nm and 6.2×10-4 at 380 nm. The standard deviations of the differences range from 2.8×10-4 at 675 nm to 8.1×10-4 at 340 nm. The AOD and AE at nighttime calculated by CÆLIS from Moon observations are also presented, showing good continuity between day and nighttime for different locations, aerosol loads and Moon phase angles. Regarding cloud screening, around 99.9 % of the observations classified as cloud-free by CÆLIS are also assumed cloud-free by AERONET; this percentage is similar for the cases considered cloud-contaminated by both databases. The obtained results point out the capability of CÆLIS as a processing system. The AOD algorithm provides the opportunity to use this tool with other instrument types and to retrieve other aerosol products in the future.