scholarly journals A RGB channel operation for removal of the difference of atmospheric scattering and its application on total sky cloud detection

2016 ◽  
Author(s):  
Jun Yang ◽  
Qilong Min ◽  
Weitao Lu ◽  
Ying Ma ◽  
Wen Yao ◽  
...  
Keyword(s):  
Detection Algorithm ◽  
Qualitative Assessment ◽  
The Sun ◽  
Cloud Detection ◽  
Recognition Error ◽  
Atmospheric Scattering ◽  
Clear Sky ◽  
Different Types ◽  
Rgb Images ◽  
The Difference

Abstract. The inhomogeneous sky background presents a great challenge for accurate cloud recognition from the total sky images. A channel operation was introduced in this study to produce a new composite channel in which the difference of atmospheric scattering has been removed and a homogeneous sky background can be obtained. Following this, a new cloud detection algorithm was proposed, which combined the merits of the differencing and threshold methods and named "differencing and threshold combination algorithm (DTCA)". Firstly, the channel operation was applied to transform 3-D RGB images to the new channel, then the circumsolar saturated pixels and its circularity were used to judge whether the sun is visible or not in the image. When the sun is obscured, a single threshold can be used to identify cloud pixels, and, when the sun is visible in the image, the true clear sky background differencing algorithm is adopted to detect clouds. The qualitative assessment for eight different total sky images shows the DTCA algorithm obtained satisfactory cloud identification effectiveness for thin clouds and in the circumsolar and near-horizon regions. Quantitative evaluation also shows the DTCA algorithm achieved the highest cloud recognition precision for five different types of clouds, with an average recognition error rate of 8.7 %.

scholarly journals An RGB channel operation for removal of the difference of atmospheric scattering and its application on total sky cloud detection

2017 ◽  
Vol 10 (3) ◽  
pp. 1191-1201 ◽  
Author(s):  
Jun Yang ◽  
Qilong Min ◽  
Weitao Lu ◽  
Ying Ma ◽  
Wen Yao ◽  
...  
Keyword(s):  
Quantitative Evaluation ◽  
Detection Algorithm ◽  
Qualitative Assessment ◽  
The Sun ◽  
Cloud Detection ◽  
Atmospheric Scattering ◽  
Clear Sky ◽  
Different Types ◽  
The Difference ◽  
Rgb Image

Abstract. The inhomogeneous sky background presents a great challenge for accurate cloud recognition from the total-sky images. A channel operation was introduced in this study to produce a new composite channel in which the difference of atmospheric scattering has been removed and a homogeneous sky background can be obtained. Following this, a new cloud detection algorithm was proposed that combined the merits of the differencing and threshold methods, named differencing and threshold combination algorithm (DTCA). Firstly, the channel operation was applied to transform 3-D RGB image to the new channel, then the circumsolar saturated pixels and its circularity were used to judge whether the sun is visible or not in the image. When the sun is obscured, a single threshold can be used to identify cloud pixels. If the sun is visible in the image, the true clear-sky background differencing algorithm is adopted to detect clouds. The qualitative assessment for eight different total-sky images shows the DTCA algorithm obtained satisfactory cloud identification effectiveness for thin clouds and in the circumsolar and near-horizon regions. Quantitative evaluation also shows that the DTCA algorithm achieved the highest cloud recognition precision for five different types of clouds and performed well under both visible sun and blocked sun conditions.

scholarly journals A cloud detection algorithm using the downwelling infrared radiance measured by an infrared pyrometer of the ground-based microwave radiometer

2015 ◽  
Vol 8 (2) ◽  
pp. 553-566 ◽  
Author(s):  
M.-H. Ahn ◽  
D. Han ◽  
H. Y. Won ◽  
V. Morris
Keyword(s):  
Water Vapor Pressure ◽  
Microwave Radiometer ◽  
Surface Air Temperature ◽  
Detection Algorithm ◽  
Probability Of Detection ◽  
Cloud Base ◽  
Cloud Detection ◽  
Clear Sky ◽  
Spectral Test ◽  
Free Data

Abstract. For better utilization of the ground-based microwave radiometer, it is important to detect the cloud presence in the measured data. Here, we introduce a simple and fast cloud detection algorithm by using the optical characteristics of the clouds in the infrared atmospheric window region. The new algorithm utilizes the brightness temperature (Tb) measured by an infrared radiometer installed on top of a microwave radiometer. The two-step algorithm consists of a spectral test followed by a temporal test. The measured Tb is first compared with a predicted clear-sky Tb obtained by an empirical formula as a function of surface air temperature and water vapor pressure. For the temporal test, the temporal variability of the measured Tb during one minute compares with a dynamic threshold value, representing the variability of clear-sky conditions. It is designated as cloud-free data only when both the spectral and temporal tests confirm cloud-free data. Overall, most of the thick and uniform clouds are successfully detected by the spectral test, while the broken and fast-varying clouds are detected by the temporal test. The algorithm is validated by comparison with the collocated ceilometer data for six months, from January to June 2013. The overall proportion of correctness is about 88.3% and the probability of detection is 90.8%, which are comparable with or better than those of previous similar approaches. Two thirds of discrepancies occur when the new algorithm detects clouds while the ceilometer does not, resulting in different values of the probability of detection with different cloud-base altitude, 93.8, 90.3, and 82.8% for low, mid, and high clouds, respectively. Finally, due to the characteristics of the spectral range, the new algorithm is found to be insensitive to the presence of inversion layers.

scholarly journals Cloud Detection Algorithm for Multi-Satellite Remote Sensing Imagery Based on a Spectral Library and 1D Convolutional Neural Network

2021 ◽  
Vol 13 (16) ◽  
pp. 3319
Author(s):  
Nan Ma ◽  
Lin Sun ◽  
Chenghu Zhou ◽  
Yawen He
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Satellite Images ◽  
Detection Algorithm ◽  
Landsat 8 ◽  
Cloud Detection ◽  
Spectral Library ◽  
Remote Sensing Images ◽  
Different Types ◽  
Sentinel 2

Automatic cloud detection in remote sensing images is of great significance. Deep-learning-based methods can achieve cloud detection with high accuracy; however, network training heavily relies on a large number of labels. Manually labelling pixel-wise level cloud and non-cloud annotations for many remote sensing images is laborious and requires expert-level knowledge. Different types of satellite images cannot share a set of training data, due to the difference in spectral range and spatial resolution between them. Hence, labelled samples in each upcoming satellite image are required to train a new deep-learning-based model. In order to overcome such a limitation, a novel cloud detection algorithm based on a spectral library and convolutional neural network (CD-SLCNN) was proposed in this paper. In this method, the residual learning and one-dimensional CNN (Res-1D-CNN) was used to accurately capture the spectral information of the pixels based on the prior spectral library, effectively preventing errors due to the uncertainties in thin clouds, broken clouds, and clear-sky pixels during remote sensing interpretation. Benefiting from data simulation, the method is suitable for the cloud detection of different types of multispectral data. A total of 62 Landsat-8 Operational Land Imagers (OLI), 25 Moderate Resolution Imaging Spectroradiometers (MODIS), and 20 Sentinel-2 satellite images acquired at different times and over different types of underlying surfaces, such as a high vegetation coverage, urban area, bare soil, water, and mountains, were used for cloud detection validation and quantitative analysis, and the cloud detection results were compared with the results from the function of the mask, MODIS cloud mask, support vector machine, and random forest. The comparison revealed that the CD-SLCNN method achieved the best performance, with a higher overall accuracy (95.6%, 95.36%, 94.27%) and mean intersection over union (77.82%, 77.94%, 77.23%) on the Landsat-8 OLI, MODIS, and Sentinel-2 data, respectively. The CD-SLCNN algorithm produced consistent results with a more accurate cloud contour on thick, thin, and broken clouds over a diverse underlying surface, and had a stable performance regarding bright surfaces, such as buildings, ice, and snow.

Advancing Maritime Transparent Cirrus Detection Using the Advanced Baseline Imager “Cirrus” Band

2021 ◽  
Author(s):  
Theodore M. McHardy ◽  
James R. Campbell ◽  
David A. Peterson ◽  
Simone Lolli ◽  
Richard L. Bankert ◽  
...  
Keyword(s):  
Precipitable Water ◽  
Detection Algorithm ◽  
Machine Learning Techniques ◽  
Orthogonal Polarization ◽  
Cirrus Cloud ◽  
Cloud Detection ◽  
Cloud Optical Depth ◽  
Clear Sky ◽  
Learning Techniques ◽  
Microphysical Property

AbstractWe describe a quantitative evaluation of maritime transparent cirrus cloud detection, which is based on Geostationary Operational Environmental Satellite – 16 (GOES-16) and developed with collocated Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP) profiling. The detection algorithm is developed using one month of collocated GOES-16 Advanced Baseline Imager (ABI) Channel 4 (1.378 μm) radiance and CALIOP 0.532 μm column-integrated cloud optical depth (COD). First, the relationships between the clear-sky 1.378 μm radiance, viewing/solar geometry, and precipitable water vapor (PWV) are characterized. Using machine learning techniques, it is shown that the total atmospheric pathlength, proxied by airmass factor (AMF), is a suitable replacement for viewing zenith and solar zenith angles alone, and that PWV is not a significant problem over ocean. Detection thresholds are computed using the Ch. 4 radiance as a function of AMF. The algorithm detects nearly 50% of sub-visual cirrus (COD < 0.03), 80% of transparent cirrus (0.03 < COD < 0.3), and 90% of opaque cirrus (COD > 0.3). Using a conservative radiance threshold results in 84% of cloudy pixels being correctly identified and 4% of clear-sky pixels being misidentified as cirrus. A semi-quantitative COD retrieval is developed for GOES ABI based on the observed relationship between CALIOP COD and 1.378 μm radiance. This study lays the groundwork for a more complex, operational GOES transparent cirrus detection algorithm. Future expansion includes an over-land algorithm, a more robust COD retrieval that is suitable for assimilation purposes, and downstream GOES products such as cirrus cloud microphysical property retrieval based on ABI infrared channels.

scholarly journals A method for cloud detection and opacity classification based on ground based sky imagery

2012 ◽  
Vol 5 (11) ◽  
pp. 2881-2892 ◽  
Author(s):  
M. S. Ghonima ◽  
B. Urquhart ◽  
C. W. Chow ◽  
J. E. Shields ◽  
A. Cazorla ◽  
...  
Keyword(s):  
Training Image ◽  
Classification Model ◽  
Cloud Detection ◽  
New Classification ◽  
Short Term ◽  
Clear Sky ◽  
Cloud Classification ◽  
Image Set ◽  
The Difference ◽  
Solar Power Forecasting

Abstract. Digital images of the sky obtained using a total sky imager (TSI) are classified pixel by pixel into clear sky, optically thin and optically thick clouds. A new classification algorithm was developed that compares the pixel red-blue ratio (RBR) to the RBR of a clear sky library (CSL) generated from images captured on clear days. The difference, rather than the ratio, between pixel RBR and CSL RBR resulted in more accurate cloud classification. High correlation between TSI image RBR and aerosol optical depth (AOD) measured by an AERONET photometer was observed and motivated the addition of a haze correction factor (HCF) to the classification model to account for variations in AOD. Thresholds for clear and thick clouds were chosen based on a training image set and validated with set of manually annotated images. Misclassifications of clear and thick clouds into the opposite category were less than 1%. Thin clouds were classified with an accuracy of 60%. Accurate cloud detection and opacity classification techniques will improve the accuracy of short-term solar power forecasting.

scholarly journals A method for cloud detection and opacity classification based on ground based sky imagery

2012 ◽  
Vol 5 (4) ◽  
pp. 4535-4569 ◽  
Author(s):  
M. S. Ghonima ◽  
B. Urquhart ◽  
C. W. Chow ◽  
J. E. Shields ◽  
A. Cazorla ◽  
...  
Keyword(s):  
Training Image ◽  
Classification Model ◽  
Cloud Detection ◽  
New Classification ◽  
Short Term ◽  
Clear Sky ◽  
Cloud Classification ◽  
Image Set ◽  
The Difference ◽  
Solar Power Forecasting

Abstract. Digital images of the sky obtained using a total sky imager (TSI) are classified pixel by pixel into clear sky, optically thin and optically thick clouds. A new classification algorithm was developed that compares the pixel red-blue ratio (RBR) to the RBR of a clear sky library (CSL) generated from images captured on clear days. The difference, rather than the ratio, between pixel RBR and CSL RBR resulted in more accurate cloud classification. High correlation between TSI image RBR and aerosol optical depth (AOD) measured by an AERONET photometer was observed and motivated the addition of a haze correction factor (HCF) to the classification model to account for variations in AOD. Thresholds for clear and thick clouds were chosen based on a training image set and validated with set of manually annotated images. Misclassifications of clear and thick clouds into the opposite category were less than 1%. Thin clouds were classified with an accuracy of 60%. Accurate cloud detection and opacity classification techniques will improve the accuracy of short-term solar power forecasting.

scholarly journals A total sky cloud detection method using real clear sky background

2015 ◽  
Vol 8 (12) ◽  
pp. 13073-13098 ◽  
Author(s):  
J. Yang ◽  
Q. Min ◽  
W. Lu ◽  
Y. Ma ◽  
W. Yao ◽  
...  
Keyword(s):  
Detection Algorithm ◽  
Brightness Distribution ◽  
Detection Methods ◽  
Cloud Detection ◽  
Image Brightness ◽  
Clear Sky ◽  
Sensitivity Tests ◽  
Thin Cloud ◽  
Distribution Sensitivity ◽  
Solar Position

Abstract. The brightness distribution of sky background is usually non-uniform, which creates many problems for traditional cloud detection methods including the failure of thin cloud detection in total sky images and significantly reducing retrieval accuracy in the circumsolar and near-horizon regions. This paper describes the development of a new cloud detection algorithm, named "clear sky background differencing (CSBD)", which is accomplished by differencing the original image and the corresponding clear sky background image using the images' green channel. First, a library of clear sky background images with a variety of solar elevation angles needs to be developed. The image rotation and image brightness adjustment algorithms are applied to ensure the two images being differenced have the same solar position and similar brightness distribution. Sensitivity tests show, as long as the positions of the sun in the two images are the same, the cloud detection results are satisfactory. Several experimental cases show that the CSBD algorithm obtains good cloud recognition results visually, especially for thin clouds.

scholarly journals A cloud detection algorithm using the downwelling infrared radiance measured by an infrared pyrometer of the ground-based microwave radiometer

2014 ◽  
Vol 7 (9) ◽  
pp. 9413-9452 ◽  
Author(s):  
M.-H. Ahn ◽  
D. Han ◽  
H.-Y. Won ◽  
V. Morris
Keyword(s):  
Water Vapor Pressure ◽  
Microwave Radiometer ◽  
Surface Air Temperature ◽  
Detection Algorithm ◽  
Probability Of Detection ◽  
Cloud Base ◽  
Cloud Detection ◽  
Clear Sky ◽  
Spectral Test ◽  
Free Data

Abstract. For a better utilization of the ground-based microwave radiometer, it is important to detect the cloud presence in the measured data. Here, we introduce a simple and fast cloud detection algorithm by using the optical characteristics of the clouds in the infrared atmospheric window region. The new algorithm utilizes the brightness temperature (Tb) measured by an infrared radiometer installed on top of a microwave radiometer. The two step algorithm consists of a spectral test followed by a temporal test. The measured Tb is first compared with a predicted clear sky Tb obtained by an empirical formula as a function of surface air temperature and water vapor pressure. For the temporal test, the temporal variability of the measured Tb during one minute compares with a dynamic threshold value, representing the variability of the clear sky condition. It is designated as cloud free data only when both the spectral and temporal tests confirm a cloud free data. Overall, most of the thick and uniform clouds are successfully screened out by the spectral test, while the broken and fast-varying clouds are screened out by the temporal test. The algorithm is validated by comparison with the collocated ceilometer data for 6 months, from January 2013 to June 2013. The overall proportion correct is about 88.3% and the probability of detection is 90.8%, which are comparable with or better than those of previous similar approaches. Two thirds of failures occur when the new algorithm detects clouds while the ceilometer does not detect, resulting in different values of the probability of detection with different cloud base altitude, 93.8, 90.3, and 82.8% for low, mid, and high clouds, respectively. Finally, due to the characteristics of the spectral range, the new algorithm is found to be insensitive to the presence of inversion layers.

scholarly journals A total sky cloud detection method using real clear sky background

2016 ◽  
Vol 9 (2) ◽  
pp. 587-597 ◽  
Author(s):  
Jun Yang ◽  
Qilong Min ◽  
Weitao Lu ◽  
Ying Ma ◽  
Wen Yao ◽  
...  
Keyword(s):  
Detection Algorithm ◽  
Brightness Distribution ◽  
Detection Methods ◽  
Cloud Detection ◽  
Image Brightness ◽  
Clear Sky ◽  
Sensitivity Tests ◽  
Thin Cloud ◽  
Distribution Sensitivity ◽  
Solar Position

Abstract. The brightness distribution of sky background is usually non-uniform, which creates many problems for traditional cloud detection methods, including the failure of thin cloud detection in total sky images and significantly reducing retrieval accuracy in the circumsolar and near-horizon regions. This paper describes the development of a new cloud detection algorithm, named "clear sky background differencing (CSBD)", which is accomplished by differencing the original image and the corresponding clear sky background image using the images' green channel. First, a library of clear sky background images with a variety of solar elevation angles needs to be developed. The image rotation and image brightness adjustment algorithms are applied to ensure the two images being differenced have the same solar position and similar brightness distribution. Sensitivity tests show that the cloud detection results are satisfactory when the two images have the same solar positions. Several experimental cases show that the CSBD algorithm obtains good cloud recognition results visually, especially for thin clouds.

Sign in / Sign up

Export Citation Format

Share Document