scholarly journals NWCSAF AVHRR Cloud Detection and Analysis Using Dynamic Thresholds and Radiative Transfer Modeling. Part II: Tuning and Validation

2005 ◽  
Vol 44 (1) ◽  
pp. 55-71 ◽  
Author(s):  
Adam Dybbroe ◽  
Karl-Göran Karlsson ◽  
Anke Thoss

Abstract Algorithms for cloud detection (cloud mask) and classification (cloud type) at high and midlatitudes using data from the Advanced Very High Resolution Radiometer (AVHRR) on board the current NOAA satellites and future polar Meteorological and Operational Weather Satellites (METOP) of the European Organisation for the Exploitation of Meteorological Satellites have been extensively validated over northern Europe and the adjacent seas. The algorithms have been described in detail in Part I and are based on a multispectral grouped threshold approach, making use of cloud-free radiative transfer model simulations. The thresholds applied in the algorithms have been validated and tuned using a database interactively built up over more than 1 yr of data from NOAA-12, -14, and -15 by experienced nephanalysts. The database contains almost 4000 rectangular (in the image data)-sized targets (typically with sides around 10 pixels), with satellite data collocated in time and space with atmospheric data from a short-range NWP forecast model, land cover characterization, elevation data, and a label identifying the given cloud or surface type as interpreted by the nephanalyst. For independent and objective validation, a large dataset of nearly 3 yr of collocated surface synoptic observation (Synop) reports, AVHRR data, and NWP model output over northern and central Europe have been collected. Furthermore, weather radar data were used to check the consistency of the cloud type. The cloud mask performs best over daytime sea and worst at twilight and night over land. As compared with Synop, the cloud cover is overestimated during night (except for completely overcast situations) and is underestimated at twilight. The algorithms have been compared with the more empirically based Swedish Meteorological and Hydrological Institute (SMHI) Cloud Analysis Model Using Digital AVHRR Data (SCANDIA), operationally run at SMHI since 1989, and results show that performance has improved significantly.

2005 ◽  
Vol 44 (1) ◽  
pp. 39-54 ◽  
Author(s):  
Adam Dybbroe ◽  
Karl-Göran Karlsson ◽  
Anke Thoss

Abstract New methods and software for cloud detection and classification at high and midlatitudes using Advanced Very High Resolution Radiometer (AVHRR) data are developed for use in a wide range of meteorological, climatological, land surface, and oceanic applications within the Satellite Application Facilities (SAFs) of the European Organisation for the Exploitation of Meteorological Satellites (EUMETSAT), including the SAF for Nowcasting and Very Short Range Forecasting Applications (NWCSAF) project. The cloud mask employs smoothly varying (dynamic) thresholds that separate fully cloudy or cloud-contaminated fields of view from cloud-free conditions. Thresholds are adapted to the actual state of the atmosphere and surface and the sun–satellite viewing geometry using cloud-free radiative transfer model simulations. Both the cloud masking and the cloud-type classification are done using sequences of grouped threshold tests that employ both spectral and textural features. The cloud-type classification divides the cloudy pixels into 10 different categories: 5 opaque cloud types, 4 semitransparent clouds, and 1 subpixel cloud category. The threshold method is fuzzy in the sense that the distances in feature space to the thresholds are stored and are used to determine whether to stop or to continue testing. They are also used as a quality indicator of the final output. The atmospheric state should preferably be taken from a short-range NWP model, but the algorithms can also run with climatological fields as input.


2015 ◽  
Vol 8 (10) ◽  
pp. 11285-11321 ◽  
Author(s):  
F. A. Mejia ◽  
B. Kurtz ◽  
K. Murray ◽  
L. M. Hinkelman ◽  
M. Sengupta ◽  
...  

Abstract. A method for retrieving cloud optical depth (τc) using a ground-based sky imager (USI) is presented. The Radiance Red-Blue Ratio (RRBR) method is motivated from the analysis of simulated images of various τc produced by a 3-D Radiative Transfer Model (3DRTM). From these images the basic parameters affecting the radiance and RBR of a pixel are identified as the solar zenith angle (θ0), τc, solar pixel angle/scattering angle (ϑs), and pixel zenith angle/view angle (ϑz). The effects of these parameters are described and the functions for radiance, Iλ(τc, θ0, ϑs, ϑz) and the red-blue ratio, RBR(τc, θ0, ϑs, ϑz) are retrieved from the 3DRTM results. RBR, which is commonly used for cloud detection in sky images, provides non-unique solutions for τc, where RBR increases with τc up to about τc = 1 (depending on other parameters) and then decreases. Therefore, the RRBR algorithm uses the measured Iλmeas(ϑs, ϑz), in addition to RBRmeas(ϑs, ϑz) to obtain a unique solution for τc. The RRBR method is applied to images taken by a USI at the Oklahoma Atmospheric Radiation Measurement program (ARM) site over the course of 220 days and validated against measurements from a microwave radiometer (MWR); output from the Min method for overcast skies, and τc retrieved by Beer's law from direct normal irradiance (DNI) measurements. A τc RMSE of 5.6 between the Min method and the USI are observed. The MWR and USI have an RMSE of 2.3 which is well within the uncertainty of the MWR. An RMSE of 0.95 between the USI and DNI retrieved τc is observed. The procedure developed here provides a foundation to test and develop other cloud detection algorithms.


2016 ◽  
Vol 31 (3) ◽  
pp. 743-761
Author(s):  
Robert P. d’Entremont ◽  
Richard Lynch ◽  
Gennadi Uymin ◽  
Jean-Luc Moncet ◽  
Ryan B. Aschbrenner ◽  
...  

Abstract The Cloud Depiction and Forecast System version 2 (CDFS II) is the operational global cloud analysis and forecasting model of the 557th Weather Wing, formerly the U.S. Air Force Weather Agency. The CDFS II cloud-detection algorithms are threshold-based tests that compare satellite-observed multispectral reflectance and brightness temperature signatures with those expected for the clear atmosphere. User-prescribed quantitative differences between sensor observations and the expected clear-scene radiances denote cloudy pixels. These radiances historically have been modeled at 24-km resolution from a running 10-day statistical analysis of cloud-free pixels that requires the entire global cloud analysis to be executed twice in real time: once in operational cloud detection mode and a second time in a cloud-clearing mode that is designed explicitly for generating clear-scene statistics. Having to run the cloud analysis twice means the availability of fewer compute cycles for other operational models and requires costly interactive maintenance of distinct cloud-detection and cloud-clearing threshold sets. Additionally, this technique breaks down whenever a region is persistently cloudy. These problems are eliminated by means of the optimal spectral sampling (OSS) radiative transfer model of Moncet et al., optimized for execution in the CDFS run-time environment. OSS is particularly well suited for real-time remote sensing applications because of its user-tunable computational speed and numerical accuracy, with respect to a reference line-by-line model. The use of OSS has cut cloud model processing times in half, eliminated the influence of cloudy pixel artifacts in the statistical time series prescription of cloud-cleared radiances, and improved cloud-mask quality.


2016 ◽  
Vol 9 (8) ◽  
pp. 4151-4165 ◽  
Author(s):  
Felipe A. Mejia ◽  
Ben Kurtz ◽  
Keenan Murray ◽  
Laura M. Hinkelman ◽  
Manajit Sengupta ◽  
...  

Abstract. A method for retrieving cloud optical depth (τc) using a UCSD developed ground-based sky imager (USI) is presented. The radiance red–blue ratio (RRBR) method is motivated from the analysis of simulated images of various τc produced by a radiative transfer model (RTM). From these images the basic parameters affecting the radiance and red–blue ratio (RBR) of a pixel are identified as the solar zenith angle (θ0), τc, solar pixel angle/scattering angle (ϑs), and pixel zenith angle/view angle (ϑz). The effects of these parameters are described and the functions for radiance, Iλτc, θ0, ϑs, ϑz, and RBRτc, θ0, ϑs, ϑz are retrieved from the RTM results. RBR, which is commonly used for cloud detection in sky images, provides non-unique solutions for τc, where RBR increases with τc up to about τc = 1 (depending on other parameters) and then decreases. Therefore, the RRBR algorithm uses the measured Iλmeasϑs, ϑz, in addition to RBRmeasϑs, ϑz, to obtain a unique solution for τc. The RRBR method is applied to images of liquid water clouds taken by a USI at the Oklahoma Atmospheric Radiation Measurement (ARM) program site over the course of 220 days and compared against measurements from a microwave radiometer (MWR) and output from the Min et al. (2003) method for overcast skies. τc values ranged from 0 to 80 with values over 80, being capped and registered as 80. A τc RMSE of 2.5 between the Min et al. (2003) method and the USI are observed. The MWR and USI  have an RMSE of 2.2, which is well within the uncertainty of the MWR. The procedure developed here provides a foundation to test and develop other cloud detection algorithms.


2012 ◽  
Vol 33 (6) ◽  
pp. 1611-1624 ◽  
Author(s):  
Iñigo Mendikoa ◽  
Santiago Pérez-Hoyos ◽  
Agustín Sánchez-Lavega

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Rehman S. Eon ◽  
Charles M. Bachmann

AbstractThe advent of remote sensing from unmanned aerial systems (UAS) has opened the door to more affordable and effective methods of imaging and mapping of surface geophysical properties with many important applications in areas such as coastal zone management, ecology, agriculture, and defense. We describe a study to validate and improve soil moisture content retrieval and mapping from hyperspectral imagery collected by a UAS system. Our approach uses a recently developed model known as the multilayer radiative transfer model of soil reflectance (MARMIT). MARMIT partitions contributions due to water and the sediment surface into equivalent but separate layers and describes these layers using an equivalent slab model formalism. The model water layer thickness along with the fraction of wet surface become parameters that must be optimized in a calibration step, with extinction due to water absorption being applied in the model based on equivalent water layer thickness, while transmission and reflection coefficients follow the Fresnel formalism. In this work, we evaluate the model in both field settings, using UAS hyperspectral imagery, and laboratory settings, using hyperspectral spectra obtained with a goniometer. Sediment samples obtained from four different field sites representing disparate environmental settings comprised the laboratory analysis while field validation used hyperspectral UAS imagery and coordinated ground truth obtained on a barrier island shore during field campaigns in 2018 and 2019. Analysis of the most significant wavelengths for retrieval indicate a number of different wavelengths in the short-wave infra-red (SWIR) that provide accurate fits to measured soil moisture content in the laboratory with normalized root mean square error (NRMSE)< 0.145, while independent evaluation from sequestered test data from the hyperspectral UAS imagery obtained during the field campaign obtained an average NRMSE = 0.169 and median NRMSE = 0.152 in a bootstrap analysis.


Sign in / Sign up

Export Citation Format

Share Document