scholarly journals Combined neural network/Phillips-Tikhonov approach to aerosol retrievals over land from the NASA Research Scanning Polarimeter

2017 ◽  
Author(s):  
Antonio Di Noia ◽  
Otto P. Hasekamp ◽  
Lianghai Wu ◽  
Bastiaan van Diedenhoven ◽  
Brian Cairns ◽  
...  

Abstract. In this paper, an algorithm for the retrieval of aerosol and land surface properties from airborne spectropolarimetric measurements – combining neural networks and an iterative scheme based on Phillips-Tikhonov regularization – is described. The algorithm – which is an extension of a scheme previously designed for ground-based retrievals – is applied to measurements from the Research Scanning Polarimeter (RSP) onboard the NASA ER-2 aircraft. A neural network, trained on a large dataset of synthetic measurements, is applied to perform aerosol retrievals from real RSP data, and the neural network retrievals are subsequently used as first guess for the Phillips-Tikhonov retrieval. The resulting algorithm appears capable of accurately retrieving aerosol optical thickness, fine mode effective radius and aerosol layer height from RSP data. Among the advantages of using a neural network as initial guess for an iterative algorithm are a decrease in processing time and an increase in the number of converging retrievals.

2017 ◽  
Vol 10 (11) ◽  
pp. 4235-4252 ◽  
Author(s):  
Antonio Di Noia ◽  
Otto P. Hasekamp ◽  
Lianghai Wu ◽  
Bastiaan van Diedenhoven ◽  
Brian Cairns ◽  
...  

Abstract. In this paper, an algorithm for the retrieval of aerosol and land surface properties from airborne spectropolarimetric measurements – combining neural networks and an iterative scheme based on Phillips–Tikhonov regularization – is described. The algorithm – which is an extension of a scheme previously designed for ground-based retrievals – is applied to measurements from the Research Scanning Polarimeter (RSP) on board the NASA ER-2 aircraft. A neural network, trained on a large data set of synthetic measurements, is applied to perform aerosol retrievals from real RSP data, and the neural network retrievals are subsequently used as a first guess for the Phillips–Tikhonov retrieval. The resulting algorithm appears capable of accurately retrieving aerosol optical thickness, fine-mode effective radius and aerosol layer height from RSP data. Among the advantages of using a neural network as initial guess for an iterative algorithm are a decrease in processing time and an increase in the number of converging retrievals.


2021 ◽  
Vol 14 (6) ◽  
pp. 3421-3435
Author(s):  
Zhenjiao Jiang ◽  
Dirk Mallants ◽  
Lei Gao ◽  
Tim Munday ◽  
Gregoire Mariethoz ◽  
...  

Abstract. This study introduces an efficient deep-learning model based on convolutional neural networks with joint autoencoder and adversarial structures for 3D subsurface mapping from 2D surface observations. The method was applied to delineate paleovalleys in an Australian desert landscape. The neural network was trained on a 6400 km2 domain by using a land surface topography as 2D input and an airborne electromagnetic (AEM)-derived probability map of paleovalley presence as 3D output. The trained neural network has a squared error <0.10 across 99 % of the training domain and produces a squared error <0.10 across 93 % of the validation domain, demonstrating that it is reliable in reconstructing 3D paleovalley patterns beyond the training area. Due to its generic structure, the neural network structure designed in this study and the training algorithm have broad application potential to construct 3D geological features (e.g., ore bodies, aquifer) from 2D land surface observations.


Sensors ◽  
2019 ◽  
Vol 19 (17) ◽  
pp. 3782 ◽  
Author(s):  
Julius Venskus ◽  
Povilas Treigys ◽  
Jolita Bernatavičienė ◽  
Gintautas Tamulevičius ◽  
Viktor Medvedev

The automated identification system of vessel movements receives a huge amount of multivariate, heterogeneous sensor data, which should be analyzed to make a proper and timely decision on vessel movements. The large number of vessels makes it difficult and time-consuming to detect abnormalities, thus rapid response algorithms should be developed for a decision support system to identify abnormal movements of vessels in areas of heavy traffic. This paper extends the previous study on a self-organizing map application for processing of sensor stream data received by the maritime automated identification system. The more data about the vessel’s movement is registered and submitted to the algorithm, the higher the accuracy of the algorithm should be. However, the task cannot be guaranteed without using an effective retraining strategy with respect to precision and data processing time. In addition, retraining ensures the integration of the latest vessel movement data, which reflects the actual conditions and context. With a view to maintaining the quality of the results of the algorithm, data batching strategies for the neural network retraining to detect anomalies in streaming maritime traffic data were investigated. The effectiveness of strategies in terms of modeling precision and the data processing time were estimated on real sensor data. The obtained results show that the neural network retraining time can be shortened by half while the sensitivity and precision only change slightly.


1995 ◽  
Vol 03 (03) ◽  
pp. 175-202 ◽  
Author(s):  
DONGYU FEI ◽  
JOHN T. KUO ◽  
YU-CHIUNG TENG

This paper presents the concept of neural network inversion. The basic mathematical problem is to establish the mapping between two multi-dimensional spaces, addressing the continuous function mapping between two close intervals. It introduces the 3-layer neural network existence theorem and proves that the multi-layer neural network can approximate any continuous function in the sense of supernorm or mean-squares-norm, provided that the activation function is locally Riemann integrable and nonpolynomial. With an initial guess of the target parameter, which, in the present case, is acoustic velocity, in a prescribed sphere, which contains the true parameter, the neural network inversion method ensures the search reaching the global minima. The principle of the neural network inversion on the basis of the least-squares minimization (L2 norm) is developed. As its application, this method is employed to perform seismic waveform inversions — Model 1, for a homogeneous isotropic earth with a 2-D rectangle embedded body, and Model 2, for a layered earth with an elliptically elongated inclusion. A fast computation algorithm of the finite element method is adopted to generate a series of synthetic shot records for training the 3-layer neural network. The trained neural network possesses the capability to find the acoustic velocity of the embedded body in both Model 1 and 2 with a real-time solution within a sufficient accuracy.


2014 ◽  
Vol 7 (9) ◽  
pp. 9047-9094 ◽  
Author(s):  
A. Di Noia ◽  
O. P. Hasekamp ◽  
G. van Harten ◽  
J. H. H. Rietjens ◽  
J. M. Smit ◽  
...  

Abstract. In this paper, the use of a neural network algorithm for the retrieval of the aerosol properties from ground-based spectropolarimetric measurements is discussed. The neural network is able to retrieve the aerosol properties with an accuracy that is almost comparable to that of an iterative retrieval. By using the outcome of the neural network as a first guess of the iterative retrieval scheme, the accuracy of the fine and coarse mode optical thickness are further improved while for the other parameters the improvement is small or absent. The resulting scheme (neural network + iterative retrieval) is compared to the original one (look-up table + iterative retrieval) on a set of simulated ground-based measurements, and on a small set of real observations carried out by an accurate ground-based spectropolarimeter. The results show that the use of a neural network based first guess leads to an increase in the number of converging retrievals, and possibly to more accurate estimates of the aerosol effective radius and complex refractive index.


2017 ◽  
Vol 28 (3-4) ◽  
pp. 55-71
Author(s):  
V. R. Cherlіnka

The maіn objectіve was to study the іnfluence of the traіnіng dataset on the qualіtatіve characterіstіcs of sіmulatіve soіl maps, whіch are obtaіned through sіmulatіon usіng a typіcal set of materіals that can be potentіally avaіlable for the soіl scіentіst іn modern Ukraіnіan realіtіes. Achіevement of thіs goal was achіeved by solvіng a number of the followіng tasks: a) dіgіtіzіng of cartographіc materіals; b) creatіng DEM wіth a resolutіon equal to 10 m; c) analysіs of dіgіtal elevatіon models and extractіon of land surface parameters; d) generatіon of traіnіng datasets accordіng to the descrіbed methodologіcal approaches; e) creatіon sіmulatіon models of soіl-cover іn R-statіstіc; g) analysіs of the obtaіned results and conclusіons regardіng the optіmal sіze of the traіnіng datasets for predіctіve modelіng of the soіl cover and іts duratіon. As an object was selected a fragment of the terrіtory of Ukraіne (4200×4200 m) wіthіn the lіmіts of Glybotsky dіstrіct of the Chernіvtsі regіon, confіned to the Prut-Sіret іnterfluve (North Bukovyna) wіth contrast geomorphologіcal condіtіons. Thіs area has dіfferent admіnіstratіve subordіnatіon and economіc use but іs covered wіth soіl cartographіc materіals only by 49.43 %. For data processіng were used іnstrumental possіbіlіtіes of free software: geo- rectіfіcatіons of maps materіal – GІS Quantum, dіgіtalіzatіon – Easy Trace, preparatіon of maps morphometrіc parameters – GRASS GІS and buіldіng sіmulatіve soіl maps – R, a language and envіronment for statіstіcal computіng. To create sіmulatіon models of soіl cover, a R-statіstіc scrіpt was wrіtten that іncludes a number of adaptatіons for solvіng set tasks and іmplements the dіfferent types of predіcatіve algorіthms such as: Multіnomіal Logіstіc Regressіon, Decіsіon Trees, Neural Networks, Random Forests, K-Nearest Neіghbors, Support Vector Machіnes and Bagged Trees. To assess the qualіty of the obtaіned models, the Cohen’s Kappa Іndex (?) was used whіch best represents the degree of complіance between the orіgіnal and the sіmulated data. As a benchmark, the usual medіal axes traіnіng dataset of was used. Other study optіons were: medіan-weіghted and randomіzed-weіghted samplіng. Thіs together wіth 7 predіcatіve algorіthms allowed to get 72 soіl sіmulatіons, the analysіs of whіch revealed quіte іnterestіng patterns. Models rankіng by іncreasіng the qualіty of the predіctіon by the kappa of the maіn data set shown, that the MLR algorіthm showed the worst results among others. Next іn ascendіng order are Neural Network, SVM, KNN, BGT, RF, DT. The last three algorіthms refer to the classіfіcatіon and theіr hіgh results іndіcate the greatest suіtabіlіty of such approaches іn sіmulatіon of soіl cover. The sample based on the weіghted medіan dіd not show strong advantages over others, as the results are quіte controversіal. Only іn the case of the neural network and the Bugget Trees the results of the medіan-weіghted sample predіctіon showed a better result vs a sіmple medіan sample and much worse than any varіants of randomіzed traіnіng data. Other algorіthms requіred a dіfferent number of randomіzed poіnts to cross the 90 % kappa: KNN – 25 %; BGT, RF and DT – 90 %. To achіeve 95 % kappa BGT algorіthm requіres 30% traіnіng poіnts of the total, RF – 25 % and DT – 20 %. Decіsіon Trees as a result turned out to be the most powerful algorіthm, whіch was able to sіmulate the dіstrіbutіon of soіl abnormalіtіes from kappa 97.13 % wіth 35 % saturatіon of the traіnіng sample wіth the orіgіnal data. Overall, DT shows a great dіfference between the approaches to selectіng traіnіng data: any medіan falls by 13 % іn front of a sіmple 5 % randomіzed-weіghted set of traіnіng cells and 22 % – about 35 % of the set.


2015 ◽  
Vol 8 (1) ◽  
pp. 281-299 ◽  
Author(s):  
A. Di Noia ◽  
O. P. Hasekamp ◽  
G. van Harten ◽  
J. H. H. Rietjens ◽  
J. M. Smit ◽  
...  

Abstract. In this paper, the use of a neural network algorithm for the retrieval of the aerosol properties from ground-based spectropolarimetric measurements is discussed. The neural network is able to retrieve the aerosol properties with an accuracy that is almost comparable to that of an iterative retrieval. By using the outcome of the neural network as first guess in the iterative retrieval scheme, the accuracy of the retrieved fine- and coarse-mode optical thickness is further improved, while for the other parameters the improvement is small or absent. The resulting scheme (neural network + iterative retrieval) is compared to the original one (look-up table + iterative retrieval) on a set of simulated ground-based measurements, and on a small set of real observations carried out by an accurate ground-based spectropolarimeter. The results show that the use of a neural-network-based first guess leads to an increase in the number of converging retrievals, and possibly to more accurate estimates of the aerosol effective radius and complex refractive index.


2019 ◽  
Author(s):  
Daniel J. Miller ◽  
Michal Segal-Rozenhaimer ◽  
Kirk Knobelspiesse ◽  
Jens Redemann ◽  
Brian Cairns ◽  
...  

Abstract. In this study we developed a neural network (NN) that can be used to relate a large dataset of multi-angular and multi-spectral polarimetric remote sensing observations to retrievals of cloud microphysical properties. This effort builds upon our previous work, which explored the sensitivity of neural network input, architecture, and other design requirements for this type of remote sensing problem. In particular this work introduces a framework for appropriately weighting total and polarized reflectances, which have vastly different magnitudes and measurement uncertainties. The NN is trained using an artificial training set and applied to Research Scanning Polarimeter (RSP) data obtained during the ORACLES field campaign (Observations of Aerosols above Clouds and their Interactions). The polarimetric RSP observations are unique in that they observe the same cloud from a very large number of angles within a variety of spectral bands resulting in a large dataset that can be explored rapidly with a NN approach. The usefulness applying a NN to a dataset such as this one stems from the possibility of rapidly obtaining a retrieval that could be subsequently applied as a first-guess for slower but more rigorous physical-based retrieval algorithms. This approach could be particularly advantageous for more complicated atmospheric retrievals – such as when an aerosol layer lies above clouds like in ORACLES. For the ORACLES 2016 dataset comparisons of the NN and standard parametric polarimetric (PP) cloud retrieval give reasonable results for droplet effective radius (re : R = 0.756, RMSE = 1.74 μm) and cloud optical thickness (τ : R = 0.950, RMSE = 1.82). This level of statistical agreement is shown to be similar to comparisons between the two most well-established cloud retrievals, namely the the polarimetric cloud retrieval and the bispectral total reflectance cloud retrieval. The NN retrievals from the ORACLES 2017 dataset result in retrievals of re (R = 0.54, RMSE = 4.77 μm) and τ (R = 0.785, RMSE = 5.61) that behave much more poorly. In particular we found that our NN retrieval approach does not perform well for thin (τ  <3), inhomogeneous, or broken clouds. We also found that correction for above-cloud atmospheric absorption improved the NN retrievals moderately – but retrievals without this correction still behaved similarly to existing cloud retrievals with a slight systematic offset.


2019 ◽  
Vol 24 (3) ◽  
pp. 256-264
Author(s):  
Gábor Werner ◽  
László Hanka

Abstract The process of pattern recognition in the biometrics is particularly important. The patterns can differ from each other a lot, and even the samples can be significantly different from the templates. The Artificial Neural Networks can be applied as a universal approximator to recognize the patterns with more flexibility. However the topology of the networks determines the processing time and complexity of the hardware of the physical environments. The Genetic Algorithms can be used with success in optimization problems like in this situation, the topology of the neural network is more optimal if we apply the Genetic Algorithms. This study introduce an algorithm in which a tailor made algorithm correcting the topology to enhance the effectiveness of the process.


2020 ◽  
Author(s):  
Zhenjiao Jiang ◽  
Dirk Mallants ◽  
Lei Gao ◽  
Gregoire Mariethoz ◽  
Luk Peeters

Abstract. This study introduces an efficient deep learning approach based on convolutional neural networks with joint autoencoder and adversarial structures for 3D subsurface mapping from surface observations. The method was applied to delineate palaeovalleys in an Australian desert landscape. The neural network was trained on a 6,400 km2 domain by using a land surface tomography as 2D input and an airborne electromagnetic (AEM)-derived probability map of palaeovalley presence as 3D output. The trained neural network has a maximum square error


Sign in / Sign up

Export Citation Format

Share Document