Data Assimilation in the Latent Space of a Convolutional Autoencoder

Author(s):  
Maddalena Amendola ◽  
Rossella Arcucci ◽  
Laetitia Mottet ◽  
César Quilodrán Casas ◽  
Shiwei Fan ◽  
...  
Sensors ◽  
2020 ◽  
Vol 20 (13) ◽  
pp. 3665
Author(s):  
Antonio Morán ◽  
Serafín Alonso ◽  
Daniel Pérez ◽  
Miguel A. Prada ◽  
Juan José Fuertes ◽  
...  

The understanding of the nature and structure of energy use in large buildings is vital for defining novel energy and climate change strategies. The advances on metering technology and low-cost devices make it possible to form a submetering network, which measures the main supply and other intermediate points providing information of the behavior of different areas. However, an analysis by means of classical techniques can lead to wrong conclusions if the load is not balanced. This paper proposes the use of a deep convolutional autoencoder to reconstruct the whole consumption measured by the submeters using the learnt features in order to analyze the behavior of different building areas. The display of weights and information of the latent space provided by the autoencoder allows us to obtain precise details of the influence of each area in the whole building consumption and its dependence on external factors such as temperature. A submetering network is deployed in the León University Hospital building in order to test the proposed methodology. The results show different correlations between environmental variables and building areas and indicate that areas can be grouped depending on their function in the building performance. Furthermore, this approach is able to provide discernible results in the presence of large differences with respect to the consumption ranges of the different areas, unlike conventional approaches where the influence of smaller areas is usually hidden.


2021 ◽  
Author(s):  
Yong-Keun Park ◽  
Min-Kyung Kim ◽  
Jumyung Um

Abstract The research on predictive maintenance of rotating machines, the most important element in manufacturing facilities, has been very active. The widespread availability of smart factory solutions has led to improved data collection from machines and processes and is able to provide key information. For our purpose, the collected information enables the maintenance system to predict the remaining useful life using deep learning models. The introduction of multi-layer perceptron of signal processing originating from bearings, in time series data, has been discussed in many publications. However, estimating accuracy for the remaining useful life is determined by the selection of the feature domain and the concatenation network model. Herein, we introduce a convolutional Autoencoder based on multi-domain ensemble learning in order to include various feature domains and a concatenation network operated by latent space into a single neural network. The performance of the proposed model is evaluated by using a simple health indicator and a PRONOSTIA dataset and compared with a simple concatenation model, 2-stage Autoencoder, and a recurrent neural network.


Author(s):  
Mathis Peyron ◽  
Anthony Fillion ◽  
Selime Gürol ◽  
Victor Marchais ◽  
Serge Gratton ◽  
...  

2021 ◽  
Author(s):  
Syamil Mohd Razak ◽  
Atefeh Jahandideh ◽  
Ulugbek Djuraev ◽  
Behnam Jafarpour

Abstract We present a deep learning architecture for efficient reduced-order implementation of ensemble data assimilation. Specifically, deep learning is used to improve two important aspects of data assimilation workflows: (i) low-rank representation of complex reservoir property distributions for geologically consistent feature-based model updating, and (ii) efficient prediction of the statistical information that are required for model updating. The proposed method uses deep convolutional autoencoders to nonlinearly map the original complex and high-dimensional parameters onto a low-dimensional parameter latent space that compactly represents the original parameters. In addition, a low-dimensional data latent space is constructed to predict the observable response of each model parameter realization, which can be used to compute the statistical information needed for the data assimilation step. The two mappings are developed as a joint deep learning architecture with two autoencoders that are connected and trained together. The training uses an ensemble of model parameters and their corresponding production response predictions as needed in implementing the standard ensemble-based data assimilation frameworks. Simultaneous training of the two mappings leads to a joint data-parameter manifold that captures the most salient information in the two spaces for a more effective data assimilation, where only relevant data and parameter features are included. Moreover, the parameter-to-data mapping provides a fast forecast model that can be used to increase the ensemble size for a more accurate data assimilation, without a major computational overhead. We implement the developed approach to a series of numerical experiments, including a 3D example based on the Volve field in the North Sea. For data assimilation methods that involve iterative schemes, such as ensemble smoothers with multiple data assimilation or iterative forms of ensemble Kalman filter, the proposed approach offers a computationally competitive alternative. Our results show that a fully low-dimensional implementation of ensemble data assimilation using deep learning architectures offers several advantages compared to standard algorithms, including joint data-parameter reduction that respects the salient features in each space, geologically consistent feature-based updates, increased ensemble sizes to improve the accuracy and computational efficiency of the calculated statistics for the update step.


Geophysics ◽  
2019 ◽  
Vol 85 (1) ◽  
pp. M15-M31 ◽  
Author(s):  
Mingliang Liu ◽  
Dario Grana

We have developed a time-lapse seismic history matching framework to assimilate production data and time-lapse seismic data for the prediction of static reservoir models. An iterative data assimilation method, the ensemble smoother with multiple data assimilation is adopted to iteratively update an ensemble of reservoir models until their predicted observations match the actual production and seismic measurements and to quantify the model uncertainty of the posterior reservoir models. To address computational and numerical challenges when applying ensemble-based optimization methods on large seismic data volumes, we develop a deep representation learning method, namely, the deep convolutional autoencoder. Such a method is used to reduce the data dimensionality by sparsely and approximately representing the seismic data with a set of hidden features to capture the nonlinear and spatial correlations in the data space. Instead of using the entire seismic data set, which would require an extremely large number of models, the ensemble of reservoir models is iteratively updated by conditioning the reservoir realizations on the production data and the low-dimensional hidden features extracted from the seismic measurements. We test our methodology on two synthetic data sets: a simplified 2D reservoir used for method validation and a 3D application with multiple channelized reservoirs. The results indicate that the deep convolutional autoencoder is extremely efficient in sparsely representing the seismic data and that the reservoir models can be accurately updated according to production data and the reparameterized time-lapse seismic data.


Geophysics ◽  
2020 ◽  
Vol 85 (4) ◽  
pp. WA67-WA76 ◽  
Author(s):  
Yunzhi Shi ◽  
Xinming Wu ◽  
Sergey Fomel

Picking horizons from seismic images is a fundamental step that could critically impact seismic interpretation quality. We have developed an unsupervised approach, waveform embedding, based on a deep convolutional autoencoder network to learn to transform seismic waveform samples to a latent space in which any waveform can be represented as an embedded vector. The regularizing mechanism of the autoencoder ensures that similar waveform patterns are mapped to embedded vectors with a shorter distance in the latent space. Within a search region, we transform all of the waveform samples to the latent space and compute their corresponding distance to the embedded vector of a control point that is set to the target horizon. We then convert the distance to a horizon probability map that highlights where the horizon is likely to be located. This method can guide horizon picking across lateral discontinuities such as faults, and it is insensitive to noise and lateral distortions. In addition, our unsupervised learning algorithm requires no training labels. We apply our horizon-picking method to multiple 2D/3D examples and obtain results more accurate than the baseline method.


2021 ◽  
Vol 10 (14) ◽  
pp. 3100
Author(s):  
Bardia Yousefi ◽  
Satoru Kawakita ◽  
Arya Amini ◽  
Hamed Akbari ◽  
Shailesh M. Advani ◽  
...  

The COVID-19 pandemic continues to spread globally at a rapid pace, and its rapid detection remains a challenge due to its rapid infectivity and limited testing availability. One of the simply available imaging modalities in clinical routine involves chest X-ray (CXR), which is often used for diagnostic purposes. Here, we proposed a computer-aided detection of COVID-19 in CXR imaging using deep and conventional radiomic features. First, we used a 2D U-Net model to segment the lung lobes. Then, we extracted deep latent space radiomics by applying deep convolutional autoencoder (ConvAE) with internal dense layers to extract low-dimensional deep radiomics. We used Johnson–Lindenstrauss (JL) lemma, Laplacian scoring (LS), and principal component analysis (PCA) to reduce dimensionality in conventional radiomics. The generated low-dimensional deep and conventional radiomics were integrated to classify COVID-19 from pneumonia and healthy patients. We used 704 CXR images for training the entire model (i.e., U-Net, ConvAE, and feature selection in conventional radiomics). Afterward, we independently validated the whole system using a study cohort of 1597 cases. We trained and tested a random forest model for detecting COVID-19 cases through multivariate binary-class and multiclass classification. The maximal (full multivariate) model using a combination of the two radiomic groups yields performance in classification cross-validated accuracy of 72.6% (69.4–74.4%) for multiclass and 89.6% (88.4–90.7%) for binary-class classification.


2015 ◽  
Vol 36 (4) ◽  
pp. 228-236 ◽  
Author(s):  
Janko Međedović ◽  
Boban Petrović

Abstract. Machiavellianism, narcissism, and psychopathy are personality traits understood to be dispositions toward amoral and antisocial behavior. Recent research has suggested that sadism should also be added to this set of traits. In the present study, we tested a hypothesis proposing that these four traits are expressions of one superordinate construct: The Dark Tetrad. Exploration of the latent space of four “dark” traits suggested that the singular second-order factor which represents the Dark Tetrad can be extracted. Analysis has shown that Dark Tetrad traits can be located in the space of basic personality traits, especially on the negative pole of the Honesty-Humility, Agreeableness, Conscientiousness, and Emotionality dimensions. We conclude that sadism behaves in a similar manner as the other dark traits, but it cannot be reduced to them. The results support the concept of “Dark Tetrad.”


Sign in / Sign up

Export Citation Format

Share Document