Convolutional Neural Network Surrogate Models for the Mechanical Properties of Periodic Structures

2019 ◽  
Vol 142 (2) ◽  
Author(s):  
Mark C. Messner
Keyword(s):  
Neural Network ◽  
Mechanical Properties ◽  
Periodic Structures ◽  
Optimization Methods ◽  
Surrogate Models ◽  
Training Data ◽  
Future Research ◽  
Data Sampling ◽  
Periodic Composites ◽  
Inverse Design Problem

Abstract This work describes neural network surrogate models for calculating the effective mechanical properties of a periodic composites. The models achieve good accuracy even when only provided with training data sampling a small portion of the design space. As an example, the surrogate models are applied to solving the inverse design problem of finding structures with optimal mechanical properties. The surrogate models are sufficiently accurate to recover optimal solutions in general agreement with established topology optimization methods. However, improvements will be required to develop robust, efficient neural network-based surrogate models and several directions for future research are highlighted here.

scholarly journals Automatic sleep stage classification with deep residual networks in a mixed-cohort setting

SLEEP ◽  
2020 ◽  
Author(s):  
Alexander Neergaard Olesen ◽  
Poul Jørgen Jennum ◽  
Emmanuel Mignot ◽  
Helge Bjarup Dissing Sorensen
Keyword(s):  
Neural Network ◽  
Large Scale ◽  
Deep Neural Network ◽  
Sleep Stage ◽  
Scoring Systems ◽  
Training Data ◽  
Future Research ◽  
Small Scale ◽  
Sleep Stage Scoring ◽  
Single Cohort

Abstract Study Objectives Sleep stage scoring is performed manually by sleep experts and is prone to subjective interpretation of scoring rules with low intra- and interscorer reliability. Many automatic systems rely on few small-scale databases for developing models, and generalizability to new datasets is thus unknown. We investigated a novel deep neural network to assess the generalizability of several large-scale cohorts. Methods A deep neural network model was developed using 15,684 polysomnography studies from five different cohorts. We applied four different scenarios: (1) impact of varying timescales in the model; (2) performance of a single cohort on other cohorts of smaller, greater, or equal size relative to the performance of other cohorts on a single cohort; (3) varying the fraction of mixed-cohort training data compared with using single-origin data; and (4) comparing models trained on combinations of data from 2, 3, and 4 cohorts. Results Overall classification accuracy improved with increasing fractions of training data (0.25%: 0.782 ± 0.097, 95% CI [0.777–0.787]; 100%: 0.869 ± 0.064, 95% CI [0.864–0.872]), and with increasing number of data sources (2: 0.788 ± 0.102, 95% CI [0.787–0.790]; 3: 0.808 ± 0.092, 95% CI [0.807–0.810]; 4: 0.821 ± 0.085, 95% CI [0.819–0.823]). Different cohorts show varying levels of generalization to other cohorts. Conclusions Automatic sleep stage scoring systems based on deep learning algorithms should consider as much data as possible from as many sources available to ensure proper generalization. Public datasets for benchmarking should be made available for future research.

scholarly journals Representation Learning for Motor Imagery Recognition with Deep Neural Network

Electronics ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 112
Author(s):  
Fangzhou Xu ◽  
Fenqi Rong ◽  
Yunjing Miao ◽  
Yanan Sun ◽  
Gege Dong ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Motor Imagery ◽  
Learning Algorithm ◽  
Representation Learning ◽  
Training Data ◽  
Gradient Boosting ◽  
Future Research ◽  
Deep Learning Algorithm ◽  
The Brain

This study describes a method for classifying electrocorticograms (ECoGs) based on motor imagery (MI) on the brain–computer interface (BCI) system. This method is different from the traditional feature extraction and classification method. In this paper, the proposed method employs the deep learning algorithm for extracting features and the traditional algorithm for classification. Specifically, we mainly use the convolution neural network (CNN) to extract the features from the training data and then classify those features by combing with the gradient boosting (GB) algorithm. The comprehensive study with CNN and GB algorithms will profoundly help us to obtain more feature information from brain activities, enabling us to obtain the classification results from human body actions. The performance of the proposed framework has been evaluated on the dataset I of BCI Competition III. Furthermore, the combination of deep learning and traditional algorithms provides some ideas for future research with the BCI systems.

scholarly journals Transfer learning for deep neural network-based partial differential equations solving

2021 ◽  
Vol 3 (1) ◽  
Author(s):  
Xinhai Chen ◽  
Chunye Gong ◽  
Qian Wan ◽  
Liang Deng ◽  
Yunbo Wan ◽  
...  
Keyword(s):  
Neural Network ◽  
Partial Differential Equations ◽  
Differential Equations ◽  
Transfer Learning ◽  
Stokes Equations ◽  
Surrogate Models ◽  
Training Data ◽  
Navier Stokes ◽  
Partial Differential ◽  
Navier Stokes Equations

AbstractDeep neural networks (DNNs) have recently shown great potential in solving partial differential equations (PDEs). The success of neural network-based surrogate models is attributed to their ability to learn a rich set of solution-related features. However, learning DNNs usually involves tedious training iterations to converge and requires a very large number of training data, which hinders the application of these models to complex physical contexts. To address this problem, we propose to apply the transfer learning approach to DNN-based PDE solving tasks. In our work, we create pairs of transfer experiments on Helmholtz and Navier-Stokes equations by constructing subtasks with different source terms and Reynolds numbers. We also conduct a series of experiments to investigate the degree of generality of the features between different equations. Our results demonstrate that despite differences in underlying PDE systems, the transfer methodology can lead to a significant improvement in the accuracy of the predicted solutions and achieve a maximum performance boost of 97.3% on widely used surrogate models.

Application of Artificial Neural Network Based on GA-BP Algorithm to Predicting Mechanical Properties of TC4

2010 ◽  
Vol 146-147 ◽  
pp. 1698-1701
Author(s):  
Zhe Zhe Hou ◽  
Yan Liang Du
Keyword(s):  
Neural Network ◽  
Mechanical Properties ◽  
Heat Treatment ◽  
Genetic Algorithm ◽  
Artificial Neural Network ◽  
Back Propagation ◽  
Optimization Methods ◽  
Calculation Results ◽  
Tc4 Alloy ◽  
Artificial Neural

On the basis of numerous experimental results the effect of heat treatment on mechanical properties of TC4 alloy is studied. A computer model expressing the relationships between heat treatment and mechanical properties has been established with a back propagation feed forword artificial neural network method. The optimization methods based on artificial neural network and the genetic algorithm, using binary system, optimize the weight and threshold by the genetic algorithm. The calculation results show that the model has good learning precision and generalization and it can be used for predicting the mechanical properties of TC4 alloy.

Economics of coated paper production made from deinked pulp

TAPPI Journal ◽  
2013 ◽  
Vol 12 (4) ◽  
pp. 19-27
Author(s):  
PATRICK HUBER ◽  
LAURENT LYANNAZ ◽  
BRUNO CARRÉ
Keyword(s):  
Mechanical Properties ◽  
Optimization Methods ◽  
Coating Process ◽  
Coated Paper ◽  
Paper Production ◽  
Base Paper

The fraction of deinked pulp for coated paper production is continually increasing, with some mills using 100% deinked pulp for the base paper. The brightness of the coated paper made from deinked pulp may be reached through a combination of more or less extensive deinking, compensated by appropriate coating, to optimize costs overall. The authors proposed general optimization methods combined with Kubelka-Munk multilayer calculations to find the most economical combination of deinking and coating process that would produce a coated paper made from DIP, at a given target brightness, while maintaining mechanical properties.

Semi-supervised Multi-task Network For Image Aesthetic Assessment

2020 ◽  
Vol 2020 (8) ◽  
pp. 188-1-188-7
Author(s):  
Xiaoyu Xiang ◽  
Yang Cheng ◽  
Jianhang Chen ◽  
Qian Lin ◽  
Jan Allebach
Keyword(s):  
Neural Network ◽  
Semantic Content ◽  
Training Data ◽  
Score Distribution ◽  
Generalization Ability ◽  
Subjective Preference ◽  
Ranking Tasks

Image aesthetic assessment has always been regarded as a challenging task because of the variability of subjective preference. Besides, the assessment of a photo is also related to its style, semantic content, etc. Conventionally, the estimations of aesthetic score and style for an image are treated as separate problems. In this paper, we explore the inter-relatedness between the aesthetics and image style, and design a neural network that can jointly categorize image by styles and give an aesthetic score distribution. To this end, we propose a multi-task network (MTNet) with an aesthetic column serving as a score predictor and a style column serving as a style classifier. The angular-softmax loss is applied in training primary style classifiers to maximize the margin among classes in single-label training data; the semi-supervised method is applied to improve the network’s generalization ability iteratively. We combine the regression loss and classification loss in training aesthetic score. Experiments on the AVA dataset show the superiority of our network in both image attributes classification and aesthetic ranking tasks.

Accurate and Transferable Multitask Prediction of Chemical Properties with an Atoms-in-Molecule Neural Network

2018 ◽  
Author(s):  
Roman Zubatyuk ◽  
Justin S. Smith ◽  
Jerzy Leszczynski ◽  
Olexandr Isayev
Keyword(s):  
Neural Network ◽  
Molecular System ◽  
Computational Cost ◽  
Chemical Properties ◽  
The State ◽  
Molecular Properties ◽  
Training Data ◽  
Dft Methods ◽  
Benchmark Datasets ◽  
Quantum Phenomena

<p>Atomic and molecular properties could be evaluated from the fundamental Schrodinger’s equation and therefore represent different modalities of the same quantum phenomena. Here we present AIMNet, a modular and chemically inspired deep neural network potential. We used AIMNet with multitarget training to learn multiple modalities of the state of the atom in a molecular system. The resulting model shows on several benchmark datasets the state-of-the-art accuracy, comparable to the results of orders of magnitude more expensive DFT methods. It can simultaneously predict several atomic and molecular properties without an increase in computational cost. With AIMNet we show a new dimension of transferability: the ability to learn new targets utilizing multimodal information from previous training. The model can learn implicit solvation energy (like SMD) utilizing only a fraction of original training data, and archive MAD error of 1.1 kcal/mol compared to experimental solvation free energies in MNSol database.</p>

Operational Determination of the Activated Sludge Process Using Neural Networks

1992 ◽  
Vol 26 (9-11) ◽  
pp. 2461-2464 ◽  
Author(s):  
R. D. Tyagi ◽  
Y. G. Du
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Steady State ◽  
Activated Sludge ◽  
Feedforward Neural Network ◽  
Training Data ◽  
Activated Sludge Process

A steady-statemathematical model of an activated sludgeprocess with a secondary settler was developed. With a limited number of training data samples obtained from the simulation at steady state, a feedforward neural network was established which exhibits an excellent capability for the operational prediction and determination.

scholarly journals Automated Ventricular System Segmentation in Paediatric Patients Treated for Hydrocephalus Using Deep Learning Methods

2019 ◽  
Vol 2019 ◽  
pp. 1-9 ◽  
Author(s):  
Michał Klimont ◽  
Mateusz Flieger ◽  
Jacek Rzeszutek ◽  
Joanna Stachera ◽  
Aleksandra Zakrzewska ◽  
...  
Keyword(s):  
Neural Network ◽  
Data Augmentation ◽  
Ct Images ◽  
Policy Transfer ◽  
Training Data ◽  
Intraobserver Variability ◽  
Practical Applications ◽  
Brain Scans ◽  
Rate Policy ◽  
Ct Brain

Hydrocephalus is a common neurological condition that can have traumatic ramifications and can be lethal without treatment. Nowadays, during therapy radiologists have to spend a vast amount of time assessing the volume of cerebrospinal fluid (CSF) by manual segmentation on Computed Tomography (CT) images. Further, some of the segmentations are prone to radiologist bias and high intraobserver variability. To improve this, researchers are exploring methods to automate the process, which would enable faster and more unbiased results. In this study, we propose the application of U-Net convolutional neural network in order to automatically segment CT brain scans for location of CSF. U-Net is a neural network that has proven to be successful for various interdisciplinary segmentation tasks. We optimised training using state of the art methods, including “1cycle” learning rate policy, transfer learning, generalized dice loss function, mixed float precision, self-attention, and data augmentation. Even though the study was performed using a limited amount of data (80 CT images), our experiment has shown near human-level performance. We managed to achieve a 0.917 mean dice score with 0.0352 standard deviation on cross validation across the training data and a 0.9506 mean dice score on a separate test set. To our knowledge, these results are better than any known method for CSF segmentation in hydrocephalic patients, and thus, it is promising for potential practical applications.

scholarly journals A review of infant cry analysis and classification

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Chunyan Ji ◽  
Thosini Bamunu Mudiyanselage ◽  
Yutong Gao ◽  
Yi Pan
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Signal Analysis ◽  
Future Research ◽  
Prosodic Features ◽  
Infant Cry ◽  
Machine Learning Classification ◽  
Machine Learning Classifiers ◽  
Learning Classifiers ◽  
Processing Techniques

AbstractThis paper reviews recent research works in infant cry signal analysis and classification tasks. A broad range of literatures are reviewed mainly from the aspects of data acquisition, cross domain signal processing techniques, and machine learning classification methods. We introduce pre-processing approaches and describe a diversity of features such as MFCC, spectrogram, and fundamental frequency, etc. Both acoustic features and prosodic features extracted from different domains can discriminate frame-based signals from one another and can be used to train machine learning classifiers. Together with traditional machine learning classifiers such as KNN, SVM, and GMM, newly developed neural network architectures such as CNN and RNN are applied in infant cry research. We present some significant experimental results on pathological cry identification, cry reason classification, and cry sound detection with some typical databases. This survey systematically studies the previous research in all relevant areas of infant cry and provides an insight on the current cutting-edge works in infant cry signal analysis and classification. We also propose future research directions in data processing, feature extraction, and neural network classification fields to better understand, interpret, and process infant cry signals.

Sign in / Sign up

Export Citation Format

Share Document