scholarly journals Estimation of Overtopping Discharges with Deep Neural Network(DNN) Method

2021 ◽  
Vol 8 (4) ◽  
pp. 229-236
Author(s):  
Changkyum Kim ◽  
Insik Chun ◽  
Byungcheol Oh
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Cost Function ◽  
Deep Neural Network ◽  
Multiple Linear Regression Model ◽  
Predictive Performance ◽  
Data Sets ◽  
Network Training ◽  
The Neural Network ◽  
The Cost

An Artificial Intelligence(AI) study was conducted to calculate overtopping discharges for various coastal structures. The Deep Neural Network(DNN), one of the artificial intelligence methods, was employed in the study. The neural network was trained, validated and tested using the EurOtop database containing the experimental data collected from all over the world. To improve the accuracy of the deep neural network results, all data were non-dimensionalized and max-min normalized as a preprocessing process. L2 regularization was also introduced in the cost function to secure the convergence of iterative learning, and the cost function was optimized using RMSProp and Adam techniques. In order to compare the performance of DNN, additional calculations based on the multiple linear regression model and EurOtop’s overtopping formulas were done as well, using the data sets which were not included in the network training. The results showed that the predictive performance of the AI technique was relatively superior to the two other methods.

scholarly journals IoT network security using autoencoder deep neural network and channel access algorithm

2021 ◽  
Vol 31 (1) ◽  
pp. 95-103
Author(s):  
Saif Mohammed Ali ◽  
Amer S. Elameer ◽  
Mustafa Musa Jaber
Keyword(s):  
Neural Network ◽  
Traffic Management ◽  
Deep Neural Network ◽  
Data Communication ◽  
Security And Privacy ◽  
Channel Access ◽  
Sensing Data ◽  
Network Training ◽  
The Neural Network ◽  
Medical Analysis

Abstract Internet-of-Things (IoT) creates a significant impact in spectrum sensing, information retrieval, medical analysis, traffic management, etc. These applications require continuous information to perform a specific task. At the time, various intermediate attacks such as jamming, priority violation attacks, and spectrum poisoning attacks affect communication because of the open nature of wireless communication. These attacks create security and privacy issues while making data communication. Therefore, a new method autoencoder deep neural network (AENN) is developed by considering exploratory, evasion, causative, and priority violation attack. The created method classifies the transmission outcomes used to predict the transmission state, whether it is jam data transmission or sensing data. After that, the sensing data is applied for network training that predicts the intermediate attacks. In addition to this, the channel access algorithm is used to validate the channel for every access that minimizes unauthorized access. After validating the channel according to the neural network, data have been transmitted over the network. The defined process is implemented, and the system minimizes different attacks on various levels of energy consumption. The effectiveness of the system is implemented using TensorFlow, and the system ensures the 99.02% of detection rate when compared with other techniques.

CHARACTERIZING ONE-LAYER ASSOCIATIVE NEURAL NETWORKS WITH OPTIMAL NOISE-REDUCTION ABILITY

1992 ◽  
Vol 06 (05) ◽  
pp. 1009-1025 ◽  
Author(s):  
TAO WANG ◽  
XIAOLIANG XING ◽  
XINHUA ZHUANG
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Cost Function ◽  
Noise Reduction ◽  
Gradient Descent ◽  
Storage Capacity ◽  
Learning Algorithm ◽  
Optimal Learning ◽  
The Neural Network ◽  
The Cost

In this paper, we describe an optimal learning algorithm for designing one-layer neural networks by means of global minimization. Taking the properties of a well-defined neural network into account, we derive a cost function to measure the goodness of the network quantitatively. The connection weights are determined by the gradient descent rule to minimize the cost function. The optimal learning algorithm is formed as either the unconstraint-based or the constraint-based minimization problem. It ensures the realization of each desired associative mapping with the best noise reduction ability in the sense of optimization. We also investigate the storage capacity of the neural network, the degree of noise reduction for a desired associative mapping, and the convergence of the learning algorithm in an analytic way. Finally, a large number of computer experimental results are presented.

scholarly journals Precise modelling and interpretation of bioactivities of ligands targeting G protein-coupled receptors

2019 ◽  
Vol 35 (14) ◽  
pp. i324-i332 ◽  
Author(s):  
Jiansheng Wu ◽  
Ben Liu ◽  
Wallace K B Chan ◽  
Weijian Wu ◽  
Tao Pang ◽  
...  
Keyword(s):  
Neural Network ◽  
G Protein ◽  
Drug Targets ◽  
Deep Neural Network ◽  
Predictive Performance ◽  
G Protein Coupled Receptors ◽  
Supplementary Information ◽  
Network Training ◽  
G Protein Coupled

Abstract Motivation Accurate prediction and interpretation of ligand bioactivities are essential for virtual screening and drug discovery. Unfortunately, many important drug targets lack experimental data about the ligand bioactivities; this is particularly true for G protein-coupled receptors (GPCRs), which account for the targets of about a third of drugs currently on the market. Computational approaches with the potential of precise assessment of ligand bioactivities and determination of key substructural features which determine ligand bioactivities are needed to address this issue. Results A new method, SED, was proposed to predict ligand bioactivities and to recognize key substructures associated with GPCRs through the coupling of screening for Lasso of long extended-connectivity fingerprints (ECFPs) with deep neural network training. The SED pipeline contains three successive steps: (i) representation of long ECFPs for ligand molecules, (ii) feature selection by screening for Lasso of ECFPs and (iii) bioactivity prediction through a deep neural network regression model. The method was examined on a set of 16 representative GPCRs that cover most subfamilies of human GPCRs, where each has 300–5000 ligand associations. The results show that SED achieves excellent performance in modelling ligand bioactivities, especially for those in the GPCR datasets without sufficient ligand associations, where SED improved the baseline predictors by 12% in correlation coefficient (r2) and 19% in root mean square error. Detail data analyses suggest that the major advantage of SED lies on its ability to detect substructures from long ECFPs which significantly improves the predictive performance. Availability and implementation The source code and datasets of SED are freely available at https://zhanglab.ccmb.med.umich.edu/SED/. Supplementary information Supplementary data are available at Bioinformatics online.

scholarly journals Neural Network and Cuckoo Optimization Algorithm for Remote Sensing Image Classification

2019 ◽  
Vol 8 (4) ◽  
pp. 1630-1634
Keyword(s):  
Neural Network ◽  
Remote Sensing ◽  
Cost Function ◽  
Optimization Algorithm ◽  
Remote Sensing Images ◽  
Remote Sensing Image Classification ◽  
The Neural Network ◽  
Training Examples ◽  
The Cost

Since Remote sensing images are used for a variety of applications, classification of such images is essential for extracting information. However, due to the lack of sufficient training examples, classification of remote sensing images is more complex. Also, in traditional method of classification, the statistical procedure uses only the gray value of the digital images to extract information. Neural network (NN) has a better impact in this domain. The proposed work uses an integrated NN and cuckoo Optimisation Algorithm (COA) for classification. The NN picks, organise and constructs the data to be trained into a network. The network is then trained and tested. The COA is combined with NN to aid the task of classification and to calculate the cost function. The optimization algorithm provides an appropriate feature suitable for the neural network classifier to produce final output. This hybridized technique presents the effective advantages of the neural network and further investigate the classification of the multispectral remote sensible images. The performance and error rate of the system is better when compared with other classical methods. The observed results illustrate the effectiveness of the COA to optimize the cost function. As training parameters in Neural network is found to be NP hard, utilization of COA involve its responsibility in optimizing the learning rate of NN.

scholarly journals Neural network training in SCILAB for classifying mango (Mangifera indica) according to maturity level using the RGB color model

2021 ◽  
Vol 1 (3) ◽  
pp. 186
Author(s):  
Eduardo Castillo-Castaneda
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Raw Materials ◽  
Mangifera Indica ◽  
Color Model ◽  
Maturity Level ◽  
Network Training ◽  
The Neural Network ◽  
Blue Background

<p style='text-indent:20px;'>Industries that use fruits as raw materials must, at some point in the process, classify them to discard the unsuitable ones and thus ensure the quality of the final product. To produce mango nectar, it is necessary to ensure that the mango is mature enough to start the extraction of the nectar; however, sorting thousands of mangoes may require many people, who can easily lose attention and reduce the accuracy of the result. Such kind of decision can be supported by current Artificial Intelligence techniques. The theoretical details of the processing are presented, as well as the programming code of the neural network using SCILAB as a computer language; the code includes the color extraction from mango images. SCILAB programming is simple, efficient and does not require computers with large processing capacity. The classification was validated with 30 images (TIF format) of Manila variety mango; the mangoes were placed on a blue background to easily separate the background from the object of interest. Four and six mangoes were used to train the neural network. This application of neural networks is part of an undergraduate course on artificial intelligence, which shows the potential of these techniques for solving real and concrete problems.</p>

Constructive Neural Networks and Their Application to Ship Multidisciplinary Design Optimization

2007 ◽  
Vol 51 (04) ◽  
pp. 297-312
Author(s):  
Eric Besnard ◽  
Adeline Schmitz ◽  
Hamid Hefazi ◽  
Rahul Shinde
Keyword(s):  
Neural Network ◽  
Data Sets ◽  
Mathematical Function ◽  
Training Set ◽  
The Neural Network ◽  
Development Cycle ◽  
Cascade Correlation ◽  
Small Set ◽  
Validation Set ◽  
The Cost

This paper presents a neural network-based response surface method for reducing the cost of computer-intensive optimizations for applications in ship design. In the approach, complex or costly analyses are replaced by a neural network, which is used to instantaneously estimate the value of the function(s) of interest. The cost of the optimization is shifted to the generation of (smaller) data sets used for training the network. The focus of the paper is on the use and analysis of constructive networks, as opposed to networks of fixed size, for treating problems with a large number of variables, say around 30. The advantages offered by constructive networks are emphasized, leading to the selection and discussion of the cascade correlation algorithm. This topology allows for efficient neural network determination when dealing with function representation over large design spaces without requiring prior experience from the user. During training, the network grows until the error on a small set (validation set), different from that used in the training itself (training set), starts increasing. The method is validated for a mathematical function for dimensions ranging from 5 to 30, and the importance of analyzing the error on a set other than the training set is emphasized. The approach is then applied to the automated computational fluid dynamics-based shape optimization of a fast ship configuration known as the twin H-body. The classical approach yields a design improvement of 26%, whereas the neural network-based method allows reaching a 34% improvement at one fifth of the cost of the former. Based on the analysis of the results, areas for future improvements and research are outlined. The results demonstrate the potential of the method in saving valuable development cycle time and increasing the performance of future ship designs.

scholarly journals Prediction of yarn unevenness based on BMNN

2021 ◽  
Vol 16 ◽  
pp. 155892502110379
Author(s):  
Hao Jiang ◽  
Jiuxiang Song ◽  
Baowei Zhang ◽  
Suna Zhao ◽  
Yonghua Wang
Keyword(s):  
Neural Network ◽  
Deep Neural Network ◽  
Learning System ◽  
Training Data ◽  
Data Sets ◽  
Data Set ◽  
Training Time ◽  
Network Training ◽  
Yarn Quality ◽  
Neural Network Structure

With the continuous development of deep learning, due to the complexity of the deep neural network structure and the limitation of training time, some scholars have proposed broad learning, the Broad Learning System (BLS). However, BLS currently only verifies that it has excellent effects on some of the network training data sets, and it does not necessarily have excellent effects on some actual data sets. In response to this, this paper uses the effect of BLS in predicting the unevenness of yarn quality in the yarn data set, and proposes a BLS-based multi-layer neural network (MNN) for the problems, which is called Broad Multilayer Neural Network (BMNN).

scholarly journals An Adaptive Optimization Method Based on Learning Rate Schedule for Neural Networks

2021 ◽  
Vol 11 (2) ◽  
pp. 850
Author(s):  
Dokkyun Yi ◽  
Sangmin Ji ◽  
Jieun Park
Keyword(s):  
Artificial Intelligence ◽  
Cost Function ◽  
Numerical Experiments ◽  
Global Minimum ◽  
Optimization Method ◽  
Learning Method ◽  
Adaptive Optimization ◽  
The Cost ◽  
Proof Of Convergence ◽  
Learning Data

Artificial intelligence (AI) is achieved by optimizing the cost function constructed from learning data. Changing the parameters in the cost function is an AI learning process (or AI learning for convenience). If AI learning is well performed, then the value of the cost function is the global minimum. In order to obtain the well-learned AI learning, the parameter should be no change in the value of the cost function at the global minimum. One useful optimization method is the momentum method; however, the momentum method has difficulty stopping the parameter when the value of the cost function satisfies the global minimum (non-stop problem). The proposed method is based on the momentum method. In order to solve the non-stop problem of the momentum method, we use the value of the cost function to our method. Therefore, as the learning method processes, the mechanism in our method reduces the amount of change in the parameter by the effect of the value of the cost function. We verified the method through proof of convergence and numerical experiments with existing methods to ensure that the learning works well.

scholarly journals The International Radiomics Platform – An Initiative of the German and Austrian Radiological Societies

2020 ◽  
Author(s):  
Daniel Overhoff ◽  
Peter Kohlmann ◽  
Alex Frydrychowicz ◽  
Sergios Gatidis ◽  
Christian Loewe ◽  
...  
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Image Data ◽  
Quality Parameters ◽  
Image Features ◽  
Performance Criteria ◽  
Data Sets ◽  
Proof Of Concept ◽  
Concept Study ◽  
Artificial Intelligence Methods

Purpose The DRG-ÖRG IRP (Deutsche Röntgengesellschaft-Österreichische Röntgengesellschaft international radiomics platform) represents a web-/cloud-based radiomics platform based on a public-private partnership. It offers the possibility of data sharing, annotation, validation and certification in the field of artificial intelligence, radiomics analysis, and integrated diagnostics. In a first proof-of-concept study, automated myocardial segmentation and automated myocardial late gadolinum enhancement (LGE) detection using radiomic image features will be evaluated for myocarditis data sets. Materials and Methods The DRG-ÖRP IRP can be used to create quality-assured, structured image data in combination with clinical data and subsequent integrated data analysis and is characterized by the following performance criteria: Possibility of using multicentric networked data, automatically calculated quality parameters, processing of annotation tasks, contour recognition using conventional and artificial intelligence methods and the possibility of targeted integration of algorithms. In a first study, a neural network pre-trained using cardiac CINE data sets was evaluated for segmentation of PSIR data sets. In a second step, radiomic features were applied for segmental detection of LGE of the same data sets, which were provided multicenter via the IRP. Results First results show the advantages (data transparency, reliability, broad involvement of all members, continuous evolution as well as validation and certification) of this platform-based approach. In the proof-of-concept study, the neural network demonstrated a Dice coefficient of 0.813 compared to the expert's segmentation of the myocardium. In the segment-based myocardial LGE detection, the AUC was 0.73 and 0.79 after exclusion of segments with uncertain annotation.The evaluation and provision of the data takes place at the IRP, taking into account the FAT (fairness, accountability, transparency) and FAIR (findable, accessible, interoperable, reusable) criteria. Conclusion It could be shown that the DRG-ÖRP IRP can be used as a crystallization point for the generation of further individual and joint projects. The execution of quantitative analyses with artificial intelligence methods is greatly facilitated by the platform approach of the DRG-ÖRP IRP, since pre-trained neural networks can be integrated and scientific groups can be networked.In a first proof-of-concept study on automated segmentation of the myocardium and automated myocardial LGE detection, these advantages were successfully applied.Our study shows that with the DRG-ÖRP IRP, strategic goals can be implemented in an interdisciplinary way, that concrete proof-of-concept examples can be demonstrated, and that a large number of individual and joint projects can be realized in a participatory way involving all groups. Key Points:  Citation Format

scholarly journals Comparison of predicted psychological distress among workers between artificial intelligence and psychiatrists: a cross-sectional study in Tsukuba Science City, Japan

BMJ Open ◽  
2021 ◽  
Vol 11 (6) ◽  
pp. e046265
Author(s):  
Shotaro Doki ◽  
Shinichiro Sasahara ◽  
Daisuke Hori ◽  
Yuichi Oi ◽  
Tsukasa Takahashi ◽  
...  
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Psychological Distress ◽  
Cross Sectional Study ◽  
Sectional Study ◽  
Cross Sectional ◽  
Explanatory Variables ◽  
The Neural Network ◽  
Significant Difference ◽  
Total Data

ObjectivesPsychological distress is a worldwide problem and a serious problem that needs to be addressed in the field of occupational health. This study aimed to use artificial intelligence (AI) to predict psychological distress among workers using sociodemographic, lifestyle and sleep factors, not subjective information such as mood and emotion, and to examine the performance of the AI models through a comparison with psychiatrists.DesignCross-sectional study.SettingWe conducted a survey on psychological distress and living conditions among workers. An AI model for predicting psychological distress was created and then the results were compared in terms of accuracy with predictions made by psychiatrists.ParticipantsAn AI model of the neural network and six psychiatrists.Primary outcomeThe accuracies of the AI model and psychiatrists for predicting psychological distress.MethodsIn total, data from 7251 workers were analysed to predict moderate and severe psychological distress. An AI model of the neural network was created and accuracy, sensitivity and specificity were calculated. Six psychiatrists used the same data as the AI model to predict psychological distress and conduct a comparison with the AI model.ResultsThe accuracies of the AI model and psychiatrists for predicting moderate psychological distress were 65.2% and 64.4%, respectively, showing no significant difference. The accuracies of the AI model and psychiatrists for predicting severe psychological distress were 89.9% and 85.5%, respectively, indicating that the AI model had significantly higher accuracy.ConclusionsA machine learning model was successfully developed to screen workers with depressed mood. The explanatory variables used for the predictions did not directly ask about mood. Therefore, this newly developed model appears to be able to predict psychological distress among workers easily, regardless of their subjective views.

Sign in / Sign up

Export Citation Format

Share Document