scholarly journals Engineer Design Process Assisted by Explainable Deep Learning Network

Author(s):  
Chia-Wei Hsu ◽  
An-Cheng Yang ◽  
Pei-Ching Kung ◽  
Nien-Ti Tsou ◽  
Nan-Yow Chen

Abstract Engineering simulation accelerates the development of reliable and repeatable design processes in various domains. However, the computing resource consumption is dramatically raised in the whole development processes. Making the most of these simulation data becomes more and more important in modern industrial product design. In the present study, we proposed a workflow comprised of a series of machine learning algorithms (mainly deep neuron networks) to be an alternative to the numerical simulation. We have applied the workflow to the field of dental implant design process. The process is based on a complex, time-dependent, multi-physical biomechanical theory, known as mechano-regulatory method. It has been used to evaluate the performance of dental implants and to assess the tissue recovery after the oral surgery procedures. We provided a deep learning network (DLN) with calibrated simulation data that came from different simulation conditions with experimental verification. The DLN achieves nearly exact result of simulated bone healing history around implants. The correlation of the predicted essential physical properties of surrounding bones (e.g. strain and fluid velocity) and performance indexes of implants (e.g. bone area and bone-implant contact) were greater than 0.980 and 0.947, respectively. The testing AUC values for the classification of each tissue phenotype were ranging from 0.90 to 0.99. The DLN reduced hours of simulation time to seconds. Moreover, our DLN is explainable via Deep Taylor decomposition, suggesting that the transverse fluid velocity, upper and lower parts of dental implants are the keys that influence bone healing and the distribution of tissue phenotypes the most. Many examples of commercial dental implants with designs which follow these design strategies can be found. This work demonstrates that DLN with proper network design is capable to replace complex, time-dependent, multi-physical models/theories, as well as to reveal the underlying features without prior professional knowledge.

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Chia-Wei Hsu ◽  
An-Cheng Yang ◽  
Pei-Ching Kung ◽  
Nien-Ti Tsou ◽  
Nan-Yow Chen

AbstractEngineering simulation accelerates the development of reliable and repeatable design processes in various domains. However, the computing resource consumption is dramatically raised in the whole development processes. Making the most of these simulation data becomes more and more important in modern industrial product design. In the present study, we proposed a workflow comprised of a series of machine learning algorithms (mainly deep neuron networks) to be an alternative to the numerical simulation. We have applied the workflow to the field of dental implant design process. The process is based on a complex, time-dependent, multi-physical biomechanical theory, known as mechano-regulatory method. It has been used to evaluate the performance of dental implants and to assess the tissue recovery after the oral surgery procedures. We provided a deep learning network (DLN) with calibrated simulation data that came from different simulation conditions with experimental verification. The DLN achieves nearly exact result of simulated bone healing history around implants. The correlation of the predicted essential physical properties of surrounding bones (e.g. strain and fluid velocity) and performance indexes of implants (e.g. bone area and bone-implant contact) were greater than 0.980 and 0.947, respectively. The testing AUC values for the classification of each tissue phenotype were ranging from 0.90 to 0.99. The DLN reduced hours of simulation time to seconds. Moreover, our DLN is explainable via Deep Taylor decomposition, suggesting that the transverse fluid velocity, upper and lower parts of dental implants are the keys that influence bone healing and the distribution of tissue phenotypes the most. Many examples of commercial dental implants with designs which follow these design strategies can be found. This work demonstrates that DLN with proper network design is capable to replace complex, time-dependent, multi-physical models/theories, as well as to reveal the underlying features without prior professional knowledge.


2021 ◽  
Vol 11 (1) ◽  
pp. 339-348
Author(s):  
Piotr Bojarczak ◽  
Piotr Lesiak

Abstract The article uses images from Unmanned Aerial Vehicles (UAVs) for rail diagnostics. The main advantage of such a solution compared to traditional surveys performed with measuring vehicles is the elimination of decreased train traffic. The authors, in the study, limited themselves to the diagnosis of hazardous split defects in rails. An algorithm has been proposed to detect them with an efficiency rate of about 81% for defects not less than 6.9% of the rail head width. It uses the FCN-8 deep-learning network, implemented in the Tensorflow environment, to extract the rail head by image segmentation. Using this type of network for segmentation increases the resistance of the algorithm to changes in the recorded rail image brightness. This is of fundamental importance in the case of variable conditions for image recording by UAVs. The detection of these defects in the rail head is performed using an algorithm in the Python language and the OpenCV library. To locate the defect, it uses the contour of a separate rail head together with a rectangle circumscribed around it. The use of UAVs together with artificial intelligence to detect split defects is an important element of novelty presented in this work.


2021 ◽  
Vol 11 (13) ◽  
pp. 5880
Author(s):  
Paloma Tirado-Martin ◽  
Raul Sanchez-Reillo

Nowadays, Deep Learning tools have been widely applied in biometrics. Electrocardiogram (ECG) biometrics is not the exception. However, the algorithm performances rely heavily on a representative dataset for training. ECGs suffer constant temporal variations, and it is even more relevant to collect databases that can represent these conditions. Nonetheless, the restriction in database publications obstructs further research on this topic. This work was developed with the help of a database that represents potential scenarios in biometric recognition as data was acquired in different days, physical activities and positions. The classification was implemented with a Deep Learning network, BioECG, avoiding complex and time-consuming signal transformations. An exhaustive tuning was completed including variations in enrollment length, improving ECG verification for more complex and realistic biometric conditions. Finally, this work studied one-day and two-days enrollments and their effects. Two-days enrollments resulted in huge general improvements even when verification was accomplished with more unstable signals. EER was improved in 63% when including a change of position, up to almost 99% when visits were in a different day and up to 91% if the user experienced a heartbeat increase after exercise.


Diagnostics ◽  
2021 ◽  
Vol 11 (7) ◽  
pp. 1156
Author(s):  
Kang Hee Lee ◽  
Sang Tae Choi ◽  
Guen Young Lee ◽  
You Jung Ha ◽  
Sang-Il Choi

Axial spondyloarthritis (axSpA) is a chronic inflammatory disease of the sacroiliac joints. In this study, we develop a method for detecting bone marrow edema by magnetic resonance (MR) imaging of the sacroiliac joints and a deep-learning network. A total of 815 MR images of the sacroiliac joints were obtained from 60 patients diagnosed with axSpA and 19 healthy subjects. Gadolinium-enhanced fat-suppressed T1-weighted oblique coronal images were used for deep learning. Active sacroiliitis was defined as bone marrow edema, and the following processes were performed: setting the region of interest (ROI) and normalizing it to a size suitable for input to a deep-learning network, determining bone marrow edema using a convolutional-neural-network-based deep-learning network for individual MR images, and determining sacroiliac arthritis in subject examinations based on the classification results of individual MR images. About 70% of the patients and normal subjects were randomly selected for the training dataset, and the remaining 30% formed the test dataset. This process was repeated five times to calculate the average classification rate of the five-fold sets. The gradient-weighted class activation mapping method was used to validate the classification results. In the performance analysis of the ResNet18-based classification network for individual MR images, use of the ROI showed excellent detection performance of bone marrow edema with 93.55 ± 2.19% accuracy, 92.87 ± 1.27% recall, and 94.69 ± 3.03% precision. The overall performance was additionally improved using a median filter to reflect the context information. Finally, active sacroiliitis was diagnosed in individual subjects with 96.06 ± 2.83% accuracy, 100% recall, and 94.84 ± 3.73% precision. This is a pilot study to diagnose bone marrow edema by deep learning based on MR images, and the results suggest that MR analysis using deep learning can be a useful complementary means for clinicians to diagnose bone marrow edema.


Methods ◽  
2021 ◽  
Author(s):  
Chun-Yen Chen ◽  
Yan-Ting Lin ◽  
Shie-Jue Lee ◽  
Wei-Chung Tsai ◽  
Tien-Chi Huang ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document