Design Space Exploration of Turbulent Multiphase Flows Using Machine Learning-Based Surrogate Model

This study focuses on establishing a surrogate model based on machine learning techniques to predict the time-averaged spatially distributed behaviors of vaporizing liquid jets in turbulent air crossflow for momentum flux ratios between 5 and 120. This surrogate model extends a previously developed Gaussian-process-based framework applicable to laminar flows to accommodate turbulent flows and demonstrates that in addition to detailed fields of primitive variables, second-order turbulence statistics can also be predicted using machine learning techniques. The framework proceeds in 3 steps—(1) design of experiment studies to identify training points and conducting high-fidelity calculations to build the training dataset; (2) Gaussian process regression (supervised training) for the range of operating conditions under consideration for gaseous and dispersed phase quantities; and (3) error quantification of the surrogate model by comparing the machine learning predictions with the truth model for test conditions (i.e., conditions not used for training). The framework was trained using data generated by high-fidelity large eddy simulation (LES)-based calculations (also referred to as the truth model), which solves the complete set of conservation equations for mass, momentum, energy, and species in an Eulerian reference frame, coupled with a Lagrangian solver that tracks the dispersed phase. Simulations were conducted for the range of momentum flux ratios between 5 and 120 for liquid water injected into crossflowing air at a pressure of 1 atm and temperature of 600 K. Results from the machine-learned surrogate model, also called emulations, were compared with the truth model under testing conditions identified by momentum flux ratios of 7 and 40. L1 errors for time-averaged field quantities, including velocity magnitudes, pressure, temperature, vapor fraction of the evaporated liquid, and turbulent kinetic energy in the gas phase, and spray penetration and Sauter mean diameters in the dispersed phase are reported. Speedup of 65 was achieved with this emulator when compared against LES simulation of the same test conditions with errors for all quantities below 14%, thus demonstrating the potential benefits of using machine learning techniques for design space exploration of devices that are based on turbulent multiphase fluid flows. This is the first effort of its kind in the literature that demonstrates the application of machine learning techniques on turbulent multiphase flows.

Download Full-text

Efficient system design space exploration using machine learning techniques

Proceedings of the 45th annual conference on Design automation - DAC '08 ◽

10.1145/1391469.1391712 ◽

2008 ◽

Cited By ~ 24

Author(s):

Berkin Ozisikyilmaz ◽

Gokhan Memik ◽

Alok Choudhary

Keyword(s):

Machine Learning ◽

System Design ◽

Design Space Exploration ◽

Design Space ◽

Space Exploration ◽

Machine Learning Techniques ◽

Efficient System ◽

Learning Techniques

Download Full-text

Using data mining and machine learning techniques for system design space exploration and automatized optimization

2017 International Conference on Applied System Innovation (ICASI) ◽

10.1109/icasi.2017.7988179 ◽

2017 ◽

Cited By ~ 1

Author(s):

Yu-Xuan Wang ◽

QiHui Sun ◽

Ting-Ying Chien ◽

Po-Chun Huang

Keyword(s):

Machine Learning ◽

Data Mining ◽

System Design ◽

Design Space Exploration ◽

Design Space ◽

Space Exploration ◽

Machine Learning Techniques ◽

Learning Techniques ◽

Using Data

Download Full-text

Reaction Wheels Fault Isolation Onboard 3-Axis Controlled Satel-lite using Enhanced Random Forest with Multidomain Features

International Journal of Prognostics and Health Management ◽

10.36001/ijphm.2021.v12i2.3078 ◽

2021 ◽

Vol 12 (2) ◽

Author(s):

Afshin Rahimi ◽

Mofiyinoluwa O. Folami

Keyword(s):

Machine Learning ◽

Fault Isolation ◽

Data Driven ◽

Machine Learning Techniques ◽

Superior Performance ◽

Alternative Methods ◽

Model Parameters ◽

High Fidelity ◽

Novel Approach ◽

Learning Techniques

As the number of satellite launches increases each year, it is only natural that an interest in the safety and monitoring of these systems would increase as well. However, as a system becomes more complex, generating a high-fidelity model that accurately describes the system becomes complicated. Therefore, imploring a data-driven method can provide to be more beneficial for such applications. This research proposes a novel approach for data-driven machine learning techniques on the detection and isolation of nonlinear systems, with a case-study for an in-orbit closed loop-controlled satellite with reaction wheels as actuators. High-fidelity models of the 3-axis controlled satellite are employed to generate data for both nominal and faulty conditions of the reaction wheels. The generated simulation data is used as input for the isolation method, after which the data is pre-processed through feature extraction from a temporal, statistical, and spectral domain. The pre-processed features are then fed into various machine learning classifiers. Isolation results are validated with cross-validation, and model parameters are tuned using hyperparameter optimization. To validate the robustness of the proposed method, it is tested on three characterized datasets and three reaction wheel configurations, including standard four-wheel, three-orthogonal, and pyramid. The results prove superior performance isolation accuracy for the system under study compared to previous studies using alternative methods (Rahimi & Saadat, 2019, 2020).

Download Full-text

An Assessment of Machine Learning Techniques for Predicting Turbine Airfoil Component Temperatures, Using FEA Simulations for Training Data

Volume 5A: Heat Transfer ◽

10.1115/gt2019-91004 ◽

2019 ◽

Author(s):

James A. Tallman ◽

Michal Osusky ◽

Nick Magina ◽

Evan Sewall

Keyword(s):

Neural Network ◽

Machine Learning ◽

Artificial Neural Network ◽

Surrogate Model ◽

Learning Algorithms ◽

Machine Learning Algorithms ◽

Training Data ◽

Machine Learning Techniques ◽

Learning Techniques ◽

Artificial Neural

Abstract This paper provides an assessment of three different machine learning techniques for accurately reproducing a distributed temperature prediction of a high-pressure turbine airfoil. A three-dimensional Finite Element Analysis thermal model of a cooled turbine airfoil was solved repeatedly (200 instances) for various operating point settings of the corresponding gas turbine engine. The response surface created by the repeated solutions was fed into three machine learning algorithms and surrogate model representations of the FEA model’s response were generated. The machine learning algorithms investigated were a Gaussian Process, a Boosted Decision Tree, and an Artificial Neural Network. Additionally, a simple Linear Regression surrogate model was created for comparative purposes. The Artificial Neural Network model proved to be the most successful at reproducing the FEA model over the range of operating points. The mean and standard deviation differences between the FEA and the Neural Network models were 15% and 14% of a desired accuracy threshold, respectively. The Digital Thread for Design (DT4D) was used to expedite all model execution and machine learning training. A description of DT4D is also provided.

Download Full-text

Accelerating phase-field-based microstructure evolution predictions via surrogate models trained by machine learning methods

npj Computational Materials ◽

10.1038/s41524-020-00471-8 ◽

2021 ◽

Vol 7 (1) ◽

Author(s):

David Montes de Oca Zapiain ◽

James A. Stewart ◽

Rémi Dingreville

Keyword(s):

Neural Network ◽

Machine Learning ◽

Microstructure Evolution ◽

Phase Field ◽

Surrogate Model ◽

Multivariate Adaptive Regression Splines ◽

Machine Learning Techniques ◽

Phase Field Method ◽

High Fidelity ◽

Integration Schemes

AbstractThe phase-field method is a powerful and versatile computational approach for modeling the evolution of microstructures and associated properties for a wide variety of physical, chemical, and biological systems. However, existing high-fidelity phase-field models are inherently computationally expensive, requiring high-performance computing resources and sophisticated numerical integration schemes to achieve a useful degree of accuracy. In this paper, we present a computationally inexpensive, accurate, data-driven surrogate model that directly learns the microstructural evolution of targeted systems by combining phase-field and history-dependent machine-learning techniques. We integrate a statistically representative, low-dimensional description of the microstructure, obtained directly from phase-field simulations, with either a time-series multivariate adaptive regression splines autoregressive algorithm or a long short-term memory neural network. The neural-network-trained surrogate model shows the best performance and accurately predicts the nonlinear microstructure evolution of a two-phase mixture during spinodal decomposition in seconds, without the need for “on-the-fly” solutions of the phase-field equations of motion. We also show that the predictions from our machine-learned surrogate model can be fed directly as an input into a classical high-fidelity phase-field model in order to accelerate the high-fidelity phase-field simulations by leaping in time. Such machine-learned phase-field framework opens a promising path forward to use accelerated phase-field simulations for discovering, understanding, and predicting processing–microstructure–performance relationships.

Download Full-text

Quantifying Subsurface Parameter and Transport Uncertainty Using Surrogate Modeling and Environmental Tracers

10.22541/au.163255068.89308766/v1 ◽

2021 ◽

Author(s):

Nicholas Thiros ◽

W. Gardner ◽

Marco Maneta ◽

Douglas Brinkerhoff

Keyword(s):

Machine Learning ◽

Solute Transport ◽

Surrogate Model ◽

Reactive Transport ◽

Transport Model ◽

Machine Learning Techniques ◽

Contaminated Site ◽

High Fidelity ◽

Posterior Distributions ◽

Reactive Transport Model

We combine physics-based groundwater reactive transport modeling with machine learning techniques to quantify hydrogeologic model and solute transport predictive uncertainties. We train an artificial neural network (ANN) on a dataset of groundwater hydraulic heads and H concentrations generated using a high-fidelity groundwater reactive transport model. Using the trained ANN as a surrogate model to reproduce the input-output response of the high-fidelity reactive transport model, we quantify the posterior distributions of hydrogeologic parameters and hydraulic forcing conditions using Markov-chain Monte Carlo (MCMC) calibration against field observations of groundwater hydraulic heads and H concentrations. We demonstrate the methodology with a model application that predicts Chlorofluorocarbon-12 (CFC-12) solute transport at a contaminated site in Wyoming, USA. Our results show that including H observations in the calibration dataset reduced the uncertainty in the estimated permeability field and infiltration rates, compared to calibration against hydraulic heads alone. However, predictive uncertainty quantification shows that CFC-12 transport predictions conditioned to the parameter posterior distributions cannot reproduce the field measurements. We found that calibrating the model to hydraulic head and H observations results in groundwater mean ages that are too large to explain the observed CFC-12 concentrations. The coupling of the physics-based reactive transport model with the machine learning surrogate model allows us to efficiently quantify model parameter and predictive uncertainties, which is typically computationally intractable using reactive transport models alone.

Download Full-text

Using machine learning techniques to reduce data annotation time

PsycEXTRA Dataset ◽

10.1037/e577762012-020 ◽

2006 ◽

Author(s):

Christopher Schreiner ◽

Kari Torkkola ◽

Mike Gardner ◽

Keshu Zhang

Keyword(s):

Machine Learning ◽

Machine Learning Techniques ◽

Data Annotation ◽

Learning Techniques

Download Full-text

Using Machine Learning Algorithms on Prediction of Stock Price

Journal of Modeling and Optimization ◽

10.32732/jmo.2020.12.2.84 ◽

2020 ◽

Vol 12 (2) ◽

pp. 84-99

Author(s):

Li-Pang Chen

Keyword(s):

Machine Learning ◽

Stock Price ◽

Short Term Memory ◽

Machine Learning Algorithms ◽

Machine Learning Techniques ◽

Support Vector ◽

Short Term ◽

Learning Techniques ◽

Historical Database ◽

Long Short Term Memory

In this paper, we investigate analysis and prediction of the time-dependent data. We focus our attention on four different stocks are selected from Yahoo Finance historical database. To build up models and predict the future stock price, we consider three different machine learning techniques including Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN) and Support Vector Regression (SVR). By treating close price, open price, daily low, daily high, adjusted close price, and volume of trades as predictors in machine learning methods, it can be shown that the prediction accuracy is improved.

Download Full-text