scholarly journals Optimasi Hyperparameter TensorFlow dengan Menggunakan Optuna di Python: Study Kasus Klasifikasi Dokumen Abstrak Skripsi

2021 ◽  
Vol 5 (3) ◽  
pp. 1084
Author(s):  
Siti Mujilahwati ◽  
Miftahus Sholihin ◽  
Retno Wardhani
Keyword(s):  
Machine Learning ◽  
Data Processing ◽  
Programming Languages ◽  
Test Data ◽  
Training Data ◽  
Batch Size ◽  
Digital Era ◽  
Abstract Data ◽  
Abstract Content

In today's rapidly growing digital era, the role of computing in artificial intelligence is needed to be able to help business people. Both in the fields of economy, health, and education. The use of machine learning will help related parties in viewing, analyzing, and making decisions. With machine learning, all problems related to data can be solved quickly and precisely. The problem is that the thesis document will increase every year, it will become a useless document if the data processing is not carried out. Past thesis data can be used for analysis and decision-making in the next thesis era. Python is one of the most popular programming languages used for machine learning. One reason is that there are many python-based libraries. Keras is a python-based machine learning library. TensorFlow can be used when dealing with large amounts of data processing, including thesis abstract data. Thus, this study classified 140 thesis abstract documents using hard-TensorFlow with the aim that based on the abstract content it would be classified into 6 classes, namely Android Applications, Data Mining, RPL, SPK, Digital Image Processing, and Expert Systems. The results of the classification with training data as many as 82 documents with model setting batch size = 12 and epoch = 2 with an Accuracy value of 89.04%. While the test loss test data has a higher value than the Accuracy value obtained by 66.66%. By utilizing maximizing TensorFlow performance by adding a parameter that Scikit Learn has, namely Optuna. The test data was optimized with a trial value of 500, the Accuracy increased to 76.19%

Improved Training for Machine Learning: The Additional Potential of Innovative Algorithmic Approaches.

2021 ◽  
Author(s):  
Octavian Dumitru ◽  
Gottfried Schwarz ◽  
Mihai Datcu ◽  
Dongyang Ao ◽  
Zhongling Huang ◽  
...  
Keyword(s):  
Machine Learning ◽  
Remote Sensing ◽  
Test Data ◽  
Satellite Images ◽  
Training Data ◽  
Data Selection ◽  
Generative Adversarial Networks ◽  
Radar Images ◽  
Basic Work ◽  
Selection Of

<p>During the last years, much progress has been reached with machine learning algorithms. Among the typical application fields of machine learning are many technical and commercial applications as well as Earth science analyses, where most often indirect and distorted detector data have to be converted to well-calibrated scientific data that are a prerequisite for a correct understanding of the desired physical quantities and their relationships.</p><p>However, the provision of sufficient calibrated data is not enough for the testing, training, and routine processing of most machine learning applications. In principle, one also needs a clear strategy for the selection of necessary and useful training data and an easily understandable quality control of the finally desired parameters.</p><p>At a first glance, one could guess that this problem could be solved by a careful selection of representative test data covering many typical cases as well as some counterexamples. Then these test data can be used for the training of the internal parameters of a machine learning application. At a second glance, however, many researchers found out that a simple stacking up of plain examples is not the best choice for many scientific applications.</p><p>To get improved machine learning results, we concentrated on the analysis of satellite images depicting the Earth’s surface under various conditions such as the selected instrument type, spectral bands, and spatial resolution. In our case, such data are routinely provided by the freely accessible European Sentinel satellite products (e.g., Sentinel-1, and Sentinel-2). Our basic work then included investigations of how some additional processing steps – to be linked with the selected training data – can provide better machine learning results.</p><p>To this end, we analysed and compared three different approaches to find out machine learning strategies for the joint selection and processing of training data for our Earth observation images:</p><ul><li>One can optimize the training data selection by adapting the data selection to the specific instrument, target, and application characteristics [1].</li> <li>As an alternative, one can dynamically generate new training parameters by Generative Adversarial Networks. This is comparable to the role of a sparring partner in boxing [2].</li> <li>One can also use a hybrid semi-supervised approach for Synthetic Aperture Radar images with limited labelled data. The method is split in: polarimetric scattering classification, topic modelling for scattering labels, unsupervised constraint learning, and supervised label prediction with constraints [3].</li> </ul><p>We applied these strategies in the ExtremeEarth sea-ice monitoring project (http://earthanalytics.eu/). As a result, we can demonstrate for which application cases these three strategies will provide a promising alternative to a simple conventional selection of available training data.</p><p>[1] C.O. Dumitru et. al, “Understanding Satellite Images: A Data Mining Module for Sentinel Images”, Big Earth Data, 2020, 4(4), pp. 367-408.</p><p>[2] D. Ao et. al., “Dialectical GAN for SAR Image Translation: From Sentinel-1 to TerraSAR-X”, Remote Sensing, 2018, 10(10), pp. 1-23.</p><p>[3] Z. Huang, et. al., "HDEC-TFA: An Unsupervised Learning Approach for Discovering Physical Scattering Properties of Single-Polarized SAR Images", IEEE Transactions on Geoscience and Remote Sensing, 2020, pp.1-18.</p>

Synthetic Sonic Log Generation With Machine Learning: A Contest Summary From Five Methods

2021 ◽  
Vol 62 (4) ◽  
pp. 393-406
Author(s):  
Yanxiang Yu ◽  
◽  
Chicheng Xu ◽  
Siddharth Misra ◽  
Weichang Li ◽  
...  
Keyword(s):  
Machine Learning ◽  
Test Data ◽  
Short Term Memory ◽  
Rock Physics ◽  
Training Data ◽  
Machine Learning Techniques ◽  
Blind Test ◽  
Data Set ◽  
Benchmark Model ◽  
Sonic Log

Compressional and shear sonic traveltime logs (DTC and DTS, respectively) are crucial for subsurface characterization and seismic-well tie. However, these two logs are often missing or incomplete in many oil and gas wells. Therefore, many petrophysical and geophysical workflows include sonic log synthetization or pseudo-log generation based on multivariate regression or rock physics relations. Started on March 1, 2020, and concluded on May 7, 2020, the SPWLA PDDA SIG hosted a contest aiming to predict the DTC and DTS logs from seven “easy-to-acquire” conventional logs using machine-learning methods (GitHub, 2020). In the contest, a total number of 20,525 data points with half-foot resolution from three wells was collected to train regression models using machine-learning techniques. Each data point had seven features, consisting of the conventional “easy-to-acquire” logs: caliper, neutron porosity, gamma ray (GR), deep resistivity, medium resistivity, photoelectric factor, and bulk density, respectively, as well as two sonic logs (DTC and DTS) as the target. The separate data set of 11,089 samples from a fourth well was then used as the blind test data set. The prediction performance of the model was evaluated using root mean square error (RMSE) as the metric, shown in the equation below: RMSE=sqrt(1/2*1/m* [∑_(i=1)^m▒〖(〖DTC〗_pred^i-〖DTC〗_true^i)〗^2 + 〖(〖DTS〗_pred^i-〖DTS〗_true^i)〗^2 ] In the benchmark model, (Yu et al., 2020), we used a Random Forest regressor and conducted minimal preprocessing to the training data set; an RMSE score of 17.93 was achieved on the test data set. The top five models from the contest, on average, beat the performance of our benchmark model by 27% in the RMSE score. In the paper, we will review these five solutions, including preprocess techniques and different machine-learning models, including neural network, long short-term memory (LSTM), and ensemble trees. We found that data cleaning and clustering were critical for improving the performance in all models.

scholarly journals Facial Expression Recognition using Residual Convnet with Image Augmentations

2021 ◽  
Vol 14 (2) ◽  
pp. 127-135
Author(s):  
Fadhil Yusuf Rahadika ◽  
Novanto Yudistira ◽  
Yuita Arum Sari
Keyword(s):  
Neural Networks ◽  
Facial Expression ◽  
Test Data ◽  
Facial Expression Recognition ◽  
Optimization Method ◽  
Training Data ◽  
Batch Size ◽  
Online Video ◽  
Expression Recognition ◽  
Validation Data

During the COVID-19 pandemic, many offline activities are turned into online activities via video meetings to prevent the spread of the COVID 19 virus. In the online video meeting, some micro-interactions are missing when compared to direct social interactions. The use of machines to assist facial expression recognition in online video meetings is expected to increase understanding of the interactions among users. Many studies have shown that CNN-based neural networks are quite effective and accurate in image classification. In this study, some open facial expression datasets were used to train CNN-based neural networks with a total number of training data of 342,497 images. This study gets the best results using ResNet-50 architecture with Mish activation function and Accuracy Booster Plus block. This architecture is trained using the Ranger and Gradient Centralization optimization method for 60000 steps with a batch size of 256. The best results from the training result in accuracy of AffectNet validation data of 0.5972, FERPlus validation data of 0.8636, FERPlus test data of 0.8488, and RAF-DB test data of 0.8879. From this study, the proposed method outperformed plain ResNet in all test scenarios without transfer learning, and there is a potential for better performance with the pre-training model. The code is available at https://github.com/yusufrahadika-facial-expressions-essay.

scholarly journals Machine Learning Based Risk Prediction for Major Adverse Cardiovascular Events

2021 ◽  
Author(s):  
Michael Schrempf ◽  
Diether Kramer ◽  
Stefanie Jauk ◽  
Sai P. K. Veeranki ◽  
Werner Leodolter ◽  
...  
Keyword(s):  
Machine Learning ◽  
Risk Prediction ◽  
Test Data ◽  
Cardiovascular Events ◽  
Prediction Models ◽  
Early Stage ◽  
Training Data ◽  
Major Adverse Cardiovascular Events ◽  
Future Research ◽  
Patients At Risk

Background: Patients with major adverse cardiovascular events (MACE) such as myocardial infarction or stroke suffer from frequent hospitalizations and have high mortality rates. By identifying patients at risk at an early stage, MACE can be prevented with the right interventions. Objectives: The aim of this study was to develop machine learning-based models for the 5-year risk prediction of MACE. Methods: The data used for modelling included electronic medical records of more than 128,000 patients including 29,262 patients with MACE. A feature selection based on filter and embedded methods resulted in 826 features for modelling. Different machine learning methods were used for modelling on the training data. Results: A random forest model achieved the best calibration and discriminative performance on a separate test data set with an AUROC of 0.88. Conclusion: The developed risk prediction models achieved an excellent performance in the test data. Future research is needed to determine the performance of these models and their clinical benefit in prospective settings.

scholarly journals Optimal Length of R-R Interval Segment Window for Lorenz Plot Detection of Paroxysmal Atrial Fibrillation by Machine Learning

2020 ◽  
Author(s):  
Masaya Kisohara ◽  
Yuto Masuda ◽  
Emi Yuda ◽  
Norihiro Ueda ◽  
Junichiro Hayano
Keyword(s):  
Machine Learning ◽  
Atrial Fibrillation ◽  
Likelihood Ratio ◽  
Test Data ◽  
Cross Validation ◽  
Positive Likelihood Ratio ◽  
Training Data ◽  
Segment Length ◽  
Optimal Length ◽  
X 32

Abstract Background Machine learning of R-R interval Lorenz plot (LP) images is a promising method for the detection of atrial fibrillation (AF) in long-term ECG monitoring, but the optimal length of R-R interval segment window for the LP images is unknown. We examined the performance of LP AF detection by differing the segment length using convolutional neural network (CNN). LP images with a 32 x 32-pixel resolution of non-overlapping R-R interval segments with lengths of 10, 20, 50, 100, 200, and 500 beats were created from 24-h ECG data in 52 patients with chronic AF and 58 non-AF controls as training data and in 53 patients with paroxysmal AF and 52 non-AF controls as test data. For each segment length, classification models were made by 5-fold cross-validation subsets of the training data and its classification performance was examined with the test data. Results In machine learning with the training data, the averages of cross-validation scores were 0.995 and 0.999 for 10 and 20-beat LP images, respectively, and >0.999 for 50 to 500-beat images. The classification of test data showed good performance for all segment lengths with an accuracy from 0.970 to 0.988. Positive likelihood ratio for detecting AF segments, however, showed a convex parabolic curve linear relationship to log segment length with a peak ratio of 111 at 100 beats, while negative likelihood ratio showed monotonous increase with increasing segment length. Conclusions This study suggests that the optimal R-R interval segment window length that maximizes the positive likelihood ratio for detecting paroxysmal AF with 32 x 32-pixel LP image is about 100 beats.

Use of machine learning to identify relevant research publications in clinical oncology.

2019 ◽  
Vol 37 (15_suppl) ◽  
pp. 6558-6558
Author(s):  
Fernando Jose Suarez Saiz ◽  
Corey Sanders ◽  
Rick J Stevens ◽  
Robert Nielsen ◽  
Michael W Britt ◽  
...  
Keyword(s):  
Machine Learning ◽  
Expert Knowledge ◽  
Grey Literature ◽  
Clinical Decision ◽  
Training Data ◽  
Surgical Approaches ◽  
High Quality ◽  
Test Set ◽  
N Gram ◽  
Abstract Content

6558 Background: Finding high-quality science to support decisions for individual patients is challenging. Common approaches to assess clinical literature quality and relevance rely on bibliometrics or expert knowledge. We describe a method to automatically identify clinically relevant, high-quality scientific citations using abstract content. Methods: We used machine learning trained on text from PubMed papers cited in 3 expert resources: NCCN, NCI-PDQ, and Hemonc.org. Balanced training data included text cited in at least two sources to form an “on topic” set (i.e., relevant and high quality), and an “off-topic” set, not cited in any of the above 3 sources. The off-topic set was published in lower ranked journals, using a citation-based score. Articles were part of an Oncology Clinical Trial corpus generated using a standard PubMed query. We used a gradient boosted-tree approach with a binary logistic supervised learning classification. Briefly, 988 texts were processed to produce a term frequency-inverse document frequency (tf-idf) n-gram representation of both the training and the test set (70/30 split). Ideal parameters were determined using 1000-fold cross validation. Results: Our model classified papers in the test set with 0.93 accuracy (95% CI (0.09:0.96) p ≤ 0.0001), with sensitivity 0.95 and specificity 0.91. Some false positives contained language considered clinically relevant that may have been missed or not yet included in expert resources. False negatives revealed a potential bias towards chemotherapy-focused research over radiation therapy or surgical approaches. Conclusions: Machine learning can be used to automatically identify relevant clinical publications from biographic databases, without relying on expert curation or bibliometric methods. The use of machine learning to identify relevant publications may reduce the time clinicians spend finding pertinent evidence for a patient. This approach is generalizable to cases where a corpus of high-quality publications that can serve as a training set exists or cases where document metadata is unreliable, as is the case of “grey” literature within oncology and beyond to other diseases. Future work will extend this approach and may integrate it into oncology clinical decision-support tools.

Model-Driven Prototyping Support for Pervasive Healthcare Applications

2010 ◽  
pp. 251-281
Author(s):  
Werner Kurschl ◽  
Stefan Mitsch ◽  
Johannes Schoenboeck
Keyword(s):  
Machine Learning ◽  
Programming Languages ◽  
Learning Algorithms ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Application Development ◽  
Healthcare Applications ◽  
Development Environment ◽  
Pervasive Healthcare ◽  
Model Driven

Pervasive healthcare applications aim at improving habitability by assisting individuals in living autonomously. To achieve this goal, data on an individual’s behavior and his or her environment (often collected with wireless sensors) is interpreted by machine learning algorithms; their decision finally leads to the initiation of appropriate actions, e.g., turning on the light. Developers of pervasive healthcare applications therefore face complexity stemming, amongst others, from different types of environmental and vital parameters, heterogeneous sensor platforms, unreliable network connections, as well as from different programming languages. Moreover, developing such applications often includes extensive prototyping work to collect large amounts of training data to optimize the machine learning algorithms. In this chapter the authors present a model-driven prototyping approach for the development of pervasive healthcare applications to leverage the complexity incurred in developing prototypes and applications. They support the approach with a development environment that simplifies application development with graphical editors, code generators, and pre-defined components.

Machine Learning-Based Predictive Modelling of Dry Electric Discharge Machining Process

2021 ◽  
pp. 151-164
Author(s):  
Kanak Kalita ◽  
Dinesh S. Shinde ◽  
Ranjan Kumar Ghadai
Keyword(s):  
Machine Learning ◽  
Random Forest ◽  
Test Data ◽  
Electric Discharge ◽  
Predictive Models ◽  
Training Data ◽  
Machining Process ◽  
Random Forest Regression ◽  
Electric Discharge Machining ◽  
Independent Test

The conventional methods like linear or polynomial regression, despite their overwhelming accuracy on training data, often fail to achieve the same accuracy on independent test data. In this research, a comparative study of three different machine learning techniques (linear regression, random forest regression, and AdaBoost) is carried out to build predictive models for dry electric discharge machining process. Six different process parameters namely voltage gap, discharge current, pulse-on-time, duty factor, air inlet pressure, and spindle speed are considered to predict the material removal rate. Statistical tests on independent test data show that despite linear regression's considerable accuracy on training data, it fails to achieve the same on independent test data. Random forest regression is seen to have the best performance among the three predictive models.

scholarly journals Use of a Machine Learning Method in Predicting Refraction after Cataract Surgery

2021 ◽  
Vol 10 (5) ◽  
pp. 1103
Author(s):  
Tomofusa Yamauchi ◽  
Hitoshi Tabuchi ◽  
Kosuke Takase ◽  
Hiroki Masumoto
Keyword(s):  
Machine Learning ◽  
Cataract Surgery ◽  
Test Data ◽  
Training Data ◽  
Gradient Boosting ◽  
Support Vector ◽  
Power Calculation ◽  
Iol Power Calculation ◽  
Significant Difference ◽  
Iol Power

The present study aims to describe the use of machine learning (ML) in predicting the occurrence of postoperative refraction after cataract surgery and compares the accuracy of this method to conventional intraocular lens (IOL) power calculation formulas. In total, 3331 eyes from 2010 patients were assessed. The objects were divided into training data and test data. The constants for the IOL power calculation formulas and model training for ML were optimized using training data. Then, the occurrence of postoperative refraction was predicted using conventional formulas, or ML models were calculated using the test data. We evaluated the SRK/T formula, Haigis formula, Holladay 1 formula, Hoffer Q formula, and Barrett Universal II formula (BU-II); similar to ML methods, we assessed support vector regression (SVR), random forest regression (RFR), gradient boosting regression (GBR), and neural network (NN). Among the conventional formulas, BU-II had the lowest mean and median absolute error of prediction. Therefore, we compared the accuracy of our method with that of BU-II. The absolute errors of some ML methods were lower than those of BU-II. However, no statistically significant difference was observed. Thus, the accuracy of our method was not inferior to that of BU-II.

scholarly journals KLASIFIKASI DOKUMEN TUGAS AKHIR (SKRIPSI) MENGGUNAKAN K-NEAREST NEIGHBOR

2019 ◽  
Vol 4 (1) ◽  
pp. 69
Author(s):  
Kitami Akromunnisa ◽  
Rahmat Hidayat
Keyword(s):  
Test Data ◽  
Cross Validation ◽  
Nearest Neighbor ◽  
Data Distribution ◽  
Training Data ◽  
K Nearest Neighbor ◽  
Electronic Documents ◽  
Digital Version ◽  
Abstract Data

Various scientific works from academicians such as theses, research reports, practical work reports and so forth are available in the digital version. However, in general this phenomenon is not accompanied by a growth in the amount of information or knowledge that can be extracted from these electronic documents. This study aims to classify the abstract data of informatics engineering thesis. The algorithm used in this study is K-Nearest Neighbor. Amount of data used 50 abstract data of Indonesian language, 454 data of English abstract and 504 title data. Each data is divided into training data and test data. Test data will be classified automatically with the classifier model that has been made. Based on the research conducted, the classification of the Indonesian essential data resulted in greater accuracy without going through a stemming process that had a 9: 1 ratio of 100.0% compared to an 8: 2 ratio of 90.0%, 7: 3 which was 80.0%, 6: 4 which is 60.0% and the data distribution using Kfold cross validation is 80.0%.

Sign in / Sign up

Export Citation Format

Share Document