The impact of indexing approaches on Arabic text classification

2016 ◽  
Vol 43 (2) ◽  
pp. 159-173 ◽  
Author(s):  
Amer Al-Badarneh ◽  
Emad Al-Shawakfa ◽  
Basel Bani-Ismail ◽  
Khaleel Al-Rababah ◽  
Safwan Shatnawi
Keyword(s):  
Cross Validation ◽  
Arabic Text ◽  
Word Form ◽  
Bayes Classifier ◽  
Stem Form ◽  
Average Accuracy ◽  
Arabic Text Classification ◽  
The Impact ◽  
And Storage ◽  
Fold Cross Validation

This paper investigates the impact of using different indexing approaches (full-word, stem, and root) when classifying Arabic text. In this study, the naïve Bayes classifier is used to construct the multinomial classification models and is evaluated using stratified k-fold cross-validation ( k ranges from 2 to 10). It is also uses a corpus that consists of 1000 normalized Arabic documents. The results of one experiment in this study show that significant accuracy improvements have occurred when the full-word form is used in most k-folds. Further experiments show that the classifier has achieved the highest accuracy in the eight-fold by using 7/8–1/8 train–test ratio, despite the indexing approach being used. The overall results of this study show that the classifier has achieved the maximum micro-average accuracy 99.36%, either by using the full-word form or the stem form. This proves that the stem is a better choice to use when classifying Arabic text, because it makes the corpus dataset smaller and this will enhance both the processing time and storage utilization, and achieve the highest level of accuracy.

An Experimental Study for the Effect of Stop Words Elimination for Arabic Text Classification Algorithms

2011 ◽  
Vol 6 (2) ◽  
pp. 68-75 ◽  
Author(s):  
Bassam Al-Shargabi ◽  
Fekry Olayah ◽  
Waseem AL Romimah
Keyword(s):  
Experimental Study ◽  
Text Classification ◽  
Cross Validation ◽  
Support Vector ◽  
Classification Algorithms ◽  
Arabic Text ◽  
Sequential Minimal Optimization ◽  
Split Method ◽  
Arabic Text Classification ◽  
Fold Cross Validation

In this paper, an experimental study was conducted on three techniques for Arabic text classification. These techniques are Support Vector Machine (SVM) with Sequential Minimal Optimization (SMO), Naïve Bayesian (NB), and J48. The paper assesses the accuracy for each classifier and determines which classifier is more accurate for Arabic text classification based on stop words elimination. The accuracy for each classifier is measured by Percentage split method (holdout), and K-fold cross validation methods, along with the time needed to classify Arabic text. The results show that the SMO classifier achieves the highest accuracy and the lowest error rate, and shows that the time needed to build the SMO model is much lower compared to other classification techniques.

Klasifikasi Berita Kriminal Menggunakan Naïve Bayes Classifier (NBC) dengan Pengujian K-Fold Cross Validation

2019 ◽  
Vol 5 (2) ◽  
pp. 108-117
Author(s):  
Herfia Rhomadhona ◽  
Jaka Permadi
Keyword(s):  
Cross Validation ◽  
Online Media ◽  
Bayes Classifier ◽  
Ve Bayes ◽  
Fold Cross Validation

Berita kriminalitas merupakan berita yang selalu menjadi trending topik di setiap media massa, khususnya media massa online. Media massa online terlah menyediakan beberapa fasilitas untuk mempermudah masyarakan dalam mencari sebuah berita berdasarkan topik. Media massa online melabeli suatu berita berdasarkan kategorinya. Namun, media massa online tidak memberikan sub kategori pada berita tersebut. Sebagai contoh jika seorang pengguna membuka kategori kriminal, maka yang ditampilkan adalah semua jenis berita kriminal tanpa memberikan informasi yang spesifik dari jenis kriminalitasnya. Permasalahan tersebut dapat diatasi dengan mengklasifikasikan berita kriminalitas berdasarkan subkategori. Penelitian ini menggunakan metode Naïve Bayes Classifier (NBC)  untuk mengklasifikasi berita berdasarkan sub kategorinya. Adapun subkategori terbagi kedalam 5 kategori yaitu korupsi, narkoba, pencurian, pemerkosaan dan pembunuhan. Penelitian ini bertujuan untuk mengetahui kemampuan NBC dalam mengklasifikasi berita dengan melakukan pengujian menggunakan teknik K-Fold Cross Validation dengan nilai K dari 3 sampai 10. Hasil pengujian menyatakan bahwa NBC memiliki kemampuan dalam klasifikasi berita kriminal dengan nilai precision sebesar 98,53 %, nilai recall sebesar 98,44 % dan nilai accuracy sebesar 99,38 %.

scholarly journals Environmental Sensitivity and Awareness as Differentiating Factors in the Purchase Decision-Making Process in the Smartphone Industry—Case of Polish Consumers

2021 ◽  
Vol 13 (1) ◽  
pp. 348
Author(s):  
Lukasz Skowron ◽  
Monika Sak-Skowron
Keyword(s):  
Expectation Maximization ◽  
Cross Validation ◽  
Expectation Maximization Algorithm ◽  
Decision Making Process ◽  
Environmental Sensitivity ◽  
Significance Level ◽  
On Line ◽  
Purchase Process ◽  
The Impact ◽  
Fold Cross Validation

The first of the research objectives discussed in this article was to analyze the differences related to the valuation of particular factors influencing the purchase process in the smartphone industry, expressed by respondents with different sensitivity and environmental awareness, as well as the assessment of their knowledge about the impact of smartphones on the natural environment. The second objective of the research was to determine whether the level of environmental sensitivity, awareness and knowledge about the impact of smartphones on the environment has a statistically significant influence on the respondents’ choice of smartphone brand. The survey was conducted using an on-line questionnaire, distributed by a specialized research agency on a representative sample of over 1000 Polish residents. In order to identify the various customers clusters, the expectation-maximization algorithm and the v-fold cross-validation were used. Additionally, in order to analyze the significance level of differences between clusters the nonparametric Mann-Whitney U-test was carried out. The results show unequivocally that people with a different approach to ecological issues demonstrate statistically significant differences in their purchasing behaviors in the smartphone industry. Furthermore, it was noticed that in the case of comparing some smartphones brands, there is a statistically confirmed difference in the environmental sensitivity and awareness of the customers who use them. Moreover, the research has shown that in Polish customers’ consciousness smartphones are mistakenly considered to be relatively safe and environmentally friendly products.

A Novel Method for Gender and Age Detection Based on EEG Brain Signals

2021 ◽  
Vol 18 (5) ◽  
Author(s):  
Haitham Issa ◽  
Sali Issa ◽  
Wahab Shah
Keyword(s):  
Cross Validation ◽  
Image Feature ◽  
Emotional States ◽  
Time Frequency ◽  
Brain Signals ◽  
Average Accuracy ◽  
Gender And Age ◽  
Novel Method ◽  
Fold Cross Validation ◽  
Validation Strategy

This paper presents a new gender and age classification system based on Electroencephalography (EEG) brain signals. First, Continuous Wavelet Transform (CWT) technique is used to get the time-frequency information of only one EEG electrode for eight distinct emotional states instead of the ordinary neutral or relax states. Then, sequential steps are implemented to extract the improved grayscale image feature. For system evaluation, a three-fold-cross validation strategy is applied to construct four different classifiers. The experimental test shows that the proposed extracted feature with Convolutional Neural Network (CNN) classifier improves the performance of both gender and age classification, and achieves an average accuracy of 96.3% and 89% for gender and age classification, respectively. Moreover, the ability to predict human gender and age during the mood of different emotional states is practically approved.

scholarly journals Soil Mapping Based on the Integration of the Similarity-Based Approach and Random Forests

Land ◽  
2020 ◽  
Vol 9 (6) ◽  
pp. 174
Author(s):  
Desheng Wang ◽  
A-Xing Zhu
Keyword(s):  
Random Forests ◽  
Cross Validation ◽  
Soil Mapping ◽  
High Quality ◽  
Integrated Method ◽  
Average Accuracy ◽  
Soil Information ◽  
Fold Cross Validation

Digital soil mapping (DSM) is currently the primary framework for predicting the spatial variation of soil information (soil type or soil properties). Random forests and similarity-based methods have been used widely in DSM. However, the accuracy of the similarity-based approach is limited, and the performance of random forests is affected by the quality of the feature set. The objective of this study was to present a method for soil mapping by integrating the similarity-based approach and the random forests method. The Heshan area (Heilongjiang province, China) was selected as the case study for mapping soil subgroups. The results of the regular validation samples showed that the overall accuracy of the integrated method (71.79%) is higher than that of a similarity-based approach (58.97%) and random forests (66.67%). The results of the 5-fold cross-validation showed that the overall accuracy of the integrated method, similarity-based approach, and random forests range from 55% to 72.73%, 43.48% to 69.57%, and 54.17% to 70.83%, with an average accuracy of 66.61%, 57.39%, and 59.62%, respectively. These results suggest that the proposed method can produce a high-quality covariate set and achieve a better performance than either the random forests or similarity-based approach alone.

scholarly journals Klasifikasi Dokumen Karya Akhir Mahasiswa Menggunakan Naïve Bayes Classifier (NBC) Berdasarkan Abstrak Karya Akhir Di Jurusan Teknik Elektro Universitas Negeri Jakarta

2017 ◽  
Vol 1 (1) ◽  
pp. 31-38
Author(s):  
Nur Indah Pratiwi ◽  
Widodo .
Keyword(s):  
Test Data ◽  
Cross Validation ◽  
Bayes Classifier ◽  
Ve Bayes ◽  
Fold Cross Validation

Dokumen karya akhir di Jurusan Teknik Elektro Universitas Negeri Jakarta setiap tahunnya bertambah, pengklasifikasian dokumen menjadi hal yang sangat penting untuk mengorganisasikan dokumen sehingga dapat memudahkan pencarian. Pengembangan Sistem klasifikasi dokumen bertujuan untuk mengembangkan sebuah sistem yang dapat mengklasifikasikan dokumen karya akhir mahasiswa berdasarkan abstrak karya akhir menggunakan algoritma Naïve Bayes Classifier (NBC). Sehingga, dapat memudahkan pengklasifikasian dokumen karya akhir  di Jurusan Teknik Elektro. Dalam penelitian ini menggunakan metode eksperimen dan menggunakan 100 dokumen abstrak, 90 dokumen sebagai data train dan 10 dokumen sebagai data test. Data diambil dari skripsi mahasiswa Jurusan Teknik Elektro Universitas Negeri Jakarta dari 14 Maret 2014 sampai dengan 27 Maret 2014. Setelah melakukan proses pengembangan perangkat lunak, dihasilkan sebuah sistem klasifikasi yang bernama Sistem Klasifikasi Dokumen Skripsi. Sistem di implementasi menggunakan PHP dan MySQL, dan diuji menggunakan K-Fold Cross Validation (10 Fold). Berdasarkan pada hasil uji Sistem didapatkan hasil tingkat akurasi sebesar 81%. Oleh karena itu, dapat disimpulkan bahwa Sistem Klasifikasi Dokumen Abstrak Karya Akhir Menggunakan Algoritma Naïve Bayes di Jurusan Teknik Elektro telah berhasil dikembangkan.

scholarly journals CGENet: A Deep Graph Model for COVID-19 Detection Based on Chest CT

Biology ◽  
2021 ◽  
Vol 11 (1) ◽  
pp. 33
Author(s):  
Si-Yuan Lu ◽  
Zheng Zhang ◽  
Yu-Dong Zhang ◽  
Shui-Hua Wang
Keyword(s):  
Extreme Learning Machine ◽  
Cross Validation ◽  
Graph Model ◽  
Chest Ct ◽  
Selection Algorithm ◽  
Efficient Tool ◽  
K Nearest Neighbors ◽  
Average Accuracy ◽  
Learning Machine ◽  
Fold Cross Validation

Accurate and timely diagnosis of COVID-19 is indispensable to control its spread. This study proposes a novel explainable COVID-19 diagnosis system called CGENet based on graph embedding and an extreme learning machine for chest CT images. We put forward an optimal backbone selection algorithm to select the best backbone for the CGENet based on transfer learning. Then, we introduced graph theory into the ResNet-18 based on the k-nearest neighbors. Finally, an extreme learning machine was trained as the classifier of the CGENet. The proposed CGENet was evaluated on a large publicly-available COVID-19 dataset and produced an average accuracy of 97.78% based on 5-fold cross-validation. In addition, we utilized the Grad-CAM maps to present a visual explanation of the CGENet based on COVID-19 samples. In all, the proposed CGENet can be an effective and efficient tool to assist COVID-19 diagnosis.

scholarly journals Convolutional Neural Networks for automatic image quality control and EARL compliance of PET images

2021 ◽  
Author(s):  
Elisabeth Pfaehler ◽  
Daniela Euba ◽  
Andreas Rinscheid ◽  
Otto S. Hoekstra ◽  
Josee Zijlstra ◽  
...  
Keyword(s):  
Machine Learning ◽  
Cross Validation ◽  
Training Data ◽  
Independent Dataset ◽  
Pet Ct ◽  
Image Quality Control ◽  
The Cross ◽  
The Impact ◽  
Pet Scanners ◽  
Fold Cross Validation

Abstract Background Machine learning studies require a large number of images often obtained on different PET scanners. When merging these images, the use of harmonized images following EARL-standards is essential. However, when including retrospective images, EARL accreditation might not have been in place. The aim of this study was to develop a convolutional neural network (CNN) that can identify retrospectively if an image is EARL compliant and if it is meeting older or newer EARL-standards. Materials and Methods 96 PET images acquired on three PET/CT systems were included in the study. All images were reconstructed with the locally clinically preferred, EARL1, and EARL2 compliant reconstruction protocols. After image pre-processing, one CNN was trained to separate clinical and EARL compliant reconstructions. A second CNN was optimized to identify EARL1 and EARL2 compliant images. The accuracy of both CNNs was assessed using 5-fold cross validation. The CNNs were validated on 24 images acquired on a PET scanner not included in the training data. To assess the impact of image noise on the CNN decision, the 24 images were reconstructed with different scan durations. Results In the cross-validation, the first CNN classified all images correctly. When identifying EARL1 and EARL2 compliant images, the second CNN identified 100% EARL1 compliant and 85% EARL2 compliant images correctly. The accuracy in the independent dataset was comparable to the cross-validation accuracy. The scan duration had almost no impact on the results. Conclusion The two CNNs trained in this study can be used to retrospectively include images in a multi-center setting by e.g. adding additional smoothing. This method is especially important for machine learning studies where the harmonization of images from different PET systems is essential.

scholarly journals Hierarchy-Based File Fragment Classification

2020 ◽  
Vol 2 (3) ◽  
pp. 216-232
Author(s):  
Manish Bhatt ◽  
Avdesh Mishra ◽  
Md Wasi Ul Kabir ◽  
S. E. Blake-Gatto ◽  
Rishav Rajendra ◽  
...  
Keyword(s):  
Cross Validation ◽  
Hierarchical Classification ◽  
Future Research ◽  
Support Vector ◽  
Challenging Problem ◽  
Fine Grain ◽  
Average Accuracy ◽  
Vector Machines ◽  
Essential Problem ◽  
Fold Cross Validation

File fragment classification is an essential problem in digital forensics. Although several attempts had been made to solve this challenging problem, a general solution has not been found. In this work, we propose a hierarchical machine-learning-based approach with optimized support vector machines (SVM) as the base classifiers for file fragment classification. This approach consists of more general classifiers at the top level and more specialized fine-grain classifiers at the lower levels of the hierarchy. We also propose a primitive taxonomy for file types that can be used to perform hierarchical classification. We evaluate our model with a dataset of 14 file types, with 1000 fragments measuring 512 bytes from each file type derived from a subset of the publicly available Digital Corpora, the govdocs1 corpus. Our experiment shows comparable results to the present literature, with an average accuracy of 67.78% and an F1-measure of 65% using 10-fold cross-validation. We then improve on the hierarchy and find better results, with an increase in the F1-measure of 1%. Finally, we make our assessment and observations, then conclude the paper by discussing the scope of future research.

Sign in / Sign up

Export Citation Format

Share Document