scholarly journals Interpretable Recognition for Dementia Using Brain Images

2021 ◽  
Vol 15 ◽  
Author(s):  
Xinjian Song ◽  
Feng Gu ◽  
Xiude Wang ◽  
Songhua Ma ◽  
Li Wang
Keyword(s):  
Recognition Performance ◽  
Fuzzy Rule ◽  
Classification Performance ◽  
Fuzzy Rules ◽  
High Dimensional ◽  
Great Success ◽  
Fuzzy Classifier ◽  
Brain Images ◽  
Fuzzy Classifiers ◽  
Takagi Sugeno

Machine learning-based models are widely used for neuroimage-based dementia recognition and achieve great success. However, most models omit the interpretability that is a very important factor regarding the confidence of a model. Takagi–Sugeno–Kang (TSK) fuzzy classifiers as the high interpretability and promising classification performance have widely used in many scenarios. TSK fuzzy classifier can generate interpretable fuzzy rules showing the reasoning process. However, when facing high-dimensional data, the antecedent become complex which may reduce the interpretability. In this study, to keep the antecedent of fuzzy rule concise, we introduce the subspace clustering technique and use it for antecedent learning. Experimental results show that the used model can generate promising recognition performance as well as concise fuzzy rules.

VISUALIZATION OF FUZZY CLASSIFIERS

2007 ◽  
Vol 15 (05) ◽  
pp. 615-624 ◽  
Author(s):  
FRANK REHM ◽  
FRANK KLAWONN ◽  
RUDOLF KRUSE
Keyword(s):  
Fuzzy Rule ◽  
Weather Data ◽  
High Dimensional ◽  
Data Set ◽  
Feature Vectors ◽  
Benchmark Data ◽  
Entire Data ◽  
Fuzzy Classifiers ◽  
Degree Of Membership ◽  
Rule Bases

This paper presents different techniques to visualize high-dimensional fuzzy rule bases in relation to the classified data. The degree of membership to influential rules can be visualized for an entire data set. This enables the observer to detect conflicting or error-prone rules as well as misclassified feature vectors. Results are shown on a benchmark data set and on a weather data set that is used to predict flight durations on a major European airport.

Rule Extraction from Data

1999 ◽  
Vol 3 (5) ◽  
pp. 339-340
Author(s):  
Takeshi Furuhashi ◽  
Keyword(s):  
Neural Networks ◽  
Fuzzy Rule ◽  
Classification Problem ◽  
Fuzzy Modeling ◽  
Rule Extraction ◽  
Fuzzy Rules ◽  
High Dimensional ◽  
Special Issue ◽  
Rule Sets ◽  
Artificial Neural

Rule extraction from data is one of the key technologies for solving the bottlenecks in artificial intelligence. Artificial neural networks are well suited for representing any knowledge in given data. Extraction of logical/fuzzy rules from the trained artificial neural network is of great importance to researchers in the fields of artificial intelligence and soft computing. Fuzzy rule sets are capable of approximating any nonlinear mapping relationships. Extraction of rules from data has been discussed in terms of fuzzy modeling, fuzzy clustering, and classification with fuzzy rule sets. This special issue entitled"Rule Extraction from Data" is aimed at providing the readers with good insights into the advanced studies in the field of rule extraction from data using neural networks/fuzzy rule sets. I invited seven research papers best suited for the theme of this special issue. All the papers were reviewed rigorously by two reviewers each. The first paper proposes an interesting rule extraction method from data using neural networks. Ishikawa presents a combination of learning with an immediate critic and a structural learning with forgetting. This method is capable of generating skeletal networks for logical rule extraction from data with correct and wrong answers. The proposed method is applied to rule extraction from lense data. The second paper presents a new methodology for logical rule extraction based on transformation of MLP (multilayered perceptron) to a logical network. Duck et al. applied their C-MLP2LN to the Iris benchmark classification problem as well as real-world medical data with very good results. In the third paper, Geczy and Usui propose fuzzy rule extraction from trained artificial neural networks. The proposed algorithm is implied from their theoretical study, not from heuristics. Their study enables to initially consider derivation of crisp rules from trained artificial neural network, and in case of conflict, application of fuzzy rules. The proposed algorithm is experimentally demonstrated with the Iris benchmark classification problem. The fourth paper presents a new framework for fuzzy modeling using genetic algorithm. The authors have broken new ground of fuzzy rule extraction from neural networks. For the fuzzy modeling, they have proposed a particular type of neural networks containing nodes representing membership functions. In this fourth paper, the authors discuss input variable selection for the fuzzy modeling under multiple criteria with different importance. A target system with a strong nonlinearity is used for demonstrating the proposed method. Kasabov, et al. present, in the fifth paper, a method for extraction of fuzzy rules that have different level of abstraction depending on several modifiable thresholds. Explanation quality becomes better with higher threshold values. They apply the proposed method to the Iris benchmark classification problem and to a real world problem. J. Yen and W. Gillespie address interpretability issue of Takagi-Sugeno-Kang model, one of the most popular fuzzy mdoels, in the fifth paper. They propose a new approach of fuzzy modeling that ensures not only a high approximation of the input-output relationship in the data, but also good insights about the local behavior of the model. The proposed method is applied to fuzzy modeling of sinc function and Mackey-Glass chaotic time series data. The last paper discusses fuzzy rule extraction from numerical data for high-dimensional classification problems. H.Ishibuchi, et al. have been pioneering methods for classification of data using fuzzy rules and genetic algorithm. In this last paper, they introduced a new criterion, simplicity of each rule, together with the conventional ones, compactness of rule base and classification ability, for high-dimensional problem. The Iris data is used for demonstrating their new classification method. They applied it also to wine data and credit data. I hope that the readers will be encouraged to explore the frontier to establish a new paradigm in the field of knowledge representation and rule extraction.

Deep Takagi–Sugeno–Kang Fuzzy Classifier With Shared Linguistic Fuzzy Rules

2018 ◽  
Vol 26 (3) ◽  
pp. 1535-1549 ◽  
Author(s):  
Yuanpeng Zhang ◽  
Hisao Ishibuchi ◽  
Shitong Wang
Keyword(s):  
Fuzzy Rules ◽  
Fuzzy Classifier ◽  
Takagi Sugeno ◽  
Linguistic Fuzzy Rules

scholarly journals Construction and Optimization of Fuzzy Rule-Based Classifier with a Swarm Intelligent Algorithm

2020 ◽  
Vol 2020 ◽  
pp. 1-12
Author(s):  
Li Mao ◽  
Qidong Chen ◽  
Jun Sun
Keyword(s):  
Particle Swarm Optimization ◽  
Particle Swarm ◽  
Fuzzy Rule ◽  
Fuzzy Rules ◽  
Fuzzy Classification ◽  
Rule Base ◽  
Classification Problems ◽  
Fuzzy Classifier ◽  
Swarm Optimization ◽  
Rule Based

In this paper, we propose a particle swarm optimization method incorporating quantum qubit operation to construct and optimize fuzzy rule-based classifiers. The proposed algorithm, denoted as QiQPSO, is inspired by the quantum computing principles. It employs quantum rotation gates to update the probability of each qubit with the corresponding quantum angle updating according to the update equation of the quantum-behaved particle swarm optimization (QPSO). After description of the principle of QiQPSO, we show how to apply QiQPSO to establish a fuzzy classifier through two procedures. The QiQPSO algorithm is first used to construct the initial fuzzy classification system based on the sample data and the grid method of partitioning the feature space, and then the fuzzy rule base of the initial fuzzy classifier is optimized further by QiQPSO in order to reduce the number of the fuzzy rules and thus improve its interpretability. In order to verify the effectiveness of the proposed method, QiQPSO is tested on various real-world classification problems. The experimental results show that the QiQPSO is able to effectively select feature variables and fuzzy rules of the fuzzy classifiers with high classification accuracies. The performance comparison with other methods also shows that the fuzzy classifier optimized by QiQPSO has higher interpretability as well as comparable or even better classification accuracies.

Automated Characterization of Atheromatous Plaque in Intravascular Ultrasound Images Using Neuro Fuzzy Classifier

2012 ◽  
Vol 58 (4) ◽  
pp. 425-431 ◽  
Author(s):  
D. Selvathi ◽  
N. Emimal ◽  
Henry Selvaraj
Keyword(s):  
Intravascular Ultrasound ◽  
Human Error ◽  
Human Life ◽  
Classification Performance ◽  
Atheromatous Plaque ◽  
Ultrasound Images ◽  
Fuzzy Classifier ◽  
Neuro Fuzzy ◽  
Calcified Tissues

Abstract The medical imaging field has grown significantly in recent years and demands high accuracy since it deals with human life. The idea is to reduce human error as much as possible by assisting physicians and radiologists with some automatic techniques. The use of artificial intelligent techniques has shown great potential in this field. Hence, in this paper the neuro fuzzy classifier is applied for the automated characterization of atheromatous plaque to identify the fibrotic, lipidic and calcified tissues in Intravascular Ultrasound images (IVUS) which is designed using sixteen inputs, corresponds to sixteen pixels of instantaneous scanning matrix, one output that tells whether the pixel under consideration is Fibrotic, Lipidic, Calcified or Normal pixel. The classification performance was evaluated in terms of sensitivity, specificity and accuracy and the results confirmed that the proposed system has potential in detecting the respective plaque with the average accuracy of 98.9%.

A Study on the Auxiliary Diagnosis of Thyroid Disease Images Based on Multiple Dimensional Deep Learning Algorithms

2020 ◽  
Vol 16 (3) ◽  
pp. 199-205
Author(s):  
Yuejun Liu ◽  
Yifei Xu ◽  
Xiangzheng Meng ◽  
Xuguang Wang ◽  
Tianxu Bai
Keyword(s):  
Deep Learning ◽  
Learning Algorithms ◽  
Region Of Interest ◽  
Classification Performance ◽  
Thyroid Diseases ◽  
Great Success ◽  
Learning Models ◽  
Good Classification Performance ◽  
Spect Images

Background: Medical imaging plays an important role in the diagnosis of thyroid diseases. In the field of machine learning, multiple dimensional deep learning algorithms are widely used in image classification and recognition, and have achieved great success. Objective: The method based on multiple dimensional deep learning is employed for the auxiliary diagnosis of thyroid diseases based on SPECT images. The performances of different deep learning models are evaluated and compared. Methods: Thyroid SPECT images are collected with three types, they are hyperthyroidism, normal and hypothyroidism. In the pre-processing, the region of interest of thyroid is segmented and the amount of data sample is expanded. Four CNN models, including CNN, Inception, VGG16 and RNN, are used to evaluate deep learning methods. Results: Deep learning based methods have good classification performance, the accuracy is 92.9%-96.2%, AUC is 97.8%-99.6%. VGG16 model has the best performance, the accuracy is 96.2% and AUC is 99.6%. Especially, the VGG16 model with a changing learning rate works best. Conclusion: The standard CNN, Inception, VGG16, and RNN four deep learning models are efficient for the classification of thyroid diseases with SPECT images. The accuracy of the assisted diagnostic method based on deep learning is higher than that of other methods reported in the literature.

A Review of Multi-Objective Evolutionary Based Fuzzy Classifiers

2020 ◽  
Vol 13 (1) ◽  
pp. 77-85
Author(s):  
Praveen Kumar Dwivedi ◽  
Surya Prakash Tripathi
Keyword(s):  
Fuzzy Systems ◽  
Evolutionary Process ◽  
Fuzzy Rule ◽  
Fuzzy Classification ◽  
Multi Objective Optimization ◽  
Fuzzy Classifier ◽  
Rule Based ◽  
Trade Off ◽  
Multi Objective ◽  
Rule Based Systems

Background: Fuzzy systems are employed in several fields like data processing, regression, pattern recognition, classification and management as a result of their characteristic of handling uncertainty and explaining the feature of the advanced system while not involving a particular mathematical model. Fuzzy rule-based systems (FRBS) or fuzzy rule-based classifiers (mainly designed for classification purpose) are primarily the fuzzy systems that consist of a group of fuzzy logical rules and these FRBS are unit annexes of ancient rule-based systems, containing the "If-then" rules. During the design of any fuzzy systems, there are two main objectives, interpretability and accuracy, which are conflicting with each another, i.e., improvement in any of those two options causes the decrement in another. This condition is termed as Interpretability –Accuracy Trade-off. To handle this condition, Multi-Objective Evolutionary Algorithms (MOEA) are often applied within the design of fuzzy systems. This paper reviews the approaches to the problem of developing fuzzy systems victimization evolutionary process Multi-Objective Optimization (EMO) algorithms considering ‘Interpretability-Accuracy Trade-off, current research trends and improvement in the design of fuzzy classifier using MOEA in the future scope of authors. Methods: The state-of-the-art review has been conducted for various fuzzy classifier designs, and their optimization is reviewed in terms of multi-objective. Results: This article reviews the different Multi-Objective Optimization (EMO) algorithms in the context of Interpretability -Accuracy tradeoff during fuzzy classification. Conclusion: The evolutionary multi-objective algorithms are being deployed in the development of fuzzy systems. Improvement in the design using these algorithms include issues like higher spatiality, exponentially inhabited solution, I-A tradeoff, interpretability quantification, and describing the ability of the system of the fuzzy domain, etc. The focus of the authors in future is to find out the best evolutionary algorithm of multi-objective nature with efficiency and robustness, which will be applicable for developing the optimized fuzzy system with more accuracy and higher interpretability. More concentration will be on the creation of new metrics or parameters for the measurement of interpretability of fuzzy systems and new processes or methods of EMO for handling I-A tradeoff.

scholarly journals Conditional out-of-distribution generation for unpaired data using transfer VAE

2020 ◽  
Vol 36 (Supplement_2) ◽  
pp. i610-i617
Author(s):  
Mohammad Lotfollahi ◽  
Mohsen Naghipourfar ◽  
Fabian J Theis ◽  
F Alexander Wolf
Keyword(s):  
Single Cell ◽  
Generative Models ◽  
Response To Treatment ◽  
High Dimensional ◽  
Compact Representation ◽  
Hair Color ◽  
Great Success ◽  
Cell Type ◽  
Style Transfer ◽  
Cell Type Specific

Abstract Motivation While generative models have shown great success in sampling high-dimensional samples conditional on low-dimensional descriptors (stroke thickness in MNIST, hair color in CelebA, speaker identity in WaveNet), their generation out-of-distribution poses fundamental problems due to the difficulty of learning compact joint distribution across conditions. The canonical example of the conditional variational autoencoder (CVAE), for instance, does not explicitly relate conditions during training and, hence, has no explicit incentive of learning such a compact representation. Results We overcome the limitation of the CVAE by matching distributions across conditions using maximum mean discrepancy in the decoder layer that follows the bottleneck. This introduces a strong regularization both for reconstructing samples within the same condition and for transforming samples across conditions, resulting in much improved generalization. As this amount to solving a style-transfer problem, we refer to the model as transfer VAE (trVAE). Benchmarking trVAE on high-dimensional image and single-cell RNA-seq, we demonstrate higher robustness and higher accuracy than existing approaches. We also show qualitatively improved predictions by tackling previously problematic minority classes and multiple conditions in the context of cellular perturbation response to treatment and disease based on high-dimensional single-cell gene expression data. For generic tasks, we improve Pearson correlations of high-dimensional estimated means and variances with their ground truths from 0.89 to 0.97 and 0.75 to 0.87, respectively. We further demonstrate that trVAE learns cell-type-specific responses after perturbation and improves the prediction of most cell-type-specific genes by 65%. Availability and implementation The trVAE implementation is available via github.com/theislab/trvae. The results of this article can be reproduced via github.com/theislab/trvae_reproducibility.

scholarly journals Novel Features and PRPD Image Denoising Method for Improved Single-Source Partial Discharges Classification in On-Line Hydro-Generators

Energies ◽  
2021 ◽  
Vol 14 (11) ◽  
pp. 3267
Author(s):  
Ramon C. F. Araújo ◽  
Rodrigo M. S. de Oliveira ◽  
Fernando S. Brasil ◽  
Fabrício J. B. Barros
Keyword(s):  
Image Denoising ◽  
Recognition Performance ◽  
Partial Discharge ◽  
Classification Performance ◽  
Partial Discharges ◽  
Denoising Method ◽  
Internal Parameters ◽  
On Line ◽  
Automatic Removal ◽  
The Impact

In this paper, a novel image denoising algorithm and novel input features are proposed. The algorithm is applied to phase-resolved partial discharge (PRPD) diagrams with a single dominant partial discharge (PD) source, preparing them for automatic artificial-intelligence-based classification. It was designed to mitigate several sources of distortions often observed in PRPDs obtained from fully operational hydroelectric generators. The capabilities of the denoising algorithm are the automatic removal of sparse noise and the suppression of non-dominant discharges, including those due to crosstalk. The input features are functions of PD distributions along amplitude and phase, which are calculated in a novel way to mitigate random effects inherent to PD measurements. The impact of the proposed contributions was statistically evaluated and compared to classification performance obtained using formerly published approaches. Higher recognition rates and reduced variances were obtained using the proposed methods, statistically outperforming autonomous classification techniques seen in earlier works. The values of the algorithm’s internal parameters are also validated by comparing the recognition performance obtained with different parameter combinations. All typical PD sources described in hydro-generators PD standards are considered and can be automatically detected.

Sign in / Sign up

Export Citation Format

Share Document