An Evolutionary Clustering Approach to Pareto Solutions in Multiobjective Optimization

2002 ◽  
Author(s):  
Min Joong Jeong ◽  
Sinobu Yoshimura
Keyword(s):  
Multiobjective Optimization ◽  
Engineering Design ◽  
Function Space ◽  
Clustering Algorithm ◽  
Computational Effort ◽  
Local Optimum ◽  
Pareto Solutions ◽  
Evolutionary Clustering ◽  
Interpretation Process ◽  
Clustering Approach

Pareto solutions in multiobjective optimization are very problematic to measuring the characteristics of solutions for engineering design because of their considerable variety in function space and parameter space. To overcome these situations, a clustering-based interpretation process for Pareto solutions is considered. For better competitive clustering algorithm, we propose an evolutionary clustering algorithm — ECA. The ECA requires less computational effort, and overcomes local optimum of the K-means clustering algorithm and its related algorithms. Effectiveness of the method is examined in detail through the comparison with other algorithms.

A Clustering Algorithm in Stream Data Using Strong Coreset

2021 ◽  
Author(s):  
Manmohan Singh ◽  
Rajendra Pamula ◽  
Alok Kumar
Keyword(s):  
Data Mining ◽  
Clustering Algorithm ◽  
Local Optimum ◽  
Reduction Algorithm ◽  
Stream Data ◽  
Stream Data Mining ◽  
Clustering Approach ◽  
Approximation Guarantee ◽  
Competitive Algorithms ◽  
Learning Data

There are various applications of clustering in the fields of machine learning, data mining, data compression along with pattern recognition. The existent techniques like the Llyods algorithm (sometimes called k-means) were affected by the issue of the algorithm which converges to a local optimum along with no approximation guarantee. For overcoming these shortcomings, an efficient k-means clustering approach is offered by this paper for stream data mining. Coreset is a popular and fundamental concept for k-means clustering in stream data. In each step, reduction determines a coreset of inputs, and represents the error, where P represents number of input points according to nested property of coreset. Hence, a bit reduction in error of final coreset gets n times more accurate. Therefore, this motivated the author to propose a new coreset-reduction algorithm. The proposed algorithm executed on the Covertype dataset, Spambase dataset, Census 1990 dataset, Bigcross dataset, and Tower dataset. Our algorithm outperforms with competitive algorithms like Streamkm[Formula: see text], BICO (BIRCH meets Coresets for k-means clustering), and BIRCH (Balance Iterative Reducing and Clustering using Hierarchies.

Rough Clustering Method Based on Particle Swarm Optimization Algorithm

2013 ◽  
Vol 325-326 ◽  
pp. 1632-1636
Author(s):  
Chao Wang ◽  
Ke Luo
Keyword(s):  
Particle Swarm Optimization ◽  
Clustering Algorithm ◽  
Particle Swarm Optimization Algorithm ◽  
Rough Set Theory ◽  
Particle Swarm ◽  
Local Optimum ◽  
Clustering Methods ◽  
Swarm Optimization ◽  
Clustering Approach ◽  
Definite Limit

As a relatively novel clustering approach, Particle Swarm Optimization (PSO) prevents k-means algorithm from falling into local optimum effectively, and has made relatively notable successes in clustering, however, using Hard C-Means algorithm when randomly obtaining initial clustering centers is required in most existing PSOs, while no definite limit existing in these samples actually. Based on this, we utilized an improved PSO; along with effective processing methods on boundary objects of Rough Set Theory, we proposed a new rough clustering algorithm based on PSO. It can adjust the upper and lower approximations weighting factors dynamically, and coordinate the proportions of upper and lower approximations in different generations as well. Finally, we compared it with several common clustering methods using Iris dataset of UCI. It turned out that the algorithm has higher accuracy and stability, along with better comprehensive performance.

A Hard C-Means Clustering Algorithm Incorporating Membership KL Divergence and Local Data Information for Noisy Image Segmentation

2017 ◽  
Vol 32 (04) ◽  
pp. 1850012 ◽  
Author(s):  
R. R. Gharieb ◽  
G. Gendy ◽  
H. Selim
Keyword(s):  
Image Segmentation ◽  
Membership Function ◽  
Clustering Algorithm ◽  
Clustering Algorithms ◽  
Cluster Center ◽  
Local Data ◽  
Cluster Membership ◽  
Kl Divergence ◽  
Clustering Approach ◽  
Center Distance

In this paper, the standard hard C-means (HCM) clustering approach to image segmentation is modified by incorporating weighted membership Kullback–Leibler (KL) divergence and local data information into the HCM objective function. The membership KL divergence, used for fuzzification, measures the proximity between each cluster membership function of a pixel and the locally-smoothed value of the membership in the pixel vicinity. The fuzzification weight is a function of the pixel to cluster-centers distances. The used pixel to a cluster-center distance is composed of the original pixel data distance plus a fraction of the distance generated from the locally-smoothed pixel data. It is shown that the obtained membership function of a pixel is proportional to the locally-smoothed membership function of this pixel multiplied by an exponentially distributed function of the minus pixel distance relative to the minimum distance provided by the nearest cluster-center to the pixel. Therefore, since incorporating the locally-smoothed membership and data information in addition to the relative distance, which is more tolerant to additive noise than the absolute distance, the proposed algorithm has a threefold noise-handling process. The presented algorithm, named local data and membership KL divergence based fuzzy C-means (LDMKLFCM), is tested by synthetic and real-world noisy images and its results are compared with those of several FCM-based clustering algorithms.

scholarly journals Lévy-Flight Moth-Flame Algorithm for Function Optimization and Engineering Design Problems

2016 ◽  
Vol 2016 ◽  
pp. 1-22 ◽  
Author(s):  
Zhiming Li ◽  
Yongquan Zhou ◽  
Sen Zhang ◽  
Junmin Song
Keyword(s):  
Engineering Design ◽  
Function Optimization ◽  
Superior Performance ◽  
Local Optimum ◽  
Lévy Flight ◽  
Design Problems ◽  
Levy Flight ◽  
Spiral Path ◽  
Straight Line ◽  
Engineering Design Problems

The moth-flame optimization (MFO) algorithm is a novel nature-inspired heuristic paradigm. The main inspiration of this algorithm is the navigation method of moths in nature called transverse orientation. Moths fly in night by maintaining a fixed angle with respect to the moon, a very effective mechanism for travelling in a straight line for long distances. However, these fancy insects are trapped in a spiral path around artificial lights. Aiming at the phenomenon that MFO algorithm has slow convergence and low precision, an improved version of MFO algorithm based on Lévy-flight strategy, which is named as LMFO, is proposed. Lévy-flight can increase the diversity of the population against premature convergence and make the algorithm jump out of local optimum more effectively. This approach is helpful to obtain a better trade-off between exploration and exploitation ability of MFO, thus, which can make LMFO faster and more robust than MFO. And a comparison with ABC, BA, GGSA, DA, PSOGSA, and MFO on 19 unconstrained benchmark functions and 2 constrained engineering design problems is tested. These results demonstrate the superior performance of LMFO.

Comparative Analysis of Methodologies for Uncertainty Propagation and Quantification

2017 ◽  
Author(s):  
Alessandra Cuneo ◽  
Alberto Traverso ◽  
Shahrokh Shahpar
Keyword(s):  
Engineering Design ◽  
Polynomial Chaos ◽  
Epistemic Uncertainty ◽  
Uncertainty Propagation ◽  
Computational Cost ◽  
Computational Effort ◽  
Optimization Under Uncertainty ◽  
Design Parameters ◽  
Test Case ◽  
Aleatory And Epistemic Uncertainty

In engineering design, uncertainty is inevitable and can cause a significant deviation in the performance of a system. Uncertainty in input parameters can be categorized into two groups: aleatory and epistemic uncertainty. The work presented here is focused on aleatory uncertainty, which can cause natural, unpredictable and uncontrollable variations in performance of the system under study. Such uncertainty can be quantified using statistical methods, but the main obstacle is often the computational cost, because the representative model is typically highly non-linear and complex. Therefore, it is necessary to have a robust tool that can perform the uncertainty propagation with as few evaluations as possible. In the last few years, different methodologies for uncertainty propagation and quantification have been proposed. The focus of this study is to evaluate four different methods to demonstrate strengths and weaknesses of each approach. The first method considered is Monte Carlo simulation, a sampling method that can give high accuracy but needs a relatively large computational effort. The second method is Polynomial Chaos, an approximated method where the probabilistic parameters of the response function are modelled with orthogonal polynomials. The third method considered is Mid-range Approximation Method. This approach is based on the assembly of multiple meta-models into one model to perform optimization under uncertainty. The fourth method is the application of the first two methods not directly to the model but to a response surface representing the model of the simulation, to decrease computational cost. All these methods have been applied to a set of analytical test functions and engineering test cases. Relevant aspects of the engineering design and analysis such as high number of stochastic variables and optimised design problem with and without stochastic design parameters were assessed. Polynomial Chaos emerges as the most promising methodology, and was then applied to a turbomachinery test case based on a thermal analysis of a high-pressure turbine disk.

scholarly journals TCLUST: Trimming Approach of Robust Clustering Method

2014 ◽  
Vol 8 (4) ◽  
Author(s):  
Muhamad Alias Md. Jedi ◽  
Robiah Adnan
Keyword(s):  
Clustering Algorithm ◽  
Likelihood Function ◽  
R Package ◽  
Clustering Method ◽  
Number Of Clusters ◽  
Robust Clustering ◽  
Scatter Matrix ◽  
Group Assignment ◽  
Log Likelihood ◽  
Clustering Approach

TCLUST is a method in statistical clustering technique which is based on modification of trimmed k-means clustering algorithm. It is called “crisp” clustering approach because the observation is can be eliminated or assigned to a group. TCLUST strengthen the group assignment by putting constraint to the cluster scatter matrix. The emphasis in this paper is to restrict on the eigenvalues, λ of the scatter matrix. The idea of imposing constraints is to maximize the log-likelihood function of spurious-outlier model. A review of different robust clustering approach is presented as a comparison to TCLUST methods. This paper will discuss the nature of TCLUST algorithm and how to determine the number of cluster or group properly and measure the strength of group assignment. At the end of this paper, R-package on TCLUST implement the types of scatter restriction, making the algorithm to be more flexible for choosing the number of clusters and the trimming proportion.

scholarly journals Canonical PSO Based K-Means Clustering Approach for Real Datasets

2014 ◽  
Vol 2014 ◽  
pp. 1-11 ◽  
Author(s):  
Lopamudra Dey ◽  
Sanjay Chakraborty
Keyword(s):  
Data Mining ◽  
Air Pollution ◽  
Clustering Algorithm ◽  
Clustering Algorithms ◽  
Real Life ◽  
Cluster Validity ◽  
Validity Assessment ◽  
Different Types ◽  
Clustering Approach ◽  
Validity Measure

“Clustering” the significance and application of this technique is spread over various fields. Clustering is an unsupervised process in data mining, that is why the proper evaluation of the results and measuring the compactness and separability of the clusters are important issues. The procedure of evaluating the results of a clustering algorithm is known as cluster validity measure. Different types of indexes are used to solve different types of problems and indices selection depends on the kind of available data. This paper first proposes Canonical PSO based K-means clustering algorithm and also analyses some important clustering indices (intercluster, intracluster) and then evaluates the effects of those indices on real-time air pollution database, wholesale customer, wine, and vehicle datasets using typical K-means, Canonical PSO based K-means, simple PSO based K-means, DBSCAN, and Hierarchical clustering algorithms. This paper also describes the nature of the clusters and finally compares the performances of these clustering algorithms according to the validity assessment. It also defines which algorithm will be more desirable among all these algorithms to make proper compact clusters on this particular real life datasets. It actually deals with the behaviour of these clustering algorithms with respect to validation indexes and represents their results of evaluation in terms of mathematical and graphical forms.

The Application of Fuzzy Clustering Number Algorithm in Network Intrusion Detection

2013 ◽  
Vol 760-762 ◽  
pp. 2220-2223
Author(s):  
Lang Guo
Keyword(s):  
Intrusion Detection ◽  
Fuzzy Clustering ◽  
Clustering Algorithm ◽  
Local Optimum ◽  
Cluster Number ◽  
Data Set ◽  
Network Intrusion ◽  
Correlation Degree ◽  
Indicator Data ◽  
Detection Effect

In view of the defects of K-means algorithm in intrusion detection: the need of preassign cluster number and sensitive initial center and easy to fall into local optimum, this paper puts forward a fuzzy clustering algorithm. The fuzzy rules are utilized to express the invasion features, and standardized matrix is adopted to further process so as to reflect the approximation degree or correlation degree between the invasion indicator data and establish a similarity matrix. The simulation results of KDD CUP1999 data set show that the algorithm has better intrusion detection effect and can effectively detect the network intrusion data.

Sign in / Sign up

Export Citation Format

Share Document