A Survey of incremental high-utility pattern mining based on storage structure

2021 ◽  
pp. 1-26
Author(s):  
Haodong Cheng ◽  
Meng Han ◽  
Ni Zhang ◽  
Xiaojuan Li ◽  
Le Wang
Keyword(s):  
Pattern Mining ◽  
Business Decisions ◽  
Practical Applications ◽  
Itemset Mining ◽  
High Utility ◽  
High Utility Itemsets ◽  
High Utility Patterns ◽  
Mining Algorithms ◽  
Purchase Quantity ◽  
Storage Structures

Traditional association rule mining has been widely studied, but this is not applicable to practical applications that must consider factors such as the unit profit of the item and the purchase quantity. High-utility itemset mining (HUIM) aims to find high-utility patterns by considering the number of items purchased and the unit profit. However, most high-utility itemset mining algorithms are designed for static databases. In real-world applications (such as market analysis and business decisions), databases are usually updated by inserting new data dynamically. Some researchers have proposed algorithms for finding high-utility itemsets in dynamically updated databases. Different from the batch processing algorithms that always process the databases from scratch, the incremental HUIM algorithms update and output high-utility itemsets in an incremental manner, thereby reducing the cost of finding high-utility itemsets. This paper provides the latest research on incremental high-utility itemset mining algorithms, including methods of storing itemsets and utilities based on tree, list, array and hash set storage structures. It also points out several important derivative algorithms and research challenges for incremental high-utility itemset mining.

scholarly journals Dynamic maintenance model for high average-utility pattern mining with deletion operation

2021 ◽  
Author(s):  
Jimmy Ming-Tai Wu ◽  
Qian Teng ◽  
Shahab Tayeb ◽  
Jerry Chun-Wei Lin
Keyword(s):  
Pattern Mining ◽  
Computational Cost ◽  
Practical Applications ◽  
Itemset Mining ◽  
Dynamic Databases ◽  
Speed Up ◽  
Dynamic Maintenance ◽  
Average Utility ◽  
High Utility ◽  
Maintenance Model

AbstractThe high average-utility itemset mining (HAUIM) was established to provide a fair measure instead of genetic high-utility itemset mining (HUIM) for revealing the satisfied and interesting patterns. In practical applications, the database is dynamically changed when insertion/deletion operations are performed on databases. Several works were designed to handle the insertion process but fewer studies focused on processing the deletion process for knowledge maintenance. In this paper, we then develop a PRE-HAUI-DEL algorithm that utilizes the pre-large concept on HAUIM for handling transaction deletion in the dynamic databases. The pre-large concept is served as the buffer on HAUIM that reduces the number of database scans while the database is updated particularly in transaction deletion. Two upper-bound values are also established here to reduce the unpromising candidates early which can speed up the computational cost. From the experimental results, the designed PRE-HAUI-DEL algorithm is well performed compared to the Apriori-like model in terms of runtime, memory, and scalability in dynamic databases.

scholarly journals MINING OF HIGH-UTILITY ITEMSETS WITH NEGATIVE UTILITY

2020 ◽  
Vol 1 (2) ◽  
pp. 44-47
Author(s):  
Tung N.T ◽  
Nguyen Le Van ◽  
Trinh Cong Nhut ◽  
Tran Van Sang
Keyword(s):  
State Of The Art ◽  
Upper Bounds ◽  
Itemset Mining ◽  
Novel Structure ◽  
Transactional Databases ◽  
Speed Up ◽  
Projection Techniques ◽  
High Utility ◽  
High Utility Itemsets ◽  
Mining Algorithms

The goal of the high-utility itemset mining task is to discover combinations of items that yield high profits from transactional databases. HUIM is a useful tool for retail stores to analyze customer behaviors. However, in the real world, items are found with both positive and negative utility values. To address this issue, we propose an algorithm named Modified Efficient High‐utility Itemsets mining with Negative utility (MEHIN) to find all HUIs with negative utility. This algorithm is an improved version of the EHIN algorithm. MEHIN utilizes 2 new upper bounds for pruning, named revised subtree and revised local utility. To reduce dataset scans, the proposed algorithm uses transaction merging and dataset projection techniques. An array‐based utility‐counting technique is also utilized to calculate upper‐bound efficiently. The MEHIN employs a novel structure called P-set to reduce the number of transaction scans and to speed up the mining process. Experimental results show that the proposed algorithms considerably outperform the state-of-the-art HUI-mining algorithms on negative utility in retail databases in terms of runtime.

scholarly journals Improved Strategy for High-Utility Pattern Mining Algorithm

2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
Le Wang ◽  
Shui Wang ◽  
Haiyan Li ◽  
Chunliang Zhou
Keyword(s):  
Pattern Mining ◽  
State Of The Art ◽  
Search Space ◽  
Research Topics ◽  
Main Research ◽  
Mining Algorithm ◽  
Temporal Efficiency ◽  
High Utility ◽  
High Utility Patterns ◽  
Mining Algorithms

High-utility pattern mining is a research hotspot in the field of pattern mining, and one of its main research topics is how to improve the efficiency of the mining algorithm. Based on the study on the state-of-the-art high-utility pattern mining algorithms, this paper proposes an improved strategy that removes noncandidate items from the global header table and local header table as early as possible, thus reducing search space and improving efficiency of the algorithm. The proposed strategy is applied to the algorithm EFIM (EFficient high-utility Itemset Mining). Experimental verification was carried out on nine typical datasets (including two large datasets); results show that our strategy can effectively improve temporal efficiency for mining high-utility patterns.

scholarly journals Business Intelligence for Evaluating the Intangible Benefits of On-Shelf High Utility Itemset from the Temporal Transaction Database

2019 ◽  
Vol 8 (6) ◽  
pp. 1428-1435
Keyword(s):  
Research Work ◽  
Decisive Role ◽  
List Structure ◽  
Business Decisions ◽  
Utility Mining ◽  
Time Period ◽  
Transaction Database ◽  
High Utility ◽  
High Utility Itemsets ◽  
Mining Algorithms

Utility Mining is the progression of identifying High Utility Itemsets (HUI’s) from enormous transaction data. Utility mining plays a decisive role in the inspection of the data or giving actionable information to help managers, sales executives, and other commercial end-users to generate versed business decisions. In the hypermarkets, the showcase period of every item in display will vary such as new products, seasonal products, and so on. Itemsets with time period are not retrieved by existing utility mining algorithms. Hence, On-Shelf Utility Mining algorithms were proposed to discover HUI’s and a general onshelf period of all items in temporal databases is considered. Research work aims to propose an algorithm called LOSUM (List On-Shelf Utility Mining) to retrieve on-shelf HUI’s from a temporal transaction database by reducing the data stores scan. The algorithm is enhanced by implementing a list structure to store utility information of every itemset. The candidate itemsets are generated from the list itself. This reduces the supplementary scan of a database. The LOSUM is compared with FOSHU using Chess, Accident, Kosarak, and Mushroom datasets. The experimental results illustrate that the LOSUM is efficient than the existing algorithm FOSHU (Fast On-Shelf High Utility itemset mining) algorithm

Mining of top-k high utility itemsets with negative utility

2020 ◽  
pp. 1-16
Author(s):  
Rui Sun ◽  
Meng Han ◽  
Chunyan Zhang ◽  
Mingyao Shen ◽  
Shiyu Du
Keyword(s):  
Data Mining ◽  
Search Space ◽  
Experimental Results ◽  
Effective Algorithm ◽  
Memory Usage ◽  
Utility Value ◽  
Itemset Mining ◽  
High Utility ◽  
High Utility Itemsets

High utility itemset mining(HUIM) with negative utility is an emerging data mining task. However, the setting of the minimum utility threshold is always a challenge when mining high utility itemsets(HUIs) with negative items. Although the top-k HUIM method is very common, this method can only mine itemsets with positive items, and the problem of missing itemsets occurs when mining itemsets with negative items. To solve this problem, we first propose an effective algorithm called THN (Top-k High Utility Itemset Mining with Negative Utility). It proposes a strategy for automatically increasing the minimum utility threshold. In order to solve the problem of multiple scans of the database, it uses transaction merging and dataset projection technology. It uses a redefined sub-tree utility value and a redefined local utility value to prune the search space. Experimental results on real datasets show that THN is efficient in terms of runtime and memory usage, and has excellent scalability. Moreover, experiments show that THN performs particularly well on dense datasets.

Optimization of Evolutionary Algorithm Using Machine Learning Techniques for Pattern Mining in Transactional Database

2020 ◽  
pp. 173-200
Author(s):  
Logeswaran K. ◽  
Suresh P. ◽  
Savitha S. ◽  
Prasanna Kumar K. R.
Keyword(s):  
Evolutionary Algorithm ◽  
Pattern Mining ◽  
Fitness Function ◽  
Search Space ◽  
Machine Learning Techniques ◽  
Dynamic Selection ◽  
Learning Techniques ◽  
Optimal Function ◽  
High Utility ◽  
Mining Algorithms

In recent years, the data analysts are facing many challenges in high utility itemset (HUI) mining from given transactional database using existing traditional techniques. The challenges in utility mining algorithms are exponentially growing search space and the minimum utility threshold appropriate to the given database. To overcome these challenges, evolutionary algorithm-based techniques can be used to mine the HUI from transactional database. However, testing each of the supporting functions in the optimization problem is very inefficient and it increases the time complexity of the algorithm. To overcome this drawback, reinforcement learning-based approach is proposed for improving the efficiency of the algorithm, and the most appropriate fitness function for evaluation can be selected automatically during execution of an algorithm. Furthermore, during the optimization process when distinct functions are skillful, dynamic selection of current optimal function is done.

scholarly journals Mining Rare Patterns by Using Automated Threshold Support

2018 ◽  
Vol 7 (3.8) ◽  
pp. 77
Author(s):  
Prof. Mangesh Ghonge ◽  
Miss Neha Rane
Keyword(s):  
Pattern Mining ◽  
Vital Role ◽  
Frequent Itemset ◽  
Projection Property ◽  
Itemset Mining ◽  
Huge Data ◽  
Information Method ◽  
Automated Support ◽  
Mining Algorithms ◽  
Crucial Part

Essentially the most primary and crucial part of data mining is pattern mining. For acquiring important corre-lations among the information, method called itemset mining plays vital role Earlier, the notion of itemset mining was used to acquire the absolute most often occurring items in the itemset. In some situation, though having utility value less than threshold it is necessary to locate such items because they are of great use. Considering the thought of weight for each and every apparent items brings effectiveness for mining the pattern efficiently. Different mining algorithms are utilized to obtain the correlations among the information items based on frequency with the items in the dataset occurs. In frequent itemset, those things which occurs frequently whereas, in infrequent itemset the items that occur very rarely are obtained. Determining such form of data is tougher than to locate data which occurs frequently. Frequent Itemset Mining (FISM) locates large and frequent itemsets in huge data for example market baskets. Such data has two properties that are not addressed by FISM; Mixture property and projection property. Here the proposed system combines both mixture as well as projection property further providing automated support thresholds.  

scholarly journals Efficient Utility Tree-Based Algorithm to Mine High Utility Patterns Having Strong Correlation

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-18
Author(s):  
Rashad Saeed ◽  
Azhar Rauf ◽  
Fahmi H. Quradaa ◽  
Syed Muhammad Asim
Keyword(s):  
Strong Correlation ◽  
Pattern Mining ◽  
Computational Cost ◽  
Search Space ◽  
Sufficient Information ◽  
Memory Consumption ◽  
Cost Cutting ◽  
E Learning ◽  
High Utility ◽  
High Utility Patterns

High Utility Itemset Mining (HUIM) is one of the most investigated tasks of data mining. It has broad applications in domains such as product recommendation, market basket analysis, e-learning, text mining, bioinformatics, and web click stream analysis. Insights from such pattern analysis provide numerous benefits, including cost cutting, improved competitive advantage, and increased revenue. However, HUIM methods may discover misleading patterns as they do not evaluate the correlation of extracted patterns. As a consequence, a number of algorithms have been proposed to mine correlated HUIs. These algorithms still suffer from the issue of the computational cost in terms of both time and memory consumption. This paper presents an algorithm, named Efficient Correlated High Utility Pattern Mining (ECoHUPM), to efficiently mine the high utility patterns having strong correlation items. A new data structure based on utility tree (UTtree) named CoUTlist is proposed to store sufficient information for mining the desired patterns. Three pruning properties are introduced to reduce the search space and improve the mining performance. Experiments on sparse, very sparse, dense, and very dense datasets indicate that the proposed ECoHUPM algorithm is efficient as compared to the state-of-the-art CoHUIM and CoHUI-Miner algorithms in terms of both time and memory consumption.

A Systematic Survey on High Utility Itemset Mining

2019 ◽  
Vol 18 (04) ◽  
pp. 1113-1185 ◽  
Author(s):  
Bahareh Rahmati ◽  
Mohammad Karim Sohrabi
Keyword(s):  
Data Structures ◽  
Search Space ◽  
Frequent Itemset ◽  
Itemset Mining ◽  
Efficient Data ◽  
Average Utility ◽  
High Utility ◽  
High Utility Itemsets ◽  
Downward Closure ◽  
Efficient Data Structures

High utility itemset mining considers unit profits and quantities of items in a transaction database to extract more applicable and more useful association rules. Downward closure property, which causes significant pruning in frequent itemset mining, is not established in the utility of itemsets and so the mining problem will require alternative solutions to reduce its search space and to enhance its efficiency. Using an anti-monotonic upper bound of the utility function and exploiting efficient data structures for storing and compacting the dataset to perform efficient pruning strategies are the main solutions to address high utility itemset mining problem. Different mining methods and techniques have attempted to improve performance of extracting high utility itemsets and their several variants, including high-average utility itemsets, top-k high utility itemsets, and high utility itemsets with negative values, using more efficient data structures, more appropriate anti-monotonic upper bounds, and stronger pruning strategies. This paper aims to represent a comprehensive systematic review for high utility itemset mining techniques and to classify them based on their problem-solving approaches.

scholarly journals Incrementally updating the high average-utility patterns with pre-large concept

2020 ◽  
Vol 50 (11) ◽  
pp. 3788-3807
Author(s):  
Jerry Chun-Wei Lin ◽  
Matin Pirouz ◽  
Youcef Djenouri ◽  
Chien-Fu Cheng ◽  
Usman Ahmed
Keyword(s):  
State Of The Art ◽  
The State ◽  
Batch Mode ◽  
Itemset Mining ◽  
The Past ◽  
Dynamic Databases ◽  
Speed Up ◽  
Average Utility ◽  
High Utility ◽  
High Utility Patterns

Abstract High-utility itemset mining (HUIM) is considered as an emerging approach to detect the high-utility patterns from databases. Most existing algorithms of HUIM only consider the itemset utility regardless of the length. This limitation raises the utility as a result of a growing itemset size. High average-utility itemset mining (HAUIM) considers the size of the itemset, thus providing a more balanced scale to measure the average-utility for decision-making. Several algorithms were presented to efficiently mine the set of high average-utility itemsets (HAUIs) but most of them focus on handling static databases. In the past, a fast-updated (FUP)-based algorithm was developed to efficiently handle the incremental problem but it still has to re-scan the database when the itemset in the original database is small but there is a high average-utility upper-bound itemset (HAUUBI) in the newly inserted transactions. In this paper, an efficient framework called PRE-HAUIMI for transaction insertion in dynamic databases is developed, which relies on the average-utility-list (AUL) structures. Moreover, we apply the pre-large concept on HAUIM. A pre-large concept is used to speed up the mining performance, which can ensure that if the total utility in the newly inserted transaction is within the safety bound, the small itemsets in the original database could not be the large ones after the database is updated. This, in turn, reduces the recurring database scans and obtains the correct HAUIs. Experiments demonstrate that the PRE-HAUIMI outperforms the state-of-the-art batch mode HAUI-Miner, and the state-of-the-art incremental IHAUPM and FUP-based algorithms in terms of runtime, memory, number of assessed patterns and scalability.

Sign in / Sign up

Export Citation Format

Share Document