scholarly journals Mining Integrated Sequential Patterns From Multiple Databases

2020 ◽  
Vol 16 (1) ◽  
pp. 1-21
Author(s):  
Christie I. Ezeife ◽  
Vignesh Aravindan ◽  
Ritu Chaturvedi
Keyword(s):  
Processing Time ◽  
Pattern Mining ◽  
Difficult Problem ◽  
Sequential Pattern ◽  
Sequential Patterns ◽  
Frequency Count ◽  
Extended Version ◽  
Complex Queries ◽  
Historical Queries ◽  
Sequence Position

Existing work on multiple databases (MDBs) sequential pattern mining cannot mine frequent sequences to answer exact and historical queries from MDBs having different table structures. This article proposes the transaction id frequent sequence pattern (TidFSeq) algorithm to handle the difficult problem of mining frequent sequences from diverse MDBs. The TidFSeq algorithm transforms candidate 1-sequences to get transaction subsequences where candidate 1-sequences occurred as (1-sequence, itssubsequenceidlist) tuple or (1-sequence, position id list). Subsequent frequent i-sequences are computed using the counts of the sequence ids in each candidate i-sequence position id list tuples. An extended version of the general sequential pattern (GSP)-like candidate generates and a frequency count approach is used for computing supports of itemset (I-step) and separate (S-step) sequences without repeated database scans but with transaction ids. Generated patterns answer complex queries from MDBs. The TidFSeq algorithm has a faster processing time than existing algorithms.

scholarly journals Sequential Pattern Mining Algorithm Based on Text Data: Taking the Fault Text Records as an Example

2018 ◽  
Vol 10 (11) ◽  
pp. 4330 ◽  
Author(s):  
Xinglong Yuan ◽  
Wenbing Chang ◽  
Shenghan Zhou ◽  
Yang Cheng
Keyword(s):  
Time Series ◽  
Pattern Mining ◽  
Sequential Pattern Mining ◽  
Sequential Pattern ◽  
Fault Classification ◽  
Sequential Patterns ◽  
Series Data ◽  
Similarity Measurement ◽  
Text Similarity ◽  
Text Data

Sequential pattern mining (SPM) is an effective and important method for analyzing time series. This paper proposed a SPM algorithm to mine fault sequential patterns in text data. Because the structure of text data is poor and there are many different forms of text expression for the same concept, the traditional SPM algorithm cannot be directly applied to text data. The proposed algorithm is designed to solve this problem. First, this study measured the similarity of fault text data and classified similar faults into one class. Next, this paper proposed a new text similarity measurement model based on the word embedding distance. Compared with the classic text similarity measurement method, this model can achieve good results in short text classification. Then, on the basis of fault classification, this paper proposed the SPM algorithm with an event window, which is a time soft constraint for obtaining a certain number of sequential patterns according to needs. Finally, this study used the fault text records of a certain aircraft as experimental data for mining fault sequential patterns. Experiment showed that this algorithm can effectively mine sequential patterns in text data. The proposed algorithm can be widely applied to text time series data in many fields such as industry, business, finance and so on.

Detecting Implicit Security Exceptions Using an Improved Variable-Length Sequential Pattern Mining Method

2017 ◽  
Vol 27 (08) ◽  
pp. 1235-1268
Author(s):  
Jinfu Chen ◽  
Saihua Cai ◽  
Dave Towey ◽  
Lili Zhu ◽  
Rubing Huang ◽  
...  
Keyword(s):  
Visual Inspection ◽  
Pattern Mining ◽  
Sequential Pattern Mining ◽  
Variable Length ◽  
Sequential Pattern ◽  
Sequential Patterns ◽  
Mining Method ◽  
Security Testing ◽  
String Searching ◽  
Correct Execution

The process of component security testing can produce massive amounts of monitor logs. Current approaches to detect implicit security exceptions (those which cannot be identified by visual inspection alone) compare correct execution sequences with fixed patterns mined from the execution of sequential patterns in the monitor logs. However, this is not efficient and is not suitable for mining large monitor logs. To enable effective mining of implicit security exceptions from large monitor logs, this paper proposes a method based on improved variable-length sequential pattern mining. The proposed method first mines the variable-length sequential patterns from correct execution sequences and from actual execution sequences, thus reducing the number of patterns. The sequential patterns are then detected using the Sunday string-searching algorithm. We conducted an experimental study based on this method, the results of which show that the proposed method can efficiently detect the implicit security exceptions of components.

scholarly journals Mining of Sequential Patterns using Directed Graphs

2019 ◽  
Vol 8 (11) ◽  
pp. 4002-4007
Keyword(s):  
Pattern Mining ◽  
Directed Graphs ◽  
Real Life ◽  
Sequential Pattern Mining ◽  
Sequential Pattern ◽  
Sequential Patterns ◽  
Sequential Data ◽  
Sequence Database ◽  
Directed Paths ◽  
Digraph Model

Sequential pattern mining is one of the important functionalities of data mining. It is used for analyzing sequential database and discovers sequential patterns. It is focused for extracting interesting subsequences from a set of sequences. Various factors such as rate of occurrence, length, and profit are used to define the interestingness of subsequence derived from the sequence database. Sequential pattern mining has abundant real-life applications since sequential data is logically programmed as sequences of cipher in many fields such as bioinformatics, e-learning, market basket analysis, texts, and webpage click-stream analysis. A large diversity of competent algorithms such as Prefixspan, GSP and Freespan have been proposed during the past few years. In this paper we propose a data model for organizing the sequential database, which consists of a directed graph DGS (cycles and several edges are allowed) and an organization of directed paths in DGS to represent a sequential data for discovering sequential pattern3 from a sequence database. Competent algorithms for constructing the digraph model (DGS) for extracting all sequential patterns and mining association rules are proposed. A number of theoretical parameters of digraph model are also introduced, which lead to more understanding of the problem.

Sequential Pattern Mining from Sequential Data

2009 ◽  
pp. 622-631
Author(s):  
Shigeaki Sakurai
Keyword(s):  
Pattern Mining ◽  
Pattern Discovery ◽  
Sequential Pattern ◽  
The Other ◽  
Sequential Patterns ◽  
Sequential Data ◽  
Frequent Patterns ◽  
New Knowledge ◽  
Discovery Method ◽  
Time Information

Owing to the progress of computer and network environments, it is easy to collect data with time information such as daily business reports, weblog data, and physiological information. This is the context in which methods of analyzing data with time information have been studied. This chapter focuses on a sequential pattern discovery method from discrete sequential data. The methods proposed by Pei et al. (2001), Srikant & Agrawal (1996), and Zaki (2001) efficiently discover the frequent patterns as characteristic patterns. However, the discovered patterns do not always correspond to the interests of analysts, because the patterns are common and are not a source of new knowledge for the analysts. The problem has been pointed out in connection with the discovery of associative rules. Blanchard et al. (2005), Brin et al. (1997), Silberschatz et al. (1996), and Suzuki et al. (2005) propose other criteria in order to discover other kinds of characteristic patterns. The patterns discovered by the criteria are not always frequent but are characteristic of viewpoints. The criteria may be applicable to discovery methods of sequential patterns. However, these criteria do not satisfy the Apriori property. It is difficult for the methods based on the criteria to efficiently discover the patterns. On the other hand, methods that use the background knowledge of analysts have been proposed in order to discover sequential patterns corresponding to the interests of analysts (Garofalakis et al., 1999; Pei et al., 2002; Sakurai et al., 2008b; Yen, 2005).

Scalable Mining of High-Utility Sequential Patterns With Three-Tier MapReduce Model

2022 ◽  
Vol 16 (3) ◽  
pp. 1-26
Author(s):  
Jerry Chun-Wei Lin ◽  
Youcef Djenouri ◽  
Gautam Srivastava ◽  
Yuanfa Li ◽  
Philip S. Yu
Keyword(s):  
Large Scale ◽  
Pattern Mining ◽  
Sequential Pattern Mining ◽  
Main Memory ◽  
Frequent Itemset ◽  
Sequential Pattern ◽  
Sequential Patterns ◽  
Speed Up ◽  
Mapreduce Model ◽  
High Utility

High-utility sequential pattern mining (HUSPM) is a hot research topic in recent decades since it combines both sequential and utility properties to reveal more information and knowledge rather than the traditional frequent itemset mining or sequential pattern mining. Several works of HUSPM have been presented but most of them are based on main memory to speed up mining performance. However, this assumption is not realistic and not suitable in large-scale environments since in real industry, the size of the collected data is very huge and it is impossible to fit the data into the main memory of a single machine. In this article, we first develop a parallel and distributed three-stage MapReduce model for mining high-utility sequential patterns based on large-scale databases. Two properties are then developed to hold the correctness and completeness of the discovered patterns in the developed framework. In addition, two data structures called sidset and utility-linked list are utilized in the developed framework to accelerate the computation for mining the required patterns. From the results, we can observe that the designed model has good performance in large-scale datasets in terms of runtime, memory, efficiency of the number of distributed nodes, and scalability compared to the serial HUSP-Span approach.

Method of forming multi-leveled sequential patterns

2016 ◽  
pp. 158-163
Author(s):  
A.V. Moldavskaya ◽  
Keyword(s):  
Pattern Mining ◽  
Sequential Pattern Mining ◽  
Sequential Pattern ◽  
Sequential Patterns ◽  
New Form

The research is dedicated to the problem of large volumes of results acquired from sequential pattern mining. The new form of sequential patterns is proposed. The requirements for a programmed implementation of the described method are introduced. The results of experiments based on real malware behavior data are demonstrated.

Mining Time-Interval Sequential Patterns with High Utility from Transaction Databases

2016 ◽  
Vol 20 (6) ◽  
pp. 1018-1026 ◽  
Author(s):  
Wen-Yen Wang ◽  
◽  
Anna Y.-Q. Huang ◽  
Keyword(s):  
Pattern Mining ◽  
Sequential Pattern Mining ◽  
Business Practice ◽  
Sequential Pattern ◽  
Sequential Patterns ◽  
Time Interval ◽  
Business Managers ◽  
Time Intervals ◽  
High Utility ◽  
Product Sales

The purpose of time-interval sequential pattern mining is to help superstore business managers promote product sales. Sequential pattern mining discovers the time interval patterns for items: for example, if most customers purchase product item <span class="bold">A</span>, and then buy items <span class="bold">B</span> and <span class="bold">C</span> after <span class="bold">r</span> to <span class="bold">s</span> and <span class="bold">t</span> to <span class="bold">u</span> days respectively, the time interval between <span class="bold">r</span> to <span class="bold">s</span> and <span class="bold">t</span> to <span class="bold">u</span> days can be provided to business managers to facilitate informed marketing decisions. We treat these time intervals as patterns to be mined, to predict the purchasing time intervals between <span class="bold">A</span> and <span class="bold">B</span>, as well as <span class="bold">B</span> and <span class="bold">C</span>. Nevertheless, little work considers the significance of product items while mining these time-interval sequential patterns. This work extends previous work and retains high-utility time interval patterns during pattern mining. This type of mining is meant to more closely reflect actual business practice. Experimental results show the differences between three mining approaches when jointly considering item utility and time intervals for purchased items. In addition to yielding more accurate patterns than the other two methods, the proposed UTMining_A method shortens execution times by delaying join processing and removing unnecessary records.

Mining Frequent Utility Sequential Patterns in Progressive Databases by U-Pisa

2020 ◽  
Vol 17 (4) ◽  
pp. 1786-1795
Author(s):  
K. M. V. Madan Kumar ◽  
B. Srinivasa Rao
Keyword(s):  
Decision Making ◽  
Pattern Mining ◽  
Weather Forecasting ◽  
Sequential Pattern Mining ◽  
Sequential Pattern ◽  
Sequential Patterns ◽  
Recent Effort ◽  
Biomedical Analysis ◽  
Decision Making System ◽  
Traditional Approaches

Sequential pattern mining is one of the most important aspects of data mining world and has a significant role in many applications like market analysis, biomedical analysis, weather forecasting etc. In the category of mining sequential patterns the usage of progressive database as an input database is relatively new and has a wide impact in decision-making system. In progressive sequential pattern mining, we discover the frequent sequences progressively with the help of period of Interest. As the traditional approaches of frequency based framework are not much more informative for decision making, in recent effort utility framework has been incorporated instead of frequency. This addressed many typical business concerns such as profit value associated with each pattern. In this paper, we applied the concept of frequent utility over the progressive database and discovered the sequential pattern efficiently. To do so we proposed an algorithm called U-Pisa which works progressively with the help of a quantitative progressive database. We conducted sub-stantial experiments on the proposed algorithm and proved that this process performs well.

Trend Analysis of Product Function Using Sequential Pattern Mining

2014 ◽  
Vol 519-520 ◽  
pp. 736-740
Author(s):  
Li Yu ◽  
Zai Fang Zhang
Keyword(s):  
Pattern Mining ◽  
Early Stage ◽  
Dynamic Change ◽  
Sequential Pattern Mining ◽  
Sequential Pattern ◽  
Sequential Patterns ◽  
Design Engineers ◽  
Product Function ◽  
Historical Database

During the early stage of product design, it is important for design engineers to decide the most appropriate functions for various customers. To facilitate this time consuming task, sequential pattern mining is applied to uncover the useful patterns in historical database. The mined sequential patterns can reflect the dynamic change of product functions, which can help design engineers find the most suitable product functions for customers. Based on the historical sales transactions of computer, a case study is conducted to illustrate the proposed method.

Mining Closed Repetitive Gapped Sequential Patterns Based on Repetition Linked WAP-Tree

2012 ◽  
Vol 197 ◽  
pp. 283-291
Author(s):  
Jun Dong ◽  
Yu Jie Xie ◽  
Jia Dong Ren ◽  
Wei Wei Zhou
Keyword(s):  
Pattern Mining ◽  
Positional Information ◽  
Sequential Pattern ◽  
Sequential Patterns ◽  
Position Information ◽  
Web Access ◽  
Frequent Items ◽  
Novel Method ◽  
Web Access Pattern ◽  
The Given

Closed repetitive gapped sequential pattern mining has been gained more and more attention in recent years, in this paper, we propose a novel method MRCGP(mining closed repetitive gapped sequential pattern based on repetition linked WAP-Tree). In the first step of MRCGP, the given sequential database is transformed into a new database in which every item is expressed by its landmark; then a positional information table(PIT) which includes all of the position information of 1-frequent items is constructed, all of the repetitive gapped 2-sequential patterns of different items (RPDI) can be obtained through searching the positional information table; following, a repetitive linked web access pattern tree (RLWAP-Tree) is built, in RLWAP-Tree, the 1-frequent items are stored as header table, the items in header table will be linked to their same items which appear earliest in each sequence corresponding to RLWAP-Tree with solid line, all of the items in RLWAP-Tree are linked to their same items in the same sequences with broken line; through mining projection tree of the existing repetitive gapped pattern recursively, we can obtain the repetitive gapped sequential pattern; at the end, we get the closed repetitive gapped sequential pattern by checking inclusion relation of any two patterns. The experiment result shows MRCGP has better time efficiency.

Sign in / Sign up

Export Citation Format

Share Document