Research on Web Data Mining Based on Topic Crawler

Journal of Web Engineering ◽

10.13052/jwe1540-9589.20411 ◽

2021 ◽

Author(s):

Hongjian Guo

Keyword(s):

Data Mining ◽

Information Search ◽

Mining System ◽

Key Technology ◽

Web Information ◽

The World ◽

Working Principle ◽

Data Mining System ◽

Implementation Method ◽

And Performance

This paper analyzes the method of Web information data mining based on topic crawler. This paper puts forward the architecture of Web information search and data mining, and introduces the key technology and operation principle of the architecture. After analyzing the functions and shortcomings of ordinary crawler, this paper focuses on the working principle, implementation method and performance analysis of this crawler, as well as the functions of this crawler different from other crawlers and its application in Web information search and data mining system. The experimental results show that the crawler can get all kinds of information resources on the world wide web, which is helpful to the monitoring and management of network cultural content.

Download Full-text

Data Mining for the Internet of Things

Exploring the Convergence of Big Data and the Internet of Things - Advances in Data Mining and Database Management ◽

10.4018/978-1-5225-2947-7.ch013 ◽

2018 ◽

pp. 181-191 ◽

Cited By ~ 1

Author(s):

Akhil Rajendra Khare ◽

Pallavi Shrivasta

Keyword(s):

Data Mining ◽

Internet Of Things ◽

System Optimization ◽

The Internet ◽

Mining System ◽

Data Mining Algorithms ◽

The World ◽

Data Mining System ◽

Mining Algorithms ◽

The Internet Of Things

The Internet of Things concept arises from the need to manage, automate, and explore all devices, instruments and sensors in the world. In order to make wise decisions both for people and for the things in IoT, data mining technologies are integrated with IoT technologies for decision making support and system optimization. Data mining involves discovering novel, interesting, and potentially useful patterns from data and applying algorithms to the extraction of hidden information. Data mining is classified into three different views: knowledge view, technique view, and application view. The challenges in the data mining algorithms for IoT are discussed and a suggested big data mining system is proposed.

Download Full-text

Personalized Web Data Mining System

Advanced Materials Research ◽

10.4028/www.scientific.net/amr.219-220.183 ◽

2011 ◽

Vol 219-220 ◽

pp. 183-186

Author(s):

Bo He

Keyword(s):

Data Mining ◽

User Interface ◽

Data Preprocessing ◽

User Profiles ◽

Web Data ◽

Web Data Mining ◽

Mining System ◽

Key Technology ◽

Interface Module ◽

Data Mining System

Most of Web data mining systems did not construct user profiles and could not support personalized Web data mining. Aiming at the shortcomings, the paper defined and established user profiles. On the base of this, the paper designed a personalized Web data mining system, namely PWDMS. PWDMS consisted of user interface module, data preprocessing module and data mining module. In addition, this paper discussed the key technology of PWDMS. It is proved that applying personalized technology to Web data mining is efficient.

Download Full-text