Design and Implementation of Distributed Crawler System for Opinion Mining

2013 ◽  
Vol 347-350 ◽  
pp. 2506-2510
Author(s):  
Yun Qi Gao ◽  
Chun Lin Peng

With the development of Internet, Network public opinion has been serving an import role in reflection of social public opinion. As there are a large number of websites and forums on the Internet, we need a powerful crawler system which can meet the demands of opinion mining. However, common crawler systems concern more about ranking and recommendation algorithms, which is less important in opinion mining. In this article, we introduced the design and implementation of a distributed crawler system for opinion mining. We also introduced some extra parameters such as keywords count and published time into the ranking and refreshing strategies. Experimental results demonstrate that the system can well support different sites, and the improved strategies can greatly enhance the crawling and monitoring efficiency.

2014 ◽  
Vol 926-930 ◽  
pp. 1902-1905
Author(s):  
Yong Zheng Li ◽  
Ming Shan Zhang

With the continuous development of the Internet technology in recent years, the number of Internet users in China is increasing, with the Internet as the mainstay of the Internet plays a more and more important role in the whole social public opinion, our country has been the lack of effective means of supervision, which leads to network public opinion events occurred frequently in recent years, a strong need for a reliable method effective to achieve the monitoring of network public opinion. In view of the above situation, this paper introduces some key technology of Internet public opinion monitoring, then gives analysis, public opinion monitoring system design and implementation.


2020 ◽  
Vol 4 (9) ◽  
Author(s):  
Jianwen Duo ◽  
Jin Wang ◽  
Zhengyan Zhan ◽  
Pinghui Yang

The popularity of the Internet and the rise of self-media have built a diversified, convenient and instant platform for colleges and universities to do a good job in education, teaching, propaganda and ideology, but at the same time it also brings challenges and problems of college network security and campus stability. Most emergencies in colleges and universities are caused by trivial incidents and are largely unpredictable. If they are put online through online channels, they will attract the attention of the majority of netizens in a short period of time and attract online public attention. Once it is not handled in a timely manner, it will affect the normal education and teaching of colleges and universities and the safety and stability of campuses, and it is likely to form major public opinion on a larger scale, affecting the harmony and stability of the local society. This article adopts the characteristics of the network public opinion of colleges and universities in Gansu Province. It analyzes the current situation and focuses on the countermeasures to deal with network public opinion caused by emergencies in colleges and universities, hoping to provide a reference for further promoting the level and effectiveness of network public opinion in response to emergencies in Gansu Province.


Author(s):  
Weimin Gao ◽  
Jiaming Zhong ◽  
Yuan Xiao

Network Public Opinion is significant in maintaining social harmony and stability and promoting transparency in government affairs. However, with the development of economy and transformation of society, our country has entered a high-risk period, which is full of unexpected public events. Unexpected mass accidents also cause hot discussions among the Internet users once they are exposed on the network. Different ideas, opinions, emotions, and attitudes about unexpected public events will be collected and collide on the Internet. It makes Network Public Opinion play an increasingly important role in the evolution of unexpected public events. It could promote the spread and upgrade of unexpected public events and bring more and more profound influence on to our social life. We use the case study method to analyze and solve the problems by applying the dynamic principles of the SIR epidemic model, comprehensively considering the social environment and various influencing factors, and constructing a mathematical model for the spread of network group events. The study uses Matlab to simulate the change trajectory of the number of participants in the network group events. By adjusting the number of contacts φ in the model, the development of network group emergencies can be effectively controlled and managed. As long as the government takes timely intervention measures, the dissemination of network group events can be basically controlled. Combined with public opinion big data to discover the important factors affecting the spread of public opinion, the control effect is obvious.


2021 ◽  
Vol 2 (3) ◽  
pp. 126-128
Author(s):  
Xinhua Li ◽  
Zichen Li

Internet public opinion is an influential and tendentious opinion or speech expressed by the public on the Internet to a certain focus, which has formed a powerful force of public opinion. Internet public opinion has become a concentrated reflection of public opinion, opening up another channel to truly reflect public opinion, and effectively promoting the supervision of government officials and their decisions. In view of the strong emotional weakness of the current network public opinion, we can train forum opinion leaders to guide the public opinion with affinity and consideration, and select and enlarge the network public opinion by connecting the traditional media.


2019 ◽  
Vol 1 (2) ◽  
Author(s):  
Yichu Wang

In the rapid development of science and technology, the Internet has been widely used in the daily life and work of people, which has greatly changed the way people live and work. At this stage, people regard the Internet as the main way to obtain news information, and they have supervised the news contents [1]. Based on this, the article expounds the relevant content of network public opinion, analyzes the role of network public opinion in the public management of Chinese government, and studies the influence of public opinion on the public management of Chinese government.


2018 ◽  
Vol 4 (1) ◽  
pp. 57
Author(s):  
Yuli Anwar ◽  
Dahlar .

Abstract. One of the advances in information technology that now has changed the outlook and human life, business process and business strategy of an institution is the internet. The internet is a very large networks that connected to computers and serves throughout the world in one centralized network. With the internet we can access data and information anytime and anywhere.    As one provider of high-speed data communications services and the pioneer of the internet network service provider in Indonesia that provides integrated services, as well as one of the pioneer development of internet services that provide extensive services in the building and apply it throughout Indonesia. Indosat ready to seize opportunities for sustainable growth of business spectrum are still sprawling Indonesia.    Therefore, Indosat continues to focus on the development of increased efforts to provide the best service for customers of Indosat. Indosat will continue to develop and expand network coverage and a larger investment that the company will achieve excellence in the field of integrated telecommunications services.    Ranking by region of the IP Providers can be seen by grouping IP Providers, and management over IP Providers prefer to choose providers based on where it orginates as an example for the region of the U.S if it will be preferred providers that come from U.S. providers.With the commencement of the internet network optimization start early in 2008 with the selection of the appropriate IP Upstream Provider criteria, it is up to date according to data obtained from Indosat, seen any significant changes to the cost of purchasing capacity of the IP Upstream.    Based on the data obtained that until Q3 or September 2008, the number of IP Upstream Providers that previously there were 20 to 10 IP Upstream Provider, IP Transit Price total decrease of 11% to the price of IP Transit Price / Mbps there is a decrease of 78%, while from the capacity bandwith an increase of 301% capacity from 2008.


Sign in / Sign up

Export Citation Format

Share Document