Automatic Intelligence Gathering from the Web: A Case Study in Container Traffic

Web usage mining is used to find out fascinating consumer navigation patterns which can be applied to a lot of real-world problems, such as enriching websites or pages, generating newly topic or product recommendations and consumer behavior studies, etc. In this paper, an attempt has been made to provide a taxonomical classification of web usage mining applications with two levels of hierarchy. Further, the ontology for various categories of the web usage mining applications has been developed and to prove the completeness of proposed taxonomy, a rigorous case study has been performed. The comparative study with other existing classifications of web usage mining applications has also been performed.

Download Full-text

Creating and using Web corpora

International Journal of Corpus Linguistics ◽

10.1075/ijcl.10.4.07the ◽

2005 ◽

Vol 10 (4) ◽

pp. 517-541 ◽

Cited By ~ 4

Author(s):

Mike Thelwall

Keyword(s):

Search Engine ◽

Web Sites ◽

Web Crawler ◽

Commercial Search Engine ◽

British National Corpus ◽

The Uk ◽

The University ◽

The Web ◽

National Corpus

The Web has recently been used as a corpus for linguistic investigations, often with the help of a commercial search engine. We discuss some potential problems with collecting data from commercial search engine and with using the Web as a corpus. We outline an alternative strategy for data collection, using a personal Web crawler. As a case study, the university Web sites of three nations (Australia, New Zealand and the UK) were crawled. The most frequent words were broadly consistent with non-Web written English, but with some academic-related words amongst the top 50 most frequent. It was also evident that the university Web sites contained a significant amount of non-English text, and academic Web English seems to be more future-oriented than British National Corpus written English.

Download Full-text

Event Monitoring and Intelligence Gathering Using Twitter Based Real-Time Event Summarization and Pre-Trained Model Techniques

Applied Sciences ◽

10.3390/app112210596 ◽

2021 ◽

Vol 11 (22) ◽

pp. 10596

Author(s):

Chung-Hong Lee ◽

Hsin-Chang Yang ◽

Yenming J. Chen ◽

Yung-Lin Chuang

Keyword(s):

Real Time ◽

Data Science ◽

Clustering Algorithm ◽

Language Models ◽

Event Monitoring ◽

Data Set ◽

Intelligence Gathering ◽

Twitter Data ◽

The Government

Recently, an emerging application field through Twitter messages and algorithmic computation to detect real-time world events has become a new paradigm in the field of data science applications. During a high-impact event, people may want to know the latest information about the development of the event because they want to better understand the situation and possible trends of the event for making decisions. However, often in emergencies, the government or enterprises are usually unable to notify people in time for early warning and avoiding risks. A sensible solution is to integrate real-time event monitoring and intelligence gathering functions into their decision support system. Such a system can provide real-time event summaries, which are updated whenever important new events are detected. Therefore, in this work, we combine a developed Twitter-based real-time event detection algorithm with pre-trained language models for summarizing emergent events. We used an online text-stream clustering algorithm and self-adaptive method developed to gather the Twitter data for detection of emerging events. Subsequently we used the Xsum data set with a pre-trained language model, namely T5 model, to train the summarization model. The Rouge metrics were used to compare the summary performance of various models. Subsequently, we started to use the trained model to summarize the incoming Twitter data set for experimentation. In particular, in this work, we provide a real-world case study, namely the COVID-19 pandemic event, to verify the applicability of the proposed method. Finally, we conducted a survey on the example resulting summaries with human judges for quality assessment of generated summaries. From the case study and experimental results, we have demonstrated that our summarization method provides users with a feasible method to quickly understand the updates in the specific event intelligence based on the real-time summary of the event story.

Download Full-text

Creating and evaluating web-based visualizations of multi-dimensional spatiotemporal data

Proceedings of the ICA ◽

10.5194/ica-proc-2-145-2019 ◽

2019 ◽

Vol 2 ◽

pp. 1-8

Author(s):

Jan Wilkening ◽

Keni Han ◽

Mathias Jahnke

Keyword(s):

Spatiotemporal Data ◽

Weather Data ◽

Temporal Data ◽

Web Based ◽

Animated Maps ◽

Different Types ◽

Weather Parameters ◽

Spatio Temporal ◽

The Web

<p><strong>Abstract.</strong> In this article, we present a method for visualizing multi-dimensional spatio-temporal data in an interactive web-based geovisualization. Our case study focuses on publicly available weather data in Germany. After processing the data with Python and desktop GIS, we integrated the data as web services in a browser-based application. This application displays several weather parameters with different types of visualisations, such as static maps, animated maps and charts. The usability of the web-based geovisualization was evaluated with a free-examination and a goal-directed task, using eye-tracking analysis. The evaluation focused on the question how people use static maps, animated maps and charts, dependent on different tasks. The results suggest that visualization elements such as animated maps, static maps and charts are particularly useful for certain types of tasks, and that more answering time correlates with less accurate answers.</p>

Download Full-text

An Evaluation of Impacts of Boko Haram Insurgency in Nigeria: A Case Study of Abuja Metropolis

Asian Research Journal of Arts & Social Sciences ◽

10.9734/arjass/2020/v11i130158 ◽

2020 ◽

pp. 1-11

Author(s):

Audu Bako Susan ◽

Chijioke, N. Joy ◽

Uwakwe Stanley Ikechukwu

Keyword(s):

Quantitative Research ◽

Local Economy ◽

Islamic State ◽

Boko Haram ◽

Intelligence Gathering ◽

Best Management ◽

Food Shortages ◽

Grass Root ◽

And Migration

The deep and far-reaching fear, chaos and uncertainties related to the Boko Haram insurgency make an empirical study of its impacts significant. Boko Haram insurgency has not only resulted in many deaths but has adversely affected agricultural production in Nigeria and distorted local economy. The Global Terrorism Index (GTI) said Boko Haram has killed more people than any other terrorist group in the world, including the Islamic State. Boko Haram is also responsible for deaths and deprivation in an indirect way of starve-killing. Their operations have caused food shortages, created food insecurity in Nigeria resulting in many farmers either being killed, displaced or their livelihoods destroyed. Infrastructural facilities on the other hand, as well as businesses have not been spared of the devastating impacts of the Boko Haram insurgency. This study strategically examined the effectiveness of security agencies management of Boko Haram insurgencies, identified its impact and examined the best management mechanisms for the insurgency, within the contextual preview of Abuja metropolis. The study adopted a quantitative research design of purposive sampling approach and discovered from the research that attacks on the metropolis resulted in urban dislocation and migration. It therefore recommends increased security partnership, improved welfare for security agencies, training of security agencies in intelligence gathering and management, encourage and strengthen grass root community policing.

Download Full-text

Information Systems for Accreditation Assessment Department base on The Web (Case Study: Informatic Engineering Department)

Proceedings of the The 1st International Conference on Computer Science and Engineering Technology Universitas Muria Kudus ◽

10.4108/eai.24-10-2018.2280611 ◽

2018 ◽

Author(s):

Mukhamad Nurkamid ◽

Ahmad Jazuli

Keyword(s):

Information Systems ◽

Engineering Department ◽

The Web

Download Full-text

Web-Based Job Aids Using RESTXQ and JavaScript for Authors of XML Documents

Proceedings of Balisage: The Markup Conference 2016 ◽

10.4242/balisagevol17.galtman01 ◽

2016 ◽

Cited By ~ 2

Author(s):

Amanda Galtman

Keyword(s):

Web Applications ◽

Web Based ◽

Job Aids ◽

Xml Documents ◽

Software Company ◽

Technical Writers ◽

Visualization Application ◽

Exchange Data ◽

The Web

Using XML as the source format for authoring technical publications creates opportunities to develop tools that provide analysis, author guidance, and visualization. This case study describes two web applications that take advantage of the XML source format of documents. The applications provide a browser-based tool for technical writers and editors in a 100-person documentation department of a software company. Compared to desktop tools, the web applications are more convenient for users and less affected by hard-to-predict inconsistencies among users' computers. One application analyzes file dependencies and produces custom reports that facilitate reorganizing files. The other helps authors visualize their network of topics in their documentation sets. Both applications rely on the XQuery language and its RESTXQ web API. The visualization application also uses JavaScript, including the powerful jQuery and D3 libraries. After discussing what the applications do and why, this paper describes some architectural highlights, including how the different technologies fit together and exchange data.

Download Full-text