Models of Random Graphs and Their Applications to the Web-Graph Analysis

In this paper, the authors discuss the MapReduce implementation of crawler, indexer and ranking algorithms in search engines. The proposed algorithms are used in search engines to retrieve results from the World Wide Web. A crawler and an indexer in a MapReduce environment are used to improve the speed of crawling and indexing. The proposed ranking algorithm is an iterative method that makes use of the link structure of the Web and is developed using MapReduce framework to improve the speed of convergence of ranking the WebPages. Categorization is used to retrieve and order the results according to the user choice to personalize the search. A new score is introduced in this paper that is associated with each WebPage and is calculated using user’s query and number of occurrences of the terms in the query in the document corpus. The experiments are conducted on Web graph datasets and the results are compared with the serial versions of crawler, indexer and ranking algorithms.

Download Full-text

Models for the web graph

Graduate Studies in Mathematics - A Course on the Web Graph ◽

10.1090/gsm/089/04 ◽

2008 ◽

pp. 59-96

Author(s):

Anthony Bonato

Keyword(s):

Web Graph ◽

The Web

Download Full-text

Limits and Power Laws of Models for the Web Graph and Other Networked Information Spaces

Combinatorial and Algorithmic Aspects of Networking - Lecture Notes in Computer Science ◽

10.1007/11527954_5 ◽

2005 ◽

pp. 42-48 ◽

Cited By ~ 1

Author(s):

Anthony Bonato ◽

Jeannette Janssen

Keyword(s):

Power Laws ◽

Information Spaces ◽

Web Graph ◽

The Web

Download Full-text

Invited Talk: The Many Wonders of the Web Graph

Combinatorial and Algorithmic Aspects of Networking - Lecture Notes in Computer Science ◽

10.1007/11527954_14 ◽

2005 ◽

pp. 154-154

Author(s):

Andrei Broder

Keyword(s):

Web Graph ◽

The Many ◽

The Web

Download Full-text

Introduction

Modern Applications of Graph Theory ◽

10.1093/oso/9780198856740.003.0001 ◽

2021 ◽

pp. 1-36

Author(s):

Vadim Zverovich

Keyword(s):

Graph Theory ◽

Biological Networks ◽

Real Life ◽

Scale Free ◽

Graph Theoretic ◽

Life Problems ◽

Scale Free Networks ◽

Web Graph ◽

The Web

This chapter gives a brief overview of selected applications of graph theory, many of which gave rise to the development of graph theory itself. A range of such applications extends from puzzles and games to serious scientific and real-life problems, thus illustrating the diversity of applications. The first section is devoted to the six earliest applications of graph theory. The next section introduces so-called scale-free networks, which include the web graph, social and biological networks. The last section describes a number of graph-theoretic algorithms, which can be used to tackle a number of interesting applications and problems of graph theory.

Download Full-text