Optimized Inverted List Assignment in Distributed Search Engine Architectures

2007 ◽  
Author(s):  
Jiangong Zhang ◽  
Torsten Suel
Keyword(s):  
Search Engine ◽  
Distributed Search ◽  
Inverted List

Reliability of a Distributed Search Engine for Fresh Information Retrieval in Large-Scale Intranet

2006 ◽  
pp. 203-216
Author(s):  
Nobuyoshi Sato ◽  
Minoru Udagawa ◽  
Minoru Uehara ◽  
Yoshifumi Sakai ◽  
Hideki Mori
Keyword(s):  
Information Retrieval ◽  
Search Engine ◽  
Large Scale ◽  
Distributed Search

scholarly journals Knowledge Graph Construction and Applications for Web Search and Beyond

2019 ◽  
Vol 1 (4) ◽  
pp. 333-349 ◽  
Author(s):  
Peilu Wang ◽  
Hao Jiang ◽  
Jingfang Xu ◽  
Qi Zhang
Keyword(s):  
Search Engine ◽  
Intelligent Systems ◽  
Large Scale ◽  
Web Search ◽  
Question Answering ◽  
Knowledge Graph ◽  
Graph Databases ◽  
Distributed Search ◽  
Knowledge Based ◽  
Dialog System

Knowledge graph (KG) has played an important role in enhancing the performance of many intelligent systems. In this paper, we introduce the solution of building a large-scale multi-source knowledge graph from scratch in Sogou Inc., including its architecture, technical implementation and applications. Unlike previous works that build knowledge graph with graph databases, we build the knowledge graph on top of SogouQdb, a distributed search engine developed by Sogou Web Search Department, which can be easily scaled to support petabytes of data. As a supplement to the search engine, we also introduce a series of models to support inference and graph based querying. Currently, the data of Sogou knowledge graph that are collected from 136 different websites and constantly updated consist of 54 million entities and over 600 million entity links. We also introduce three applications of knowledge graph in Sogou Inc.: entity detection and linking, knowledge based question answering and knowledge based dialog system. These applications have been used in Web search products to help user acquire information more efficiently.

Analysis of Distributed Computing Architecture Search Principle Based on Hadoop

2014 ◽  
Vol 519-520 ◽  
pp. 54-57
Author(s):  
Ai Ling Duan ◽  
Dan Cao ◽  
Hai Fang Si
Keyword(s):  
Distributed Computing ◽  
Search Engine ◽  
Distributed Processing ◽  
Data Handling ◽  
Distributed Search ◽  
Time And Space ◽  
Positive Role ◽  
Computing Architecture ◽  
Engine System ◽  
Processing Architecture

Distributed search techniques of Hadoop are researched and analyzed. Combined with Lucene indexing objects, a search engine system IS successfully built. Efficiency of the system in both time and space is investigated. Merit of distributed processing architecture for a single architecture in data handling is verified. The access and update of file information in distributed search technology are further explored. The research plays a positive role in promoting study of related fields

Redundancy of meta search servers in a distributed search engine

2003 ◽  
Author(s):  
N. Sato ◽  
M. Udagawa ◽  
M. Uehara ◽  
Y. Sakai ◽  
H. Mori
Keyword(s):  
Search Engine ◽  
Distributed Search ◽  
Meta Search

scholarly journals A Framework for Privacy Preserving, Distributed Search Engine Using Topology of DLT and Onion Routing

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 43001-43012
Author(s):  
Ali Raza ◽  
Kyunghyun Han ◽  
Seong Oun Hwang
Keyword(s):  
Search Engine ◽  
Privacy Preserving ◽  
Distributed Search ◽  
Onion Routing

Design and Implementation of a Cache System in Web Search Engines

2013 ◽  
Vol 462-463 ◽  
pp. 1106-1109
Author(s):  
Hong Yuan Ma
Keyword(s):  
Search Engine ◽  
Search Engines ◽  
Web Search ◽  
Communication Architecture ◽  
Design And Implementation ◽  
Web Search Engine ◽  
Inverted List ◽  
Web Search Engines ◽  
Application Processor ◽  
Cache System

Web search engine caches the results which is frequently queried by users. It is an effective approach to improve the efficiency of Web search engines. In this paper, we give some valuable experience in our design and implementation of a Web search engine cache system. We present there design principles: logical layer processing, event-based communication architecture and avoiding frequent data copy. We also introduce the architecture presented in practice, including connection processor, application processor, query results caching processor, inverted list caching processor and list intersection caching processor. Experiments are conducted in our cache system using a real Web search engine query log.

Design of distributed search engine system for apparel based on semantic Web services

2009 ◽  
Vol 29 (6) ◽  
pp. 1601-1604 ◽  
Author(s):  
Ge-fu ZHANG ◽  
Qi XU
Keyword(s):  
Web Services ◽  
Semantic Web ◽  
Search Engine ◽  
Semantic Web Services ◽  
Distributed Search ◽  
Engine System
Sign in / Sign up

Export Citation Format

Share Document