5-10.1597.pdf - 3134 Searching the Web Asia Beijing...

This preview shows page 1 - 2 out of 4 pages.

3134 - Searching the Web Asia - Beijing - 2004/2005 The word search engine may not be strange to you. Generally speaking, a search engine searches the web pages available in the Internet, extracts and organizes the information and responds to users queries with the most relevant pages. World famous search engines, like GOOGLE, have become very important tools for us to use when we visit the web. Such conversations are now common in our daily life: What does the word like ****** mean? Um I am not sure, just google it. In this problem, you are required to construct a small search engine. Sounds impossible, does it? Don t worry, here is a tutorial teaching you how to organize large collection of texts efficiently and respond to queries quickly step by step. You don t need to worry about the fetching process of web pages, all the web pages are provided to you in text format as the input data. Besides, a lot of queries are also provided to validate your system. Modern search engines use a technique called inversion for dealing with very large sets of documents. The method relies on the construction of a data structure, called an inverted index, which associates terms (words) to their occurrences in the collection of documents. The set of terms of interest is called the vocabulary, denoted as V. In its simplest form, an inverted index is a dictionary where each search key is a term V. The associated value b( ) is a pointer to an additional intermediate data structure, called a bucket. The bucket associated with a certain term is essentially a list of pointers marking all the occurrences of in the text collection. Each entry in each bucket simply consists of the document identifier (DID), the ordinal number of
Image of page 1

Subscribe to view the full document.

Image of page 2
  • Fall '09
  • TAOLI
  • Algorithms, Searching, World Wide Web, don t, inverted index

{[ snackBarMessage ]}

Get FREE access by uploading your study materials

Upload your study materials now and get free access to over 25 million documents.

Upload now for FREE access Or pay now for instant access
Christopher Reinemann
"Before using Course Hero my grade was at 78%. By the end of the semester my grade was at 90%. I could not have done it without all the class material I found."
— Christopher R., University of Rhode Island '15, Course Hero Intern

Ask a question for free

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern