08 - Midterm Overview of Text Retrieval (Lecture for...

Info iconThis preview shows pages 1–3. Sign up to view the full content.

View Full Document Right Arrow Icon
1 Overview of Text Retrieval (Lecture for CSE671: Intro. to DB Systems II) Feb. 8, 2008 Hui Fang Department of Computer Science and Engineering The Ohio State University Midterm Average: 80 Thanks for returning the survey! Deadline for regrade: Feb. 13, 2008. Test Your Understanding How many queries are there per day to a major search engine? Hundreds of millions How much data is in the index of a major search engine? How many computers act as servers for a major search engine? Hundreds of thousands, maybe millions What is a Petabyte? It is 10 million gigabytes Standard Web Search Engine Architecture Search engine servers user query Show results To user Slide adapted from Lew & Davis How Search Engines Work Gather the contents of all web pages (using a program called a crawler or spider ) Organize the contents of the pages in a way that allows efficient retrieval ( indexing ) Take in a query, determine which pages match, and show the results ( ranking and display of results) Three main parts:
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
2 Standard Web Search Engine Architecture crawl the web Create an inverted index Check for duplicates, store the documents Inverted index Search engine servers DocIds Crawler machines Standard Web Search Engine Architecture crawl the web Create an inverted index Check for duplicates, store the documents Inverted index Search engine servers user query Show results To user DocIds Crawler machines Lecture Plan What is text retrieval (TR) ?
Background image of page 2
Image of page 3
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 04/13/2010 for the course CSE 671 taught by Professor Hakanferhatosmanoglu during the Winter '06 term at Ohio State.

Page1 / 5

08 - Midterm Overview of Text Retrieval (Lecture for...

This preview shows document pages 1 - 3. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online