lecture03

lecture03 - Information Retrieval Ranking Fernando Diaz...

Info iconThis preview shows pages 1–17. Sign up to view the full content.

View Full Document Right Arrow Icon
Information Retrieval: Ranking Fernando Diaz Yahoo! Labs February 7, 2011 1 / 64
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Outline Introduction to Information Retrieval Vector Space Model PageRank Ranking in Practice 2 / 64
Background image of page 2
Introduction to Information Retrieval 3 / 64
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Information Retrieval given a query and a corpus , Fnd relevant documents . 4 / 64
Background image of page 4
Information Retrieval given a query and a corpus , Fnd relevant documents . query : user’s expression of the information need 4 / 64
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Information Retrieval given a query and a corpus , Fnd relevant documents . query : user’s expression of the information need corpus : the repository of retrievable items 4 / 64
Background image of page 6
Information Retrieval given a query and a corpus , Fnd relevant documents . query : user’s expression of the information need corpus : the repository of retrievable items relevance : satisfaction of the information need 4 / 64
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Examples of Information Retrieval Problems Web Search given a keyword and a web crawl , Fnd relevant URLs . 5 / 64
Background image of page 8
Examples of Information Retrieval Problems Image Search given a keyword and image database , Fnd relevant images . 6 / 64
Background image of page 9

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Examples of Information Retrieval Problems Question Answering given a question and available text, rules, logic , Fnd an answer . 7 / 64
Background image of page 10
Examples of Information Retrieval Problems Job Search given a resume and job advertisements , Fnd relevant jobs . 8 / 64
Background image of page 11

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Examples of Information Retrieval Problems Applicant Search given a advertisement and resumes , Fnd good candidates . 9 / 64
Background image of page 12
History 1950s : early information work in problem deFnition, metrics. 1960s : Gerard Salton begins work on SMART; CranFeld evaluation method deFned. 1970s : information retrieval research community developed (SIGIR); many fundamental concepts proposed (e.g. cluster-based retrieval, pseudo-relevance feedback). 1980s : development of Frst commercial information retrieval systems. 1990s : TREC conferences begin, standardizing evaluation; web search engines developed, using many fundamental IR techniques. 10 / 64
Background image of page 13

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Text REtrieval Conference (TREC) Started in 1992 as a forum to compare IR systems using standard test collections, ensuring reproducibility . Initially focused on ad hoc retrieval (keyword search), the scope has broadened to include multi-lingual retrieval, legal retrieval, and question answering. Allowed for accelerated comparison and testing of algorithmic changes across systems. Resulted in similar forums in Europe (CLEF), Asia (NTCIR), and India (FIRE). 11 / 64
Background image of page 14
IR ̸ = DB DB IR data structured semi-structured felds clear semantics Free text queries structured Free text matching exact imprecise ranking none important based on a table by James Allan 12 / 64
Background image of page 15

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Fundamental Problems in Information Retrieval Research Effectiveness : how well does the system satisfy the user’s information need? algorithms interaction evaluation EfFciency : how ef±ciently does the system satisfy the user’s information need?
Background image of page 16
Image of page 17
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 01/22/2012 for the course CS 6093 taught by Professor Diaz during the Spring '11 term at NYU Poly.

Page1 / 67

lecture03 - Information Retrieval Ranking Fernando Diaz...

This preview shows document pages 1 - 17. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online