lecture8-evaluation-handout-6-per

Search for you can get high recall but low precision

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: engine classifies each doc as “Relevant” or “Nonrelevant”   The accuracy of an engine: the frac)on of these classifica)ons that are correct Relevant Nonrelevant Retrieved tp fp Not Retrieved fn tn   Precision P = tp/(tp + fp)   Recall R = tp/(tp + fn)   (tp + tn) / ( tp + fp + fn + tn)   Accuracy is a commonly used evalua)on measure in machine learning classifica)on work   Why is this not a very useful evalua)on measure in IR? 11 12 2 Introduc)on to Informa)on Retrieval Sec. 8.3 Why not just use accuracy? Sec. 8.3 Precision/Recall   How to build a 99.9999% accurate search engine on a low budget…. Search for:   You can get high recall (but low precision) by retrieving all docs for all queries!   Recall is a non ­decreasing func)on of the number of docs retrieved   In a good system, precision decreases as either the number of docs retrieved or recall increases 0 matching results found.   People doing informa)on...
View Full Document

This document was uploaded on 02/26/2014.

Ask a homework question - tutors are online