lecture8-evaluation-handout-6-per

863 introducon to informaon retrieval evaluaon at

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: Retrieval Sec. 8.5 Impact of Inter ­judge Agreement   GOV2         Sec. 8.2 Another TREC/NIST collec)on 25 million web pages Largest collec)on that is easily available But s)ll 3 orders of magnitude smaller than what Google/ Yahoo/MSN index   NTCIR   East Asian language and cross ­language informa)on retrieval   Cross Language Evalua)on Forum (CLEF)   This evalua)on series has concentrated on European languages and cross ­language informa)on retrieval.   Impact on absolute performance measure can be significant (0.32 vs 0.39)   LiUle impact on ranking of different systems or rela)ve performance   Suppose we want to know if algorithm A is beUer than algorithm B   A standard informa)on retrieval experiment will give us a reliable answer to this ques)on.   Many others 33 Introduc)on to Informa)on Retrieval Sec. 8.5.1 34 Introduc)on to Informa)on Retrieval Cri)...
View Full Document

Ask a homework question - tutors are online