Search_engine_result_comparisons

Search_engine_result_comparisons - This time we are going...

This preview shows pages 1–4. Sign up to view the full content.

Section H of the Term Paper: How to compare search engines SET THEORY METHOD S1 S2 S3 S4 A 0 A 0 0 C G 0 0 B 0 A 0 0 F 0 B G E 0 C A 0 0 0 0 0 0 0 D 0 0 D 0 0 B E 0 0 0 Relevant items are marked A, B, C, D, E, F, G How many pairs? 6 S1 + S2, S1 + S3, S1 + S4 S2 + S3, S2+ S4 S3 + S4 S1 S2 / S1 S2 = |{A, B, C, D,}| / |{A, B, C, D, G, E}| If I write this without brackets, how is this wrong? = 4 / 6 = 2 / 3 (as a decimal = .67) There’s your first number. Continue for all of the other pairs.

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
When you are done, make the comparison table: S1 S2 S3 S4 S1 S2 .67 S3 S4 Second Method: Kendall’s Tau-Like Method S1 S2 S3 S4 A A C G B A F B G E C A D D B E We’ve looked at relevant/not-relevant. If we enter our queries into different search engines, and each pulls up the exact same results in exactly the same order, we can say that the search engines are 100% similar. Most people only look at the first few (actually 10) results. This method shows whether the search engines are similar or not.

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: This time we are going to use the same table as above, but I have deleted the zeros (not relevant items) and added lines to make it easier. [HINT: every pair of items has a corresponding pair of lines. If the items of the pair are in different order, the lines cross. So count the crossings, and you have the pairs out of order.] Compare each search engine with another. If there are four engines, how many pairs? (S1, S2), (S1, S3), (S1, S4), (S2, S3), (S2, S4), (S3, S4) For the denominator , how many TOTAL query pairs do we have comparing Set 1 and Set 2? 6x5 / 1x2 (well learn this later), which is equal to 30 / 2, or 15. AB, AC, AD, AG BC, BG, BD CD, CG DG EA, EB, EC, ED, EG Our denominator is 15. For the numerator , we will look at total pairs IN ORDER: AD, AE (What about AB? NO! B is above A in S2). BD, BE CD, CE DE GB, GC [HINT: Pairs in order / Total pairs!]...
View Full Document

This note was uploaded on 02/20/2012 for the course 790 373 taught by Professor Boros during the Fall '09 term at Rutgers.

Page1 / 4

Search_engine_result_comparisons - This time we are going...

This preview shows document pages 1 - 4. Sign up to view the full document.

View Full Document
Ask a homework question - tutors are online