class_08_24 - Statistical Data Mining ORIE 474 Fall 2007...

Info iconThis preview shows pages 1–5. Sign up to view the full content.

View Full Document Right Arrow Icon
Statistical Data Mining ORIE 474 Fall 2007 Tatiyana Apanasovich 08/24/07
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Background image of page 2
What is Data Mining Originally, “data mining" was a statistician's term for overusing data to draw invalid inferences. Bonferroni's theorem warns us that if there are too many possible conclusions to draw, some will be true for purely statistical reasons, with no physical validity. Famous example: David Rhine, a “parapsychologist" at Duke in the 1950's tested students for “ex-trasensory perception" by asking them to guess 10 cards, red or black. He found about 1/1000 of them guessed all 10, and instead of realizing that that is what you'd expect from random guessing, declared them to have ESP. When he retested them, he found they did no better than average. His conclusion: telling people they have ESP causes them to lose it!
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
What is Data Mining? The process of identifying hidden patterns, trends and relationships in data (Groth) The process of exploration and analysis, by automatic or semiautomatic means, of large quantities of data in order to discover meaningful The analysis of (often large) observational data sets to find unsuspected relationships and to
Background image of page 4
Image of page 5
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 12/23/2009 for the course ORIE 474 taught by Professor Apanasovich during the Spring '07 term at Cornell University (Engineering School).

Page1 / 12

class_08_24 - Statistical Data Mining ORIE 474 Fall 2007...

This preview shows document pages 1 - 5. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online