spelling

000021 pwhoseactress 0010 pacrossversatile 000021

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: ing a bigram language model •  “a stellar and versatile acress whose combination of sass and glamour…”! •  Counts from the Corpus of Contemporary American English with add ­1 smoothing •  P(actress|versatile)=.000021 P(whose|actress) = .0010! •  P(across|versatile) =.000021 P(whose|across) = .000006! •  P(“versatile actress whose”) = .000021*.0010 = 210 x10-10! •  P(“versatile across whose”) = .000021*.000006 = 1 x10-10! 28 Dan Jurafsky Using a bigram language model •  “a stellar and versatile acress whose combination of sass and glamour…”! •  Counts from the Corpus of Contemporary American English with add ­1 smoothing •  P(actress|versatile)=.000021 P(whose|actress) = .0010! •  P(across|versatile) =.000021 P(whose|across) = .000006! •  P(“versatile actress whose”) = .000021*.0010 = 210 x10-10! •  P(“versatile across whose”) = .000021*.000006 = 1 x10-10! 29 Dan Jurafsky Evalua'on •  Some spelling error test sets •  •  •  •  30 Wikipedia’s list of common English misspelling Aspell filtered version of that list Birkbeck spelling error corpus Peter Norvig’s list of errors (includes Wikipedia and Birkbeck, for training or tes/ng) Spelling Correction and the Noisy Channel The Noisy Channel Model of Spelling Spelling Correction and the Noisy Channel Real ­Word Spelling Correc/on Dan Ju...
View Full Document

Ask a homework question - tutors are online