224s.09.lec18

224s.09.lec18 - CS 224S/LING 281 Speech Recognition Synthesis and Dialogue Dan Jurafsky Lecture 18 Emotion In the last 20 years • A huge body of

Info iconThis preview shows pages 1–18. Sign up to view the full content.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: CS 224S/LING 281 Speech Recognition, Synthesis, and Dialogue Dan Jurafsky Lecture 18: Emotion In the last 20 years • A huge body of research on cognition and emotion • Just one quick pointer: Ekman: basic emotions: Disgust Anger Fear Happiness Surprise Sadness Slide from Harinder Aujla Ekman’s 6 basic emotions Surprise, happiness, anger, fear, disgust, sadness Why Emotion Detection from Speech? • Detecting frustration of callers to a help line • Detecting stress in drivers or pilots • Detecting “interest”, “certainty”, “confusion” in on-line tutors Pacing/Positive feedback • Synthesizing emotion for text-to-speech On-line literacy tutors in the children’s storybook domain • Lie detection Some systems • Detecting acted emotions, holding words constant Hirschberg EPSaT corpus • Detecting frustration of callers to appointment schedulers or call centers Ang et al 2002 • Detecting “interest”, “certainty”, “confusion” in on-line tutors Kate Forbes and Diane Litman. In press. Recognizing Student Emotions and Attitudes on the Basis of Utterances (with Diane Litman), Speech Communication. Pon-Barry • Synthesizing emotion for text-to-speech Eide et al Text Pennebaker Livejournal.com Study: I, me, my o30-n5 o16-o22 o2-o8 s 24 s 22 s 20 s 18 s 16 s 14 s 12 B 7.2 7.0 6.8 6.6 6.4 6.2 6.0 5.8 Pennebaker September 11 LiveJournal.com study: We, us, our o30-n5 o16-o22 o2-o8 s 24 s 22 s 20 s 18 s 16 s 14 s 12 B 1.1 1.0 .9 .8 .7 .6 .5 Pennebaker LiveJournal.com study: Positive and negative emotion words 04/22/11 11 Personality • Mairesse & Walker ’07 PERSONAGE ( PERSONAlity GEnerator ) ‘ Big 5’ personality trait model : extroversion, neuroticism, agreeableness, conscientiousness, openness to experience Attempts to generate “extroverted” language based on traits associated with extroversion in psychology literature Demo: http://mi.eng.cam.ac.uk/~farm2/personality/demo.htm : find your personality type 04/22/11 12 Speech Data and tasks for Emotion Detection • Scripted speech Acted emotions, often using 6 emotions Controls for words, focus on acoustic/prosodic differences Features: F0/pitch Energy speaking rate • Spontaneous speech More natural, harder to control Dialogue Kinds of emotion focused on: frustration, annoyance, certainty/uncertainty “activation/hot spots” Slide from Jackson Liscombe Example 1: Emotional Prosody Speech and Transcripts Corpus (EPSaT) • Collected by Julia Hirschberg, Jennifer Venditti at Columbia University • 8 actors read short dates and numbers in 15 emotional styles Slide from Jackson Liscombe happy sad angry confident frustrated friendly interested anxious bored encouraging EPSaT Examples Detecting EPSaT Emotions • Liscombe et al 2003 Slide from Jackson Liscombe...
View Full Document

This note was uploaded on 04/21/2011 for the course CS 224 taught by Professor De during the Spring '11 term at Kentucky.

Page1 / 66

224s.09.lec18 - CS 224S/LING 281 Speech Recognition Synthesis and Dialogue Dan Jurafsky Lecture 18 Emotion In the last 20 years • A huge body of

This preview shows document pages 1 - 18. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online