EmotionSense - EmotionSense What? EmotionSense gathers...

Info iconThis preview shows pages 1–7. Sign up to view the full content.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: EmotionSense What? EmotionSense gathers participants emotions as well as proximity and patterns of conversation by processing the outputs from the sensors of off-the-shelf Smartphone Why? Can be used to understand the correlation and the impact of interactions and activities on the emotions and behavior of individuals How ? Designed two novel subsystems for emotion detection and speaker recognition built on a mobile phone platform. A programmable adaptive system with declarative rules. Abstract Phones used as tool for conducting social and psychological experiments in an unobtrusive way Key characteristics include the ability of sensing individual emotions as well as activities, verbal and proximity interactions among members of social groups. The system is programmable by means of a declarative language that can be used to express adaptive rules to improve power saving Shows how speakers and participants emotions can be automatically detected by means of classifiers running locally on off-the-shelf mobile phones Evaluated and deploys system prototype on Nokia Symbian phones Challenges Efficient algorithm Efficient inference algorithms needs to be exploited to extract high- level information from the available raw data of not always accurate sensors embedded in mobile phones Power consumption An efficient system for this class of resource-constrained devices (especially in terms of power consumption) needs to be devised Easily programmable System should be easily programmable and customizable for different types of experiments with changing requirements System Overview Sensor Monitors Speaker and Emotion Recognition Monitor This monitor is responsible for speaker and emotion recognition. It records audio samples with a variable sampling interval. Each sample is processed to extract speaker and emotion information by comparing it against a set of preloaded emotion and speaker- dependent models, collected offline during the setup phase of the system The speaker recognition component also includes a silence model....
View Full Document

This note was uploaded on 08/25/2011 for the course EEL 6788 taught by Professor Boloni,l during the Spring '08 term at University of Central Florida.

Page1 / 22

EmotionSense - EmotionSense What? EmotionSense gathers...

This preview shows document pages 1 - 7. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online