Lecture-16.ppt - Monitoring Human Behavior Lecture-16...

Info iconThis preview shows pages 1–18. Sign up to view the full content.

View Full Document Right Arrow Icon
Monitoring Human Behavior Lecture-16 Monitoring Human Behavior http://www.cs.ucf.edu/~vision/projects/Office/Office.html
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Goals of the System • Recognize human actions in a room for which prior knowledge is available. • Handle multiple people • Provide a textual description of each action • Extract “key frames” for each action Possible Actions Enter Leave Sitting or Standing Picking Up Object Put Down Object …..
Background image of page 2
Prior Knowledge • Spatial layout of the scene: – Location of entrances and exits – Location of objects and some information about how they are use • Context can then be used to improve recognition and save computation Layout of Scene 1
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Layout of Scene 2 Layout of Scene 4
Background image of page 4
Major Components • Skin Detection • Tracking • Scene Change Detection • Action Recognition Start End Standing Sitting Near Cabinet Near Terminal Using Terminal Enter Sit Leave Use Terminal Near Phone Talking on Phone Hanging Up Phone Pick Up Phone Put Down Phone Stand Opening/Closing Cabinet Open / Close Cabinet Sit / 0 Stand / 0 State Model For Action Recognition
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Flow of the System Skin Detection Track people and Objects for this Frame Scene Change Detection Update States, Output Text, Output Key Frames Determine Possible Interactions Between People and Objects Key Frames • Why get key frames? – Key frames take less space to store – Key frames take less time to transmit – Key frames can be viewed more quickly • We use heuristics to determine when key frames are taken – Some are taken before the action occurs – Some are taken after the action occurs
Background image of page 6
Key Frames • “Enter” key frames : as the person leaves the entrance/exit area • “Leave” key frames : as the person enters the entrance/exit area • “Standing/Sitting” key frames : after the tracking box has stopped moving up or down respectively • “Open/Close” key frames : when the % of changed pixels stabilizes
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Key Frames Sequence 1 (350 frames), Part 1 Key Frames Sequence 1 (350 frames), Part 2
Background image of page 8
Key Frames Sequence 2 (200 frames)
Background image of page 9

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Key Frames Sequence 3 (200 frames)
Background image of page 10
Key Frames Sequence 4 (399 frames), Part 1
Background image of page 11

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Key Frames Sequence 4 (399 frames), Part 2
Background image of page 12
Action Recognition
Background image of page 13

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Approaches • FSA • HMMs/NNs • Rule-based • --- • Representation is important FSA: Hand Gesture Recognition
Background image of page 14
FSA: Hand Gesture Recognition Hunt events
Background image of page 15

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Start End Standing Sitting Near Cabinet Near Terminal Using Terminal Enter Sit Leave Use Terminal Near Phone Talking on Phone Hanging Up Phone Pick Up Phone Put Down Phone Stand Opening/Closing Cabinet Open / Close Cabinet Sit / 0 Stand / 0 FSA: Recognizing Human Behavior in Office Environment Rule-Based: Detecting Violence
Background image of page 16
Rule-Based: Detecting Violence Rule-Based: Recognizing Outdoor Activities
Background image of page 17

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 18
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 06/12/2011 for the course CAP 6411 taught by Professor Shah during the Spring '09 term at University of Central Florida.

Page1 / 35

Lecture-16.ppt - Monitoring Human Behavior Lecture-16...

This preview shows document pages 1 - 18. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online