{[ promptMessage ]}

Bookmark it

{[ promptMessage ]}

Lecture-16 - Monitoring Human Behavior Lecture-16...

Info icon This preview shows pages 1–18. Sign up to view the full content.

View Full Document Right Arrow Icon
Monitoring Human Behavior Lecture-16 Monitoring Human Behavior http://www.cs.ucf.edu/~vision/projects/Office/Office.html
Image of page 1

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Goals of the System Recognize human actions in a room for which prior knowledge is available. Handle multiple people Provide a textual description of each action Extract “key frames” for each action Possible Actions Enter Leave Sitting or Standing Picking Up Object Put Down Object …..
Image of page 2
Prior Knowledge Spatial layout of the scene: – Location of entrances and exits – Location of objects and some information about how they are use Context can then be used to improve recognition and save computation Layout of Scene 1
Image of page 3

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Layout of Scene 2 Layout of Scene 4
Image of page 4
Major Components Skin Detection • Tracking Scene Change Detection • Action Recognition Start End Standing Sitting Near Cabinet Near Terminal Using Terminal Enter Sit Leave Use Terminal Near Phone Talking on Phone Hanging Up Phone Pick Up Phone Put Down Phone Stand Opening/Closing Cabinet Open / Close Cabinet Sit / 0 Stand / 0 State Model For Action Recognition
Image of page 5

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Flow of the System Skin Detection Track people and Objects for this Frame Scene Change Detection Update States, Output Text, Output Key Frames Determine Possible Interactions Between People and Objects Key Frames Why get key frames? – Key frames take less space to store – Key frames take less time to transmit – Key frames can be viewed more quickly We use heuristics to determine when key frames are taken – Some are taken before the action occurs – Some are taken after the action occurs
Image of page 6
Key Frames “Enter” key frames : as the person leaves the entrance/exit area “Leave” key frames : as the person enters the entrance/exit area “Standing/Sitting” key frames : after the tracking box has stopped moving up or down respectively “Open/Close” key frames : when the % of changed pixels stabilizes
Image of page 7

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Key Frames Sequence 1 (350 frames), Part 1 Key Frames Sequence 1 (350 frames), Part 2
Image of page 8
Key Frames Sequence 2 (200 frames)
Image of page 9

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
1 Key Frames Sequence 3 (200 frames)
Image of page 10
1 Key Frames Sequence 4 (399 frames), Part 1
Image of page 11

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
1 Key Frames Sequence 4 (399 frames), Part 2
Image of page 12
1 Action Recognition
Image of page 13

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
1 Approaches • FSA • HMMs/NNs • Rule-based • --- Representation is important FSA: Hand Gesture Recognition
Image of page 14
1 FSA: Hand Gesture Recognition Hunt events
Image of page 15

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
1 Start End Standing Sitting Near Cabinet Near Terminal Using Terminal Enter Sit Leave Use Terminal Near Phone Talking on Phone Hanging Up Phone Pick Up Phone Put Down Phone Stand Opening/Closing Cabinet Open / Close Cabinet Sit / 0 Stand / 0 FSA: Recognizing Human Behavior in Office Environment Rule-Based: Detecting Violence
Image of page 16
1 Rule-Based: Detecting Violence Rule-Based: Recognizing Outdoor Activities
Image of page 17

Info icon This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Image of page 18
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}