lect1102h - Hand Gesture Recognition Seven Gestures 1...

Info iconThis preview shows pages 1–11. Sign up to view the full content.

View Full Document Right Arrow Icon
1 Hand Gesture Recognition Seven Gestures
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
2 Gesture Phases • Hand fixed in the start position . • Fingers or hand move smoothly to gesture position . • Hand fixed in gesture position . • Fingers or hand return smoothly to start position. Finite State Machine
Background image of page 2
3 Main Steps • Detect fingertips. • Create fingertip trajectories using motion correspondence of fingertip points. • Fit vectors and assign motion code to unknown gesture. • Match Detecting Fingertips
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
4 Proximal Uniformity Constraint • Most objects in the real world follow smooth paths and cover small distance in a small time. – Given a location of point in a frame, its location in the next fame lies in the proximity of its previous location. – The resulting trajectories are smooth and uniform. Proximal Uniformity Constraint X p X r X q
Background image of page 4
5 Proximal Uniformity Constraint Establish correspondence by minimizing : ∑∑ ∑∑ = = + + = = + - + - + - + - - = m x m z k z k y k r k q m x m z k z k y k y k x k r k q k q k p k r k q k p X X X X X X X X X X X X X X X 1 1 1 1 1 1 1 1 1 1 1 1 || || || || || | || || ) , , ( d Greedy Algorithm For k=2 to n-1 do Construct M, an mxm matrix, with the points from k-th frame along the rows and points from (k+1)-th frame along the columns. Let when • for a=1 to m do – Identify the minimum element in each row i of M – Compute priority matrix , B, such that for each i . Select pair with highest priority value and make Mask row i and column from M . ) , , ( ] , [ 1 1 + - = k r k q k p X X X j i M d ] , [ i l i = = + = m i k k i m l j j i l k M j i M l i B i , 1 , 1 ] , [ ] , [ ] , [ ] , [ i l i i k l i = ) ( f i l
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
6 Example = 2 . 7 . 3 . 6 . M = 1 8 . B Vector Extraction
Background image of page 6
7 Vector Representation of Gestures Results
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
8 Action Recognition Using Temporal Templates Jim Davis and Aaron Bobick Main Points • Compute a sequence of difference pictures from a sequence of images. • Compute Motion Energy Images (MEI) and Motion History Images (MHI) from difference pictures. • Compute Hu moments of MEI and MHI. • Perform recognition using Hu moments.
Background image of page 8
9 MEI and MHI ) , , ( ) , , ( 1 0 i t y x D t y x E i - = - = t t U - - = = otherwise t y x H t y x D if t y x H ) 1 ) 1 , , ( , 0 max( 1 ) , , ( ) , , ( t t t Motion-Energy Images (MEI ) Motion History Images (MHI) Difference Pictures MEIs
Background image of page 9

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
10 Color MHI Demo Main Points Use seven Hu moments of MHI and MEI to recognize different exercises. Use seven views (-90 degrees to +90 degrees in increments
Background image of page 10
Image of page 11
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 06/12/2011 for the course CAP 6411 taught by Professor Shah during the Spring '09 term at University of Central Florida.

Page1 / 32

lect1102h - Hand Gesture Recognition Seven Gestures 1...

This preview shows document pages 1 - 11. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online