{[ promptMessage ]}

Bookmark it

{[ promptMessage ]}

# lect1102h - Hand Gesture Recognition Seven Gestures 1...

This preview shows pages 1–11. Sign up to view the full content.

1 Hand Gesture Recognition Seven Gestures

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
2 Gesture Phases • Hand fixed in the start position . • Fingers or hand move smoothly to gesture position . • Hand fixed in gesture position . • Fingers or hand return smoothly to start position. Finite State Machine
3 Main Steps • Detect fingertips. • Create fingertip trajectories using motion correspondence of fingertip points. • Fit vectors and assign motion code to unknown gesture. • Match Detecting Fingertips

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
4 Proximal Uniformity Constraint • Most objects in the real world follow smooth paths and cover small distance in a small time. – Given a location of point in a frame, its location in the next fame lies in the proximity of its previous location. – The resulting trajectories are smooth and uniform. Proximal Uniformity Constraint X p X r X q
5 Proximal Uniformity Constraint Establish correspondence by minimizing : ∑∑ ∑∑ = = + + = = + - + - + - + - - = m x m z k z k y k r k q m x m z k z k y k y k x k r k q k q k p k r k q k p X X X X X X X X X X X X X X X 1 1 1 1 1 1 1 1 1 1 1 1 || || || || || | || || ) , , ( d Greedy Algorithm For k=2 to n-1 do Construct M, an mxm matrix, with the points from k-th frame along the rows and points from (k+1)-th frame along the columns. Let when • for a=1 to m do – Identify the minimum element in each row i of M – Compute priority matrix , B, such that for each i . Select pair with highest priority value and make Mask row i and column from M . ) , , ( ] , [ 1 1 + - = k r k q k p X X X j i M d ] , [ i l i = = + = m i k k i m l j j i l k M j i M l i B i , 1 , 1 ] , [ ] , [ ] , [ ] , [ i l i i k l i = ) ( f i l

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
6 Example = 2 . 7 . 3 . 6 . M = 1 8 . B Vector Extraction
7 Vector Representation of Gestures Results

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
8 Action Recognition Using Temporal Templates Jim Davis and Aaron Bobick Main Points • Compute a sequence of difference pictures from a sequence of images. • Compute Motion Energy Images (MEI) and Motion History Images (MHI) from difference pictures. • Compute Hu moments of MEI and MHI. • Perform recognition using Hu moments.
9 MEI and MHI ) , , ( ) , , ( 1 0 i t y x D t y x E i - = - = t t U - - = = otherwise t y x H t y x D if t y x H ) 1 ) 1 , , ( , 0 max( 1 ) , , ( ) , , ( t t t Motion-Energy Images (MEI ) Motion History Images (MHI) Difference Pictures MEIs

This preview has intentionally blurred sections. Sign up to view the full version.

View Full Document
10 Color MHI Demo Main Points Use seven Hu moments of MHI and MEI to recognize different exercises. Use seven views (-90 degrees to +90 degrees in increments
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

### Page1 / 32

lect1102h - Hand Gesture Recognition Seven Gestures 1...

This preview shows document pages 1 - 11. Sign up to view the full document.

View Full Document
Ask a homework question - tutors are online