sketch_understanding - Multi-Domain Sketch Recognition...

Info iconThis preview shows pages 1–6. Sign up to view the full content.

View Full Document Right Arrow Icon
1 Fall 2008 CAP 6938 – Topics in Pen-Based User Interfaces ©Joseph J. LaViola Jr. Multi-Domain Sketch Recognition Lecture #11: Sketch Understanding Joseph J. LaViola Jr. Fall 2008 Slides adapted from Alvarado, Multi-Domain Sketch Understanding, SIGGRAPH course #3, 2007. Fall 2008 CAP 6938 – Topics in Pen-based User Interfaces ©Joseph J. LaViola Jr. Recall Pen-Based Interface Dataflow Raw Stroke Data Preprocessing Segmentation Feature Extraction And Analysis Classification Ink Parsing Sketch Understanding Make Inferences
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
2 Fall 2008 CAP 6938 – Topics in Pen-based User Interfaces ©Joseph J. LaViola Jr. Building Recognition Systems Mechanical Engineering UML Electrical Engineering Strokes Strokes Strokes ± Building each system requires: ² sketch recognition expertise ² a lot of time (2-5 person years!) ² built in domain assumptions to improve recognition Domain Shapes Domain Shapes Domain Shapes Fall 2008 CAP 6938 – Topics in Pen-based User Interfaces ©Joseph J. LaViola Jr. A Multi-Domain Sketch Recognition Engine Mechanical Engineering UML Electrical Engineering Strokes Strokes Strokes Domain Shapes Domain Shapes Domain Shapes General Recognition Engine Shape descriptions Strokes Domain Shapes
Background image of page 2
3 Fall 2008 CAP 6938 – Topics in Pen-based User Interfaces ©Joseph J. LaViola Jr. Enabling Natural Interaction ± Goal: ² recognition engines for multiple domains ± Core challenge: ² multi-domain recognition Fall 2008 CAP 6938 – Topics in Pen-based User Interfaces ©Joseph J. LaViola Jr. Sketch Recognition Subtasks Stroke Fragmentation Stroke grouping Symbol recognition NOR ± Need a multi-domain solution!
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
4 Fall 2008 CAP 6938 – Topics in Pen-based User Interfaces ©Joseph J. LaViola Jr. Shape Descriptions Generalized Matching Engine Post Processor Primitive Recognizer/Fragmenter Strokes Recognized Objects Line, Ellipse, Arc, Polyline Multi-Domain Sketch Recognition Architecture Multi-Domain Sketch Recognition Architecture Fall 2008 CAP 6938 – Topics in Pen-based User Interfaces ©Joseph J. LaViola Jr. Shape Descriptions Generalized Matching Engine Post Processor Primitive Recognizer/Fragmenter Strokes Recognized Objects Line, Ellipse, Arc, Polyline Multi-Domain Sketch Recognition Architecture Multi-Domain Sketch Recognition Architecture
Background image of page 4
5 Fall 2008 CAP 6938 – Topics in Pen-based User Interfaces ©Joseph J. LaViola Jr. ± Compound: ± Domain: ± Domain Patterns: Family Tree Domain Divorce-link Marriage-link Child-link Male Female Divorce Parent-Child Partnership Marriage Quadrilateral Arrow Fall 2008 CAP 6938 – Topics in Pen-based User Interfaces ©Joseph J. LaViola Jr. Subshapes Knowledge Representation (LADDER [Hammond03] ) (Define Arrow ( Subshapes (Line shaft) (Line head1) (Line head2)) ( Constraints (coincident shaft.p1 head1.p1) (coincident shaft.p1 head2.p1) (equalLength head1 head2) (smaller head1 shaft) (acuteAngle head1 shaft) (acuteAngle head2 shaft))) shaft head1 head2 Shape defined by Constraints
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 6
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 06/13/2011 for the course CAP 6938 taught by Professor Staff during the Spring '08 term at University of Central Florida.

Page1 / 17

sketch_understanding - Multi-Domain Sketch Recognition...

This preview shows document pages 1 - 6. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online