syscontrol - 3D User Interface System 3D User Interface...

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: 3D User Interface System 3D User Interface System Control Control Techniques Lecture #12: System Control Spring 2011 Sprin Joseph J. LaViola Jr. Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Universal 3D Interaction Tasks Navigation Travel – motor component Wayfinding – cognitive component Selection Manipulation System control Symbolic input Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 1 System Control Often considered glue of 3D UI considered glue of 3D UI Specify the “what” Commands are issued to request system to perform a particular function change interaction mode change system state Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Human Factors and System Control Learn from mechanical systems from mechanical systems transfer of mechanical energy/information to system controlcontrol-body linkage interaction between control device and human body Effectiveness of control-body linkage control Spring 2011 human experience, training experience, training shape and size of control visual representation and labeling methods of selection CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 2 Classification Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Graphical Menus – Adapted 2D Menus Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 3 Graphical Menus – 1-DOF Menus Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Graphical Menus – TULIP Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 4 Graphical Menus – 3D Widgets (1) Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Graphical Menus – 3D Widgets (2) Command and Control Cube Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 5 Graphical Menus – Design Placement Selection worldworld-referenced (freely in world) object-referenced (centered to object in world) ectheadhead-referenced (view centered) bodybody-referenced devicedevice-centered Degrees of freedom, constraints Representation and structure form, size, space, affordance hierarchy: functional and semantic grouping, context sensitivity, control coding Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Voice Voice Commands Speech recognition Spoken dialogue techniques Requires speech recognition engine speaker dependent vs. independent varying vocabulary size good microphone Invisible to the user Push to talk Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 6 Gestural Commands One of the first system control techniques Posture – static hand configuration Gesture – dynamic movement Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Gesture Command Types Speech connected connected Mimic gestures Symbolic Sign language Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 7 Tools Provide directness of interaction directness of interaction Familiar (real-world devices) (realPhysical tools real physical objects (props) may have graphical representation have graphical representation Virtual tools Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Tools – Virtual Tool belt Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 8 Tools – Tricorder Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Tools – TUI Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 9 Multimodal System Control More than one input modality (speech More than one input modality (speech, gesture, facial expression, etc…) Advantages Spring 2011 decoupling flexibility and complementary behavior control of mental resources CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Multimodal Interaction – Examples Spring 2011 CAP6121 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 10 Next Class 3D UI Design UI Design Readings Spring 2011 3DUI Book – Chapter 8 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 11 ...
View Full Document

This note was uploaded on 08/25/2011 for the course CAP 6121 taught by Professor Lavoilajr. during the Spring '11 term at University of Central Florida.

Ask a homework question - tutors are online