syscontrol

syscontrol - 3D User Interface System 3D Control Techniques...

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: 3D User Interface System 3D Control Techniques Lecture #10: System Control Spring 2008 Joseph J. LaViola Jr. Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Universal 3D Interaction Tasks Navigation Navigation Travel – motor component Travel Wayfinding – cognitive component Wayfinding Selection Selection Manipulation Manipulation System control System Symbolic input Symbolic Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 1 System Control Often considered glue of 3D UI Often Specify the “what” Specify Commands are issued to Commands request system to perform a particular request function change interaction mode change change system state change Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Human Factors and System Control Learn from mechanical systems Learn transfer of mechanical energy/information to system transfer control-body linkage controlinteraction between control device and human body interaction Effectiveness of control-body linkage Effectiveness human experience, training human shape and size of control shape visual representation and labeling visual methods of selection methods Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 2 Classification Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Graphical Menus – Adapted 2D Menus Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 3 Graphical Menus – 1-DOF Menus Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Graphical Menus – TULIP Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 4 Graphical Menus – 3D Widgets (1) Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Graphical Menus – 3D Widgets (2) Command and Control Cube Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 5 Graphical Menus – Design Placement Placement world-referenced (freely in world) worldobject-referenced (centered to object in world) objecthead-referenced (view centered) headbody-referenced bodydevice-centered device- Selection Selection Degrees of freedom, constraints Degrees Representation and structure Representation form, size, space, affordance form, hierarchy: functional and semantic grouping, context hierarchy: sensitivity, control coding Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Voice Commands Speech recognition Speech Spoken dialogue techniques Spoken Requires Requires speech recognition engine speech speaker dependent vs. independent speaker varying vocabulary size varying good microphone good Invisible to the user Invisible Push to talk Push Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality CAP6938 ©Joseph J. LaViola Jr. 6 Gestural Commands One of the first system control techniques One Posture – static hand configuration Posture Gesture – dynamic movement Gesture Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Gesture Command Types Speech connected Speech Mimic gestures Mimic Symbolic Symbolic Sign language Sign Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 7 Tools Provide directness of interaction Provide Familiar (real-world devices) Familiar Physical tools Physical real physical objects (props) real may have graphical representation may Virtual tools Virtual Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Tools – Virtual Tool belt Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 8 Tools – Tricorder Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Tools – TUI Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 9 Multimodal System Control More than one input modality (speech, More gesture, facial expression, etc…) Advantages Advantages decoupling decoupling flexibility and complementary behavior flexibility control of mental resources control Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Multimodal Interaction – Examples Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 10 Next Class Symbolic Input Symbolic Readings Readings 3DUI Book – Chapter 8 3DUI Spring 2008 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 11 ...
View Full Document

Ask a homework question - tutors are online