introduction(1) - 3D User Interfaces for Games 3D and...

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: 3D User Interfaces for Games 3D and Virtual Reality Lecture #1: Introduction Spring 2009 Joseph J. LaViola Jr. Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Instructor Professor – Joseph J. LaViola Jr. Email – [email protected] Office Hours – Tues. 4:30pm – 6:30pm Wed. 5:45pm – 6:45pm Office is Harris 321 Website will have all required info www.eecs.ucf.edu/courses/cap6938/spr2009 Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 1 Class Goals Provide in-depth introduction to spatial 3D user Provide interfaces Focus on 3D games Focus Speaking and presentation skills Speaking Start of master’s projects and PhD dissertations Start Possible publications Possible Virtual Reality 2010 Virtual 3D User Interfaces 2010 3D Foundations of Digital Games 2010 Foundations SIGGRAPH Sandbox 2010 SIGGRAPH Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Required Books Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 2 Grading Assignment 1 (group) Assignment 2 (group) GameUI Paper (individual) Paper presentation (individual) Final Project (group) Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality 15% 15% 15% 5% 50% ©Joseph J. LaViola Jr. Final Projects 2-3 person teams Must have research component Must related to games related innovative 3D UI innovative Everyone must write and get approved a Everyone project proposal Final Project write up required Final DEMO DAY!!!! – May 4, 2009 DEMO Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality CAP6938 ©Joseph J. LaViola Jr. 3 Class Structure (see syllabus for details) Lectures Lectures Fundamentals of 3D user interfaces Fundamentals hardware hardware common interaction tasks common user evaluation user Student paper presentation Student 20 minute presentation 20 Final project update sessions Final Work done in ISUE Lab – Harris 208 Work key access required key Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Course Topics XNA Development XNA 3D Hardware 3D perception perception input and output devices input Common 3D Interaction Tasks Common travel (e.g., navigation and wayfinding) travel wayfinding) selection and manipulation selection system control system 3D UI Design 3D 3D UI Evaluation 3D 3D UI and Augmented/Mixed Reality 3D Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 4 Collaboration and Late Policy Collaboration encouraged Collaboration do your own work on assignments do cheating = BAD!!! cheating All assignments must be handed in on All time Assignments – by 11:59pm on due date Assignments Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Tools – Hardware Wii Sensor Bar PC with Intel Quad Core processor Samsung 50’’ 3D DLP HDTV 3GB RAM NVIDIA GT8500 GFX Card TriDef Stereo Emmitter 5.1 Speaker System Wii controllers Spring 2009 TriDef Shutter Glasses CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 5 Tools – More Hardware Natural Point Track IR Wii Balance Board Novint Falcon 3rd Space Gaming Vest Spring 2009 IZ3D Monitor CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Tools – Software Visual Studio 2008, C# Visual Microsoft XNA 3.0 Microsoft basis of development environment basis audio support, vector/matrix tools audio physics engine (external component) physics Bullet (3D) Bullet our version: modified to handle 3D DLP stereo our Custom built XNA components Custom Scenegraph Scenegraph Wii controller API Wii head tracking (TrackIR from Natural Point) head (TrackIR content loader content Google SketchUp Pro Google nice model database nice Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 6 What are 3D UIs? 3D interaction: Human-computer interaction in which the 3D Humanuser’s tasks are carried out in a 3D spatial context ’ user 3D input devices 3D 2D input devices with direct mappings to 3D 2D 3D user interface (3D UI): A UI that involves 3D 3D interaction 3D interaction technique: A method (hardware and 3D software) allowing a user to accomplish a task in a 3D UI Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Why 3D Interfaces? 3D applications should be useful 3D immersion immersion natural skills natural immediacy of visualization immediacy But, applications in common use have low But, complexity of interaction More complex applications have serious usability More problems Technology alone is not the solution! Technology Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 7 What makes 3D interaction difficult? Spatial input Spatial Lack of constraints Lack Lack of standards Lack Lack of tools Lack Spring 2009 Lack of precision Lack Fatigue Fatigue Layout more complex Layout Perception Perception CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Interaction Goals Performance Performance efficiency efficiency accuracy accuracy productivity productivity Usability Usability ease of use ease ease of learning ease user comfort user Usefulness Usefulness interaction helps meet system goals interaction interface relatively transparent so users can focus on tasks interface Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 8 Universal 3D Interaction Tasks Navigation Navigation travel: motor component travel: wayfinding: cognitive component wayfinding: Selection/Picking Selection/Picking Manipulation Manipulation specification of object position & orientation specification specification of scale, shape, other attributes specification System Control System changing the system state or interaction mode changing may be composed of other tasks may Symbolic Input Symbolic Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 3D UI Design Philosophies Artistic approach: Base design decisions on Artistic intuition about users, tasks, and environments intuition heuristics, metaphors, common Sense heuristics, aesthetics aesthetics adaptation/inversion of existing interfaces adaptation/inversion Scientific approach: Base design decisions on Scientific formal characterization of users, tasks, and formal environments quantitative evaluation results quantitative performance requirements performance examples: taxonomies, formal experimentation examples: Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 9 Applications Architecture / CAD Architecture Education Education Manufacturing Manufacturing Medicine Medicine Simulation / Training Simulation Entertainment – Games!!! Entertainment Design / Prototyping Design Information / Scientific Visualization Information Collaboration / Communication Collaboration Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 3D UI RoadMap Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 10 Next Class Games and 3DUIs Games Readings Readings Bowman – Chapters 1 and 2 Bowman Bowman, D., Chen, J., Wingrave, C., Lucas, J., Ray, A., Polys, N., Li, Q., Bowman, Wingrave, Polys, Haciahmetoglu, Y., Kim, J., Kim, S., Boehringer, R., and Ni, T. “New Directions in Haciahmetoglu, Boehringer, 3D User Interfaces”, International Journal of Virtual Reality, vol. 5, no. 2, 2006, Interfaces” International pp. 3-14. 3LaViola, J. “Bringing VR and Spatial 3D Interaction to the Masses through Video LaViola, Video Games”, IEEE Computer Graphics and Applications, 28(5):10-15, Games” IEEE 28(5):10September/October 2008. Doug A. Bowman, Sabine Coquillart, Bernd Froehlich, Michitaka Hirose, Yoshifumi Doug Coquillart, Kitamura, Kiyoshi Kiyokawa, Wolfgang Stuerzlinger, "3D User Interfaces: New Kiyokawa, Stuerzlinger, Directions and Perspectives," IEEE Computer Graphics and Applications, vol. 28, IEEE no. 6, pp. 20-36, Nov/Dec, 2008 20- Spring 2009 CAP6938 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 11 ...
View Full Document

This note was uploaded on 06/13/2011 for the course CAP 6938 taught by Professor Staff during the Spring '08 term at University of Central Florida.

Ask a homework question - tutors are online