introduction - 3D User Interfaces for Games 3D User...

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: 3D User Interfaces for Games 3D User Interfaces for Games and and Virtual Reality Lecture #1: Introduction Spring 2011 Joseph J. LaViola Jr. Spring 2011 CAP6121 -- 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Instructor Instructor Professor – Joseph J. LaViola Jr. Email – [email protected] Office Hours – Tues. 4:00pm – 5:30pm Wed. 5:45pm – 6:45pm Office is Harris 321 Office is Harris 321 Website will have all required info www.eecs.ucf.edu/courses/cap6121/spr11 Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 1 Class Goals Provide in-depth introduction to spatial 3D user ininterfaces Focus on 3D games Speaking and presentation skills Start of master’s projects and PhD dissertations Possible publications Spring 2011 Virtual Reality 2012 Reality 2012 3D User Interfaces 2012 Foundations of Digital Games 2012 SIGGRAPH Sandbox 2012 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Required Books Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 2 Grading Assignment 1 (group) (group) Assignment Assignment 2 (group) Chapter Paper (individual) Paper presentation (individual) Final Project (group) Final Project (group) Spring Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality 15% 15% 15% 15% 5% 50% 50% ©Joseph J. LaViola Jr. Final Projects 2-3 person teams Must have research component related to games innovative 3D UI Everyone must write and get approved a pro project proposal Final Project write up required DEMO DAY!!!! – May 2, 2011 Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 3 Class Structure (see syllabus for details) Lectures Fundamentals of 3D user interfaces Student paper presentation hardware common interaction tasks user evaluation 20 minute presentation minute presentation Final project update sessions Work done in ISUE Lab – Harris 208 (laptops also) Spring 2011 key access required CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Course Topics Unity 3D 3D Hardware Common 3D Interaction Tasks perception input and output devices travel (e.g., navigation and wayfinding) wayfinding) selection and manipulation system control control 3D UI Design 3D UI Evaluation 3D UI and Augmented/Mixed Reality Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 4 Collaboration and Late Policy Collaboration encouraged encouraged do your own work on assignments cheating = BAD!!! All assignments must be handed in on time Assignments – by 11:59pm on due date Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Tools – Hardware Wii Sensor Bar PC with Intel Quad Core processor processor Samsung 50’’ 3D DLP HDTV 3GB RAM NVIDIA GT8500 GFX Card TriDef Stereo Emmitter 5.1 Speaker Speaker System Wii controllers Spring 2011 TriDef Shutter Glasses CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 5 Tools – More Hardware NVIDIA 3D Vision Kit Wii Balance Board Novint Falcon Microsoft Kinect 3rd Space Gaming Vest Spring 2011 IZ3D Monitor CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Tools – Even More Hardware Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 6 Tools – Software Visual Studio 2010, C# Unity 3D game engine audio support, graphics support physics engine development UI Scripting in C#, Javascript Supports 3D stereo Open NUI interface to Microsoft Kinect interface to Microsoft Kinect supports RGB, depth image extraction skeleton tracking Custom Client/Server code Google SketchUp Pro Spring 2011 nice model database CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. What are 3D UIs? 3D interaction: Human-computer interaction in which the Humanuser tasks are carried out in 3D spatial context user’s tasks are carried out in a 3D spatial context 3D input devices 2D input devices with direct mappings to 3D 3D user interface (3D UI): A UI that involves 3D interaction 3D interaction technique: A method (hardware and software) allowing a user to accomplish a task in a 3D UI Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 7 Why 3D Interfaces? 3D applications should be useful immersion natural skills immediacy of visualization But, applications in common use have low complexity of interaction More complex applications have serious usability More complex applications have serious usability problems problems Technology alone is not the solution! Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. What makes 3D interaction difficult? Spatial input input Lack of constraints Lack of standards Lack of tools Spring 2011 Lack of precision of precision Fatigue Layout more complex Perception CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 8 Interaction Goals Performance Usability efficiency accuracy productivity ease of use ease of learning user comfort Usefulness interaction helps meet system goals interface relatively transparent so users can focus on tasks Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Universal 3D Interaction Tasks Navigation Selection/Picking Manipulation specification of object position & orientation specification of scale, shape, other attributes System Control Control travel: motor component motor component wayfinding: cognitive component changing the system state or interaction mode may be composed of other tasks Symbolic Input Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 9 3D UI Design Philosophies Artistic approach: Base design decisions on intuition about users, tasks, and environments about users, tasks, and environments heuristics, metaphors, common Sense aesthetics adaptation/inversion of existing interfaces Scientific approach: Base design decisions on Spring 2011 formal characterization of users, tasks, and environments environments quantitative evaluation results performance requirements examples: taxonomies, formal experimentation CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Applications Architecture / CAD Education Manufacturing Medicine Simulation / Training Entertainment – Games!!! Design / Prototyping Information / Scientific Visualization Collaboration / Communication Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 10 3D UI RoadMap Spring 2011 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. Next Class Games and 3DUIs and 3DUIs Readings Spring 2011 Bowman – Chapters 1 and 2 Bowman, D., Chen, J., Wingrave, C., Lucas, J., Ray, A., Polys, N., Li, Q., Haciahmetoglu, Y., Kim, J., Kim, S., Boehringer, R., and Ni, T. “New Directions in 3D User Interfaces”, International Journal of Virtual Reality, vol. 5, no. 2, 2006, International pp. 3-14. 3LaViola, J. “Bringing VR and Spatial 3D Interaction to the Masses through Video Spat to Games”, IEEE Computer Graphics and Applications, 28(5):10-15, IEEE 28(5):10September/October 2008. Doug A. Bowman, Sabine Coquillart, Bernd Froehlich, Michitaka Hirose, Yoshifumi Kitamura, Kiyoshi Kiyokawa, Wolfgang Stuerzlinger, "3D User Interfaces: New Directions and Perspectives," IEEE Computer Graphics and Applications, vol. 28, IEEE no. 6, pp. 20-36, Nov/Dec, 2008 20- CAP6121 CAP6121 – 3D User Interfaces for Games and Virtual Reality ©Joseph J. LaViola Jr. 11 ...
View Full Document

This note was uploaded on 08/25/2011 for the course CAP 6121 taught by Professor Lavoilajr. during the Spring '11 term at University of Central Florida.

Ask a homework question - tutors are online