special_topics_graphics_research - CAP4730: Computational...

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: CAP4730: Computational Structures in Computer Graphics Graphics Research Graphics Research Graphics Community Graphics Community s s s SIGGRAPH ­ Special Interest Group ­ Graphics – premiere graphics conference held annually – go here for the latest in graphics research s computer graphics as art/art festival s special effects/movies s technical papers s immerging technologies – ~50000 people from all over the world – UNC has perennially had a strong presence here Eurographics, Interactive 3D Graphics (I3D), Visualization, IEEE Virtual Reality, Virtual Reality Symposium on Technology Unlike many fields, conferences are more important than journals Graphics Education Graphics Education s Universities that have a strong graphics (with an interactive or photorealistic focus) – University of North Carolina http://www.cs.unc.edu/Research/Graphics­Image/ – University of Utah – Brown University – Stanford University – MIT – Cornell University – CalTech – Georgia Tech – University of California at Berkley Graphics in Industry Graphics in Industry Microsoft Graphics Research s Mitsubishi Engineering Research Labs s Alias|Wavefront s Pixar s Dreamworks Studio s SGI (Silicon Graphics) s Areas of Graphics Research Areas of Graphics Research s s s s s s s s s s s s NOT an exhaustive list! Modeling Compression Surfaces Lighting and Shading Image Based Rendering Model Acquisition Simplification/Level of Detail Light Fields Rendering Non­Photorealistic Rendering Interactive Techniques Modeling Different Materials Modeling Different Materials Cloth s Liquids s Fire s Hair/Fur s Skin s CDs s Grass s What are the common denominators here? s Global Illumination Global Illumination s s s s Radiosity Radiosity as textures Bidirection Reflectance Distribution Function (BRDF) Light as rays, doesn’t do everything Modelling Modelling s Massive Models – models of 100,000,000 triangles – http://www.cs.unc.edu/ ~walk/research/index. html – Replace geometry with images – Warp images – Occlusion culling – Cell and Portal culling – Level of detail Volume Visualization Volume Visualization Medical Data s MRI Slices ­> 3D s Data sizes s Extracting useful information s Accuracy is now VERY important! s Simplification/Level of Detail Simplification/Level of Detail s s s s s s Objects farther away can be represented with less detail http://www.cs.unc.edu/~walk/hlod/ How do we “remove” triangles? What are the advantages and disadvantages? What about objects that stretch the entire length of the object? Can we do this automatically? Collision Detection Collision Detection Determining intersections between models s Resolution of collisions s Where is the intersection? s Normal of surfaces s Depth of intersection s Multiple collisions s Image Based Rendering Image Based Rendering We use to think of photos as 2D and geometry as 3D and distinct s IBR says 2D images have 3D information. s Non Photorealistic Rendering Non Photorealistic Rendering Cartoons s Pen/Pencil s Paints s Art s Drawing Styles s Virtual Environments Virtual Environments Virtual Reality s Trackers s Rendering s Haptics s Avatars s Hybrid Reality s Using Graphics as tools Using Graphics as tools Office of real soon now s Nanomanipulator s Human Computer Interaction Human Computer Interaction s s s What is a user interface? Why do we care about design? We see this all the time. – What’s good about the design of this error box? s The user knows there is an error – What’s poor about the design of this error box? s s s Discouraging Not enough information No way to resolve the problem (instructions or contact info) My Choice My Choice s s iPod by Apple Computers Pros: – – – – s portable power ease of use # of controls – – – scratches easily no speech for car use proprietary Cons: HCI Community HCI Community s Academics/Industry Research – Taxonomies – Theories – Predictive models s Experimenters – – s Empirical data Product design – – – – Motor Perceptual Cognitive Social, economic, ethics Other areas (Sociologists, anthropologists, managers) HCI Tools HCI Tools s s s s s Sound 3D Animation Video Devices – Size (small­>very large) – Portable (PDA, phone) – Plasticity s s s Context sensitive/aware Personalizable Ubiquitous Usability Requirements Usability Requirements s Goals: – Usability – Universality – Usefulness s Achieved by: – Planning – Sensitivity to user needs – Devotion to requirements analysis – Testing Bad Interfaces Bad Interfaces s s s s s Encumbering Confusing Slow Trust (ex. windows crashing) What makes it hard? – – – s Varies by culture Multiple platforms Variety of users Think of a game you’ve played with a bad interface – UNIX s Example Example Five fastest places to click on for a right­ handed user? s Example Example What affects time? Virtual Reality Definition Virtual Reality Definition s What is virtual reality? – Virtual – Being in essence or effect, but not in fact s Example VRAM s – Reality – s The state or quality of being real. Something that exists independently of ideas concerning it. Something that constitutes a real or actual thing as distinguished from something that is merely apparent.” – What was the first VR? What was the first VR? What was the first VR? Ivan Sutherland’s Ivan Sutherland’s The Ultimate Display “Don’t think of that thing as a screen, think of it as a window, a window through which one looks into a virtual world. The challenge to computer graphics is to make that virtual world look real, sound real, move and respond to interaction in real time, and even feel real.” Key Elements of Virtual Reality Key Elements of Virtual Reality Experience s Virtual World ­ content of a given medium – – s screen play, script, etc. actors performing the play allows us to experience the virtual world Immersion – sensation of being in an environment – mental immersion – suspension of disbelief – physical immersion – bodily entering the medium – Related to presence – (mentally immersed) the participant’s sensation of being in the virtual environment (Slater) Walking Experiment at UNC – Chapel Hill Augmented Reality Augmented Reality A combination of a real scene viewed by a user and a virtual scene generated by a computer that augments the scene with additional information. All Virtual Objects s Ultrasound Visualization Research at UNC – Chapel Hill All Real Objects s Immersive Technology Immersive Technology Head­mounted Display – Optical System – Image Source (CRT or LCD) – Mounting Apparatus – Earphones – Position Tracker s Immersive Technology Immersive Technology Multi­screen Projection of stereoscopic images (CAVE) Immersive Technology Immersive Technology s Single large stereoscopic display Projection­based Head­tracked Possible tracking of hands and arms. – Brings virtual objects into the physical world – – – User’s perspective User’s perspective s s s s Setting Objects in world Other participants Active/Passive – Factory Simulation – Architectural Walkthrough Immersive Virtual Characters for Educating Immersive Virtual Characters for Educating Medical Communication Skills J. Hernendez, A. Stevens, D. S. Lind Department of Surgery (College of Medicine) M. Duerson Department of Community Health and Family Medicine (College of Medicine) K. Johnsen, A. Raij, R. Dickerson, B. Lok Department of Computer and Information Science and Engineering (College of Engineering) R. Ferdig College of Education The University of Florida, Gainesville, FL J. Jackson, M. Shin Department of Computer Science The University of North Carolina at Charlotte, Charlotte, NC Sebastian Foti, Juan Cendan, Peggy Werner Associated Faculty Future Work Future Work s Future collaborators – UF College of Education – Medical College of Georgia (MCG) s s s Now n=20, future n=120 students / year (MCG) Evaluate VP vs SP Non­verbal communication – Body lean – Eye gaze s s Real Speech vs Text to Speech Negative training transfer Driving Application: Driving Application: Engineering Design Evaluation At assembly design stage: Several constructed parts Many CAD models for parts yet to be constructed – Unverified assembly plans – – Motivation: – Finding design flaws earlier will save time and money – Virtual environments have difficulty simulating hands­on assembly – Support team based interaction How can we verify the assembly plan? We only have this in 2005 To be built in 2008 Reconstruction from Capturing the Physical Model Capturing the Physical Model Scanning Define color markers multiple scans Interaction in ME Skill Set Skill Set s s s s s “Oh I don’t want to program, I just want to create stuff” Architect or Car analogy Programming ­> tool to create what is in your imagination Programming proficiency goal: be able to code anything that you imagine To do what you saw before we use: – C/C++, OpenGL, many different libraries s Math, math, and yet more math!!! – Differential equations (simulations, physics engines), linear algebra (transforms, 3D manipulations), statistics Graduate School Graduate School s Programming Team Lead at RockStar Games – Worked on Midnight Club 2 s Renderman Developer at Pixar – Worked on the Jellyfish of Nemo and The Incredibles s Software Engineer for Interactive Media for Disney – Worked on Toon Town, online capable titles s s Worked at 989 Sports, EA Sports, Freedom Force, etc. What did they all have in common? – Published scientific journals in computer science – Graduate school in computer science – Worked on efficient collision detection, particle systems, curved surfaces, virtual reality, etc. – All had s s s s GRE scores in the top 10% Went to a top graduate school (admission is tough) Strong math and science and coding Why would a CS professor want to work with you? Interested? Take the Interested? Take the following… s s s s s CAP4730 Computational Structures in Computer Graphics (Fall ’05) CAP4930/6930 Design and Creation of Virtual Environments (Fall ’05) CAP4930/6930 Human­Computer Interaction (Spring ’06?) Computational Geometry (Spring ’06)? Computer Simulation Concepts (Fall ’05) s Virtual Experiences Group Virtual Experiences Group PhD Students (4) – – – – – – – – s s Kyle Johnsen John Quarrels Andrew Raij Xiyong Wang Robert Dickerson Sayed Hashimi Andrew Joubert Art Homs – – – – – Cyrus Harrison (MS) George Mora (MS) Andrew Joubert (BS) Samuel Preston (BS) John Samuelsen (BS) Undergraduates (4) Alumni (4) Thank you! Questions? ...
View Full Document

Ask a homework question - tutors are online