InteractionsWithinMultiModalEnvironments - Interaction...

Info iconThis preview shows pages 1–2. Sign up to view the full content.

View Full Document Right Arrow Icon
Interaction within Multimodal Environments in a Collaborative Setting Glenn A. Martin, Jason Daly and Casey Thurston Institute for Simulation & Training, University of Central Florida 3280 Progress Dr., Orlando, FL 32826 {martin, jdaly, cthursto} Abstract Much attention has been given to the topic of multimodal environments as of late. Research in haptics is thriving and even some olfactory research is appearing. However, while there has been research in collaborative environments in the general sense, minimal focus has been given to the interaction present in multimodal environments within a collaborative setting. This paper presents research into a network architecture for collaborative, multimodal environments with a focus on interaction. Within a dynamic world three types of human interaction are possible: user-to-user, world-to-user, and user-to- world. The first two form what are fundamentally multimodal environments; the user receives feedback using various modalities both from other users and the world. The last one forms the area of dynamic environments where the user can affect the world itself. The architecture presented here provides a flexible mechanism for studying multimodal environments in this distributed sense. Within such an architecture, latency and synchronization are key concepts when bringing multimodal environments to a collaborative setting. 1 Introduction Virtual environments have existed for many years. However, despite numerous distributed simulations, including training uses in many domains, there still is relatively little interaction within these virtual environments. Most allow only navigation and perhaps some minimal interaction. For example, military simulations allow basic combat-oriented interaction (shooting, throwing a grenade, etc.), but only few of those incorporate advanced modalities (such as haptics or olfactory) or dynamic changes to the environment itself. 2 Types of Interaction Within a distributed, interactive virtual environment there are many components to address: the user, the environment and other users. In categorizing the types of interaction we have split them into four categories: user- to-user, world-to-user, user-to-world and world-to-world. The first two types form what are fundamentally multimodal environments. Whether from another user or from the world, the user gets feedback from the various modalities. In the case of user-to-user it may be grabbing a shoulder or shooting an opponent. For world-to-user it may be bumping into a piece of furniture in the virtual environment. The latter two types of interaction form what we call dynamic environments. For example, the user can act upon the world by moving an object or changing the characteristics of an object (e.g. watering a virtual plant making the soil damper). Similarly, within a world-to-world interaction a rain model might change the soil moisture. In this paper we will focus on the user-to-world interactions, however. 3
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 2
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 07/30/2011 for the course COP 4810 taught by Professor Staff during the Spring '11 term at University of Central Florida.

Page1 / 10

InteractionsWithinMultiModalEnvironments - Interaction...

This preview shows document pages 1 - 2. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online