Miluzzo-EyePhone - EyePhone Activating Mobile Phones With...

Info icon This preview shows pages 1–2. Sign up to view the full content.

View Full Document Right Arrow Icon
EyePhone: Activating Mobile Phones With Your Eyes Emiliano Miluzzo, Tianyu Wang, Andrew T. Campbell Computer Science Department Dartmouth College Hanover, NH, USA ABSTRACT As smartphones evolve researchers are studying new tech- niques to ease the human-mobile interaction. We propose EyePhone , a novel “hand-free” interfacing system capable of driving mobile applications/functions using only the user’s eyes movement and actions (e.g., wink). EyePhone tracks the user’s eye movement across the phone’s display using the camera mounted on the front of the phone; more specifically, machine learning algorithms are used to: i) track the eye and infer its position on the mobile phone display as a user views a particular application; and ii) detect eye blinks that em- ulate mouse clicks to activate the target application under view. We present a prototype implementation of EyePhone on a Nokia N810, which is capable of tracking the position of the eye on the display, mapping this positions to an ap- plication that is activated by a wink. At no time does the user have to physically touch the phone display. Categories and Subject Descriptors C.3 [ Special-Purpose and Application-Based Systems ]: Real-time and embedded systems General Terms Algorithms, Design, Experimentation, Human Factors, Mea- surement, Performance Keywords Human-Phone Interaction, Mobile Sensing Systems, Machine Learning, Mobile Phones 1. INTRODUCTION Human-Computer Interaction (HCI) researchers and phone vendors are continuously searching for new approaches to reduce the e ff ort users exert when accessing applications on limited form factor devices such as mobile phones. The most significant innovation of the past few years is the adoption of Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. MobiHeld 2010, August 30, 2010, New Delhi, India. Copyright 2010 ACM 978-1-4503-0197-8/10/08 ...$10.00. touchscreen technology introduced with the Apple iPhone [1] and recently followed by all the other major vendors, such as Nokia [2] and HTC [3]. The touchscreen has changed the way people interact with their mobile phones because it provides an intuitive way to perform actions using the move- ment of one or more fingers on the display (e.g., pinching a photo to zoom in and out, or panning to move a map). Several recent research projects demonstrate new people- to-mobile phone interactions technologies [4, 5, 6, 7, 8, 9, 10]. For example, to infer and detect gestures made by the user, phones use the on-board accelerometer [4, 7, 8], camera [11, 5], specialized headsets [6], dedicated sensors [9] or radio features [10]. We take a di ff erent approach than that found in the literature and propose the EyePhone system which
Image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Image of page 2
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern