This preview shows pages 1–2. Sign up to view the full content.
This preview has intentionally blurred sections. Sign up to view the full version.View Full Document
Unformatted text preview: The Music Notepad Andrew Forsberg, Mark Dieterich, and Robert Zeleznik Brown University Department of Computer Science Providence, RI 02912 (401) 863-7693; asf,mkd,bcz @cs.brown.edu ABSTRACT We present a system for entering common music notation based on 2D gestural input. The key feature of the system is the look-and-feel of the interface which approximates sketch- ing music with paper and pencil. A probability-based inter- preter integrates sequences of gestural input to perform the most common notation and editing operations. In this paper, we present the user’s model of the system, the components of the high-level recognition system, and a discussion of the evolution of the system including user feedback. KEYWORDS: user interface, interaction, music notation, gestural input, gesture recognition, handwriting recognition, direct displays. INTRODUCTION There are a number of situations that revolve around infor- mally notating music , such as when a composer wants to jot down an idea, when a teacher explains theory to students, or when a musician wants to visualize (i.e., notate) a musical idea. Despite the many advantages of applying computers to music notation (e.g., for synthesizing sound, neatly format- ting and rendering notation), people in fact resort to using just paper and pencil for many tasks even when computer so- lutions are available. This paradox derives from the nature of the interfaces for typical music applications. Most computerized music notation systems employ standard windows, icons, menus, and point-and-click (WIMP) user in- terfaces (UI’s) as well as a transition to keyboard “hotkeys” for frequently used functions. In some cases, these systems offer advantages over paper and pencil notation such as rapid data entry, editing flexibility, automatic formating, synthe- sized sound, and high-quality printing. However, the user’s model for computerized systems is very different from the model of paper and pencil notation. Based on discussions See  and  for further information on musical terms and common music notation with a number of musicians and composers we believe a fun- damentally different music notation interface based on a pen- based UI will be more desirable and of equal or greater value than a WIMP-based UI. The Music Notepad attempts to be an interactive electronic sheet of music paper. Unlike WIMP UIs, the Music Notepad is characterized by a portable display surface (a Wacom PL- 300 Display Tablet) that can be directly drawn upon with a stylus. To support what can be done with pencil and paper interfaces, the Music Notepad interprets gestures specified by the user with a stylus to create notation. Moreover, ges- tures can also be used to perform more powerful editing op- erations, to professionally format notation, and to synthesize instrumental sounds based on the notation....
View Full Document
This note was uploaded on 06/13/2011 for the course CAP 6938 taught by Professor Staff during the Spring '08 term at University of Central Florida.
- Spring '08