scribe - S CRIBE: The design of a large-scale event...

Info iconThis preview shows pages 1–3. Sign up to view the full content.

View Full Document Right Arrow Icon
S CRIBE : The design of a large-scale event notification infrastructure Antony Rowstron , Anne-Marie Kermarrec , Miguel Castro , and Peter Druschel Microsoft Research, 7 J J Thomson Avenue, Cambridge, CB3 0FB, UK. antr,anne-mk,mcastro@microsoft.com Rice University MS-132, 6100 Main Street, Houston, TX 77005-1892, USA. druschel@cs.rice.edu Abstract. This paper presents Scribe, a large-scale event notification infrastruc- ture for topic-based publish-subscribe applications. Scribe supports large num- bers of topics, with a potentially large number of subscribers per topic. Scribe is built on top of Pastry, a generic peer-to-peer object location and routing substrate overlayed on the Internet, and leverages Pastry’s reliability, self-organization and locality properties. Pastry is used to create a topic (group) and to build an ef- ficient multicast tree for the dissemination of events to the topic’s subscribers (members). Scribe provides weak reliability guarantees, but we outline how an application can extend Scribe to provide stronger ones. 1 Introduction Publish-subscribe has emerged as a promising paradigm for large-scale, Internet based distributed systems. In general, subscribers register their interest in a topic or a pattern of events and then asynchronously receive events matching their interest, regardless of the events’ publisher. Topic-based publish-subscribe [1–3] is very similar to group- based communication; subscribing is equivalent to becoming a member of a group. For such systems the challenge remains to build an infrastructure that can scale to, and tolerate the failure modes of the general Internet. Techniques such as SRM (Scalable Reliable Multicast Protocol) [4] or RMTP (Re- liable Message Transport Protocol) [5] have added reliability to network-level IP mul- ticast [6, 7] solutions. However, tracking membership remains an issue in router-based multicast approaches and the lack of wide deployment of IP multicast limits their ap- plicability. As a result, application-level multicast is gaining popularity. Appropriate algorithms and systems for scalable subscription management and scalable, reliable propagation of events are still an active research area [8–11]. Recent work on peer-to-peer overlay networks offers a scalable, self-organizing, fault-tolerant substrate for decentralized distributed applications [12–15]. Such systems Appears in the proceedings of 3rd International Workshop on Networked Group Communica- tion (NGC2001), UCL, London, UK, November 2001.
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
offer an attractive platform for publish-subscribe systems that can leverage these prop- erties. In this paper we present Scribe, a large-scale, decentralized event notification in- frastructure built upon Pastry, a scalable, self-organizing peer-to-peer location and rout- ing substrate with good locality properties [12]. Scribe provides efficient application- level multicast and is capable of scaling to a large number of subscribers, publishers and topics. Scribe and Pastry adopt a fully decentralized peer-to-peer model, where each partic-
Background image of page 2
Image of page 3
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 12/08/2011 for the course CS 525 taught by Professor Gupta during the Spring '08 term at University of Illinois, Urbana Champaign.

Page1 / 13

scribe - S CRIBE: The design of a large-scale event...

This preview shows document pages 1 - 3. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online