This preview has intentionally blurred sections. Sign up to view the full version.View Full Document
Unformatted text preview: Symbiotic Routing in Future Data Centers Hussam Abu-Libdeh * Microsoft Research Cambridge, UK. [email protected] Paolo Costa Microsoft Research Cambridge, UK. [email protected] Antony Rowstron Microsoft Research Cambridge, UK. [email protected] Greg O’Shea Microsoft Research Cambridge, UK. [email protected] Austin Donnelly Microsoft Research Cambridge, UK. [email protected] ABSTRACT Building distributed applications that run in data centers is hard. The CamCube project explores the design of a ship- ping container sized data center with the goal of building an easier platform on which to build these applications. Cam- Cube replaces the traditional switch-based network with a 3D torus topology, with each server directly connected to six other servers. As in other proposals, e.g. DCell and BCube, multi-hop routing in CamCube requires servers to participate in packet forwarding. To date, as in existing data centers, these approaches have all provided a single routing protocol for the applications. In this paper we explore if allowing applications to im- plement their own routing services is advantageous, and if we can support it efficiently. This is based on the obser- vation that, due to the flexibility offered by the CamCube API, many applications implemented their own routing pro- tocol in order to achieve specific application-level charac- teristics, such as trading off higher-latency for better path convergence. Using large-scale simulations we demonstrate the benefits and network-level impact of running multiple routing protocols. We demonstrate that applications are more efficient and do not generate additional control traffic overhead. This motivates us to design an extended routing service allowing easy implementation of application-specific routing protocols on CamCube. Finally, we demonstrate that the additional performance overhead incurred when us- ing the extended routing service on a prototype CamCube is very low. * Work done during internship at Microsoft Research, Cam- bridge. Currently at Cornell University, Ithaca, NY, USA. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. SIGCOMM’10, August 30–September 3, 2010, New Delhi, India. Copyright 2010 ACM 978-1-4503-0201-2/10/08 ...$10.00. Categories and Subject Descriptors C.2 [ Computer Systems Organization ]: Computer com- munication networks; H.3.4 [ Information systems ]: Infor- mation storage and retrieval— Distributed Systems General Terms Algorithms, Design, Performance Keywords Data centers, key-value stores, routing protocols 1. INTRODUCTION The networks in large-scale data centers, such as those owned by Amazon, Google, Microsoft and Yahoo, adopt...
View Full Document
- Spring '11