This preview shows pages 1–2. Sign up to view the full content.
This preview has intentionally blurred sections. Sign up to view the full version.View Full Document
Unformatted text preview: Inter-Datacenter Bulk Transfers with NetStitcher Nikolaos Laoutaris, Michael Sirivianos, Xiaoyuan Yang, and Pablo Rodriguez Telefonica Research Barcelona, Spain firstname.lastname@example.org, email@example.com, firstname.lastname@example.org, email@example.com ABSTRACT Large datacenter operators with sites at multiple locations dimension their key resources according to the peak demand of the geographic area that each site covers. The demand of specific areas follows strong diurnal patterns with high peak to valley ratios that result in poor average utilization across a day. In this paper, we show how to rescue unuti- lized bandwidth across multiple datacenters and backbone networks and use it for non-real-time applications, such as backups, propagation of bulky updates, and migration of data. Achieving the above is non-trivial since leftover band- width appears at different times, for different durations, and at different places in the world. To this end, we have designed, implemented, and vali- dated NetStitcher , a system that employs a network of stor- age nodes to stitch together unutilized bandwidth, whenever and wherever it exists. It gathers information about leftover resources, uses a store-and-forward algorithm to schedule data transfers, and adapts to resource fluctuations. We have compared NetStitcher with other bulk transfer mechanisms using both a testbed and a live deployment on a real CDN. Our testbed evaluation shows that Net- Stitcher outperforms all other mechanisms and can rescue up to five times additional datacenter bandwidth thus mak- ing it a valuable tool for datacenter providers. Our live CDN deployment demonstrates that our solution can per- form large data transfers at a substantially lower cost than naive end-to-end or store-and-forward schemes. Categories and Subject Descriptors C.2.5 [ Computer-Communication Networks ]: Distributed Systems General Terms Algorithms, Design Keywords bulk transfers, inter-datacenter traffic, store-and-forward Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. SIGCOMM11, August 1519, 2011, Toronto, Ontario, Canada. Copyright 2011 ACM 978-1-4503-0797-0/11/08 ...$10.00. 1. INTRODUCTION Online service companies such as Amazon, Facebook, Google, Microsoft, and Yahoo! have made huge investments in networks of datacenters that host their online services and cloud platforms. Similarly, hosting and co-location services such as Equinix and Savvis employ distributed networks of datacenters that include tens of locations across the globe....
View Full Document
This note was uploaded on 12/01/2011 for the course EE 5373 taught by Professor Chao during the Spring '11 term at NYU Poly.
- Spring '11