slides.0310.2011 - Geo-distribution in Storage-Jason Croft...

Info icon This preview shows pages 1–13. Sign up to view the full content.

View Full Document Right Arrow Icon
Geo-distribution in Storage -Jason Croft and Anjali Sridhar
Image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Outline Introduction Smoke and Mirrors RACS Redundant Array of Cloud Storage Conclusion 2
Image of page 2
Introduction Why do we need geo-distribution? Protection against data loss Options for data recovery Cost ? Physical Latency Manpower Power Redundancy/Replication 3
Image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
How to Minimize Cost ? Smoke and Mirror File System Latency RACS Monetary cost Volley Latency and Monetary cost Applications? 4
Image of page 4
Smoke and Mirrors: Reflecting Files at a Geographically Remote Location Without Loss of Performance -Hakim Weatherspoon, Lakshmi Ganesh, Tudor Marian, Mahesh Balakrishnan, and Ken Birman, Cornell University, Computer Science Department & Microsoft Research, Silicon Valley ,FAST 2009 5
Image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Smoke and Mirrors Network sync tries to provide reliable transmission of data from the primary to the replicas with minimum latency Sensitive to high latency but require fault tolerance US Treasury, Finance Sector Technology Consortium and any corporation using transactional databases 6
Image of page 6
Failure Sequence or Rolling disaster The model assumes wide area optical link networks with high data rates which has sporadic , bursty packet loss . Experiments are based on observation of TeraGrid, a scientific data network linking supercomputers. 7
Image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Synchronous 1 2 3 4 5 CLIENT Disadvantage - Low performance due to latency Advantage - High reliability 8 PRIMARY Local storage site MIRROR Remote storage site
Image of page 8
Asynchronous 1 2 4 CLIENT Advantage - High performance due to low latency Disadvantage -Low reliability 3 9 PRIMARY Local storage site MIRROR Remote storage site
Image of page 9

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Semi-synchronous 1 2 3 4 CLIENT Advantage -Better reliability than asynchronous Disadvantage - More latency than synchronous 10 PRIMARY Local storage site MIRROR Remote storage site
Image of page 10
Core Ideas Network Sync is close to the semi-synchronous model It uses egress and ingress routers to increase reliability The data packets along with forward error correcting packets are “stored” in the network after which an ack is sent to the client A better bet for applications 11
Image of page 11

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
Network Sync 1 2 3 5 CLIENT PRIMARY Local storage site MIRROR Remote storage site Ingress Router Egress Router Ingress and Egress Routers are gateway routers that form the boundary between the datacenter and the wide area network.
Image of page 12
Image of page 13
This is the end of the preview. Sign up to access the rest of the document.

{[ snackBarMessage ]}

What students are saying

  • Left Quote Icon

    As a current student on this bumpy collegiate pathway, I stumbled upon Course Hero, where I can find study resources for nearly all my courses, get online help from tutors 24/7, and even share my old projects, papers, and lecture notes with other students.

    Student Picture

    Kiran Temple University Fox School of Business ‘17, Course Hero Intern

  • Left Quote Icon

    I cannot even describe how much Course Hero helped me this summer. It’s truly become something I can always rely on and help me. In the end, I was not only able to survive summer classes, but I was able to thrive thanks to Course Hero.

    Student Picture

    Dana University of Pennsylvania ‘17, Course Hero Intern

  • Left Quote Icon

    The ability to access any university’s resources through Course Hero proved invaluable in my case. I was behind on Tulane coursework and actually used UCLA’s materials to help me move forward and get everything together on time.

    Student Picture

    Jill Tulane University ‘16, Course Hero Intern