Speed master can scan its state in the background

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: y unique ID –  Can cache info for a mulE ­TB working set Colorado State University, Sangmi Pallickara CS480 Principles of Data Management In GFS a file is broken up into fixedsize chunks Chunk size: But why this big? 2/8/13 L22.14 Colorado State University, Sangmi Pallickara 2/8/13 •  Vastly simplifies design •  Easy to use global knowledge to reason about –  Chunk placements –  ReplicaEon decisions L22.17 2/8/13 Colorado State University, Sangmi Pallickara L22.18 3 2/8/13 CS480 Principles of Data Management Spring 2013 ALL system metadata is managed by the Master and stored in Main Memory ①  File and chunk namespaces ②  Mapping from files to chunks Logs mutations into a permanent log CS480 Principles of Data Management Spring 2013 Why keep the entire metadata in memory? •  Speed •  Master can scan its state in the background –  Implement chunk garbage collecEon –  Re ­replicate if there are failures –  Chunk migraEon to balance load and space ③  LocaEon of chunks •  Add extra memory to increase file system size L22.19 Colorado State University, Sangmi Pallickara...
View Full Document

This note was uploaded on 02/11/2014 for the course CS 480 taught by Professor Staff during the Spring '08 term at Colorado State.

Ask a homework question - tutors are online