create a fast copy of le and directory tree gfs chunk

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: are huge by tradiEonal standards •  File mutaEons predominantly through appends 2/8/13 8 Colorado State University, Sangmi Pallickara 2/8/13 Spring 2013 L22.10 Colorado State University, Sangmi Pallickara 2/8/13 CS480 Principles of Data Management The file system interface Spring 2013 Architecture of GFS •  Does not implement standard APIs such as POSIX •  Supports create, delete, open, close, read and write Client •  snapshot Client GFS Master Client ...! –  Create a fast copy of file and directory tree GFS Chunk Server Linux File System •  record append –  MulEple files can concurrently append records to the same file GFS Chunk Server Linux File System GFS Chunk Server Linux File System •  Without addiEonal locking 2/8/13 Colorado State University, Sangmi Pallickara L22.11 2/8/13 Colorado State University, Sangmi Pallickara L22.12 2 2/8/13 CS480 Principles of Data Management Spring 2013 In GFS a file is broken up into fixedsize chunks CS480 Principles of Data Management •  This is fixed at 64 MB –  Much larger than typical FS block sizes (512 bytes) •  Obvious reason –  The file is too big Map-Reduce Spring 2013 Chunk size •  Lazy space alloca2on •  Set the stage for computaEons that operate on this data –  Stored as plain Linux file – ...
View Full Document

This note was uploaded on 02/11/2014 for the course CS 480 taught by Professor Staff during the Spring '08 term at Colorado State.

Ask a homework question - tutors are online