Topic_2_PT - Topic 2 Replication management& Google File System Presented by LEE HO MING(51306210 TSANG TSZ KIT(51274232 CHEUK HIU KING(51362570

Info iconThis preview shows pages 1–6. Sign up to view the full content.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: Topic 2: Replication management & Google File System Presented by: LEE HO MING (51306210) TSANG TSZ KIT (51274232) CHEUK HIU KING (51362570) 1 CS3283 Distributed System Distributed File System Storage resource management Allocation and memory space 2 • Google File System = Distributed File System ? • Join together the file system of individual machines in network. • Stored on different machines but accessible from all machines. Google File System Challenges of File systems: • Scalability, Reliability, Availability • Highly fault tolerance • Inexpensive commodity hardware • High aggregate performance • High throughput -> low latency • Concurrent append to the same file • Workloads – Large streaming reads (read) – Small random reads (read) 3 • GFS including single master, multiple clients and multiple chunk servers. – Master is used to store the metadata – Chunk server store the data – Client follow the application’s needs to read or write Figure 1: GFS Architecture Architecture 4 Master : • Only one master • Stored metadata including: 1). File and chunk namespaces 2). The mapping from files to chunks 3). The locations of each chunk’s replicas • Control the whole system’s behavior • Use Heartbeat messages communicate with chunk server 1). Grasp the state of chunk server 2). Order chunk server Chunk server: • More than one chunk server • Store the formed data called chunk- Treated as Linux data stored in local hard drive • Chunk has include replicas (default is three) stored in each chunk server....
View Full Document

This note was uploaded on 01/17/2011 for the course CS CS3283 taught by Professor Kylam during the Spring '10 term at City University of Hong Kong.

Page1 / 21

Topic_2_PT - Topic 2 Replication management& Google File System Presented by LEE HO MING(51306210 TSANG TSZ KIT(51274232 CHEUK HIU KING(51362570

This preview shows document pages 1 - 6. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online