lecture1 - Parallel Computer Architectures Tarek A....

Info iconThis preview shows pages 1–6. Sign up to view the full content.

View Full Document Right Arrow Icon
1 Tarek El-Ghazawi, Parallel Computer Architectures slide 1 of 36 Parallel Computer Architectures Tarek A. El-Ghazawi Department of Electrical and Computer Engineering The George Washington University Tarek El-Ghazawi, Parallel Computer Architectures slide 2 of 36 Introduction to Parallel Computing Systems Outline Definitions and Conceptual Classifications » Parallel Processing, MPP’s, and Related Terms » Flynn’s Classification of Computer Architectures Operational Models for Parallel Computers Interconnection Networks MPP’s Performance
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
2 Tarek El-Ghazawi, Parallel Computer Architectures slide 3 of 36 Definitions and Conceptual Classification What is Parallel Processing? -- A form of data processing which emphasizes the exploration and exploitation of inherent parallelism in the underlying problem. Parallel Processing Vs. Distributed and Heterogeneous Processing! What are Massively Parallel Processors (MPP’s)-- Parallel processing systems which can use thousand(s) of processors to collaborate in solving a problem Tarek El-Ghazawi, Parallel Computer Architectures slide 4 of 36 Definitions and Conceptual Classifications Why MPP’s? » Increase processing speed and memory allowing studies of problems with higher resolutions or bigger sizes » Provide a low cost alternative to using expensive processor and memory technologies (as in traditional vector machines) MPP’s vs. SPP’s!
Background image of page 2
3 Tarek El-Ghazawi, Parallel Computer Architectures slide 5 of 36 Definitions and Conceptual Classifications: Flynn’s Classification Based on the multiplicity of data and instructions streams-- Categories = {single instr.(SI), multiple instr.(MI)} X {single data(SD), multiple data(MD)} SISD -- This is the uniprocessor architecture CU PE M IS IS DS I/O CU= Control Unit, PE= Processing Element, M= Memory Tarek El-Ghazawi, Parallel Computer Architectures slide 6 of 36 Definitions and Conceptual Classifications: Flynn’s Classification SIMD-- PE PEM PE PEM CU IS IS DS DS DS DS
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
4 Tarek El-Ghazawi, Parallel Computer Architectures slide 7 of 36 Definitions and Conceptual Classifications: Flynn’s Classification MIMD (Shared Memory)-- CU PE CU PE Shared Memory IS IS DS IS IS DS Tarek El-Ghazawi, Parallel Computer Architectures slide 8 of 36 Definitions and Conceptual Classifications: Flynn’s Classification MISD -- » Systolic array like CU PE IS CU PE IS CU PE IS Memory DS DS DS DS
Background image of page 4
5 Tarek El-Ghazawi, Parallel Computer Architectures slide 9 of 36 Definitions 3 Types of Prallelism could be seen in a program » Data Parallelism -- many data items can be processed in the same manner at the same time » Functional Parallelism -- program has different independet modules that can execute simultaneously » Overlapped/Temporal Parallelism -- program has a sequence of tasks that can be executed in an overlapped fashion. The most important form of this overlapped parallelism is PIPELINING .
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 6
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 09/24/2009 for the course CS 525 taught by Professor Rjyosy during the Winter '09 term at Central Mich..

Page1 / 18

lecture1 - Parallel Computer Architectures Tarek A....

This preview shows document pages 1 - 6. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online