ArchModels

ArchModels - CSE721 - Introduction to Parallel Computing...

Info iconThis preview shows pages 1–8. Sign up to view the full content.

View Full Document Right Arrow Icon
CSE 721, Winter 2011 1 CSE721 - Introduction to Parallel Computing Instructor: P. (Saday) Sadayappan (email: [email protected]) office location: DL 595 (ph: 292-0053) office hours: TR 11-12:30, or by appointment Grader: Bin Ren ( email: [email protected]) office location: DL 774 (ph: 720-937-6240) office hours: MW 1:30-3:30pm Textbook: Kumar, Grama, Gupta, Karypis, Introduction to Parallel Computing: Design and Analysis of Algorithms ”, 2 nd Ed. Benjamin/Cummings (available online via Safari for OSU students). Acknowledgment for slides: Mario Lauria
Background image of page 1

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
CSE 721, Winter 2011 2 Objectives of the course Enable a student to: Understand the current state-of-practice in parallel programming languages Be familiar with algorithms for a number of numeric and non-numeric application areas Be familiar with current architectural trends Be able to design and implement efficient algorithms on parallel computers, and evaluate their performance
Background image of page 2
CSE 721, Winter 2011 3 Course Topics (tentative) High-Performance Computing Architectures and Models Basic Communication Operations Performance and Scalability of Parallel Systems Parallel Programming using OpenMP, MPI, CUDA (CSE 621) Vector Instructions Sets (SSE, AVX, etc.) PGAS (Parallel Global-Address-Space) Programming Models Algorithms Dense/sparse Matrix Algorithms Sorting FFT Multi-core Architectures and Current Trends
Background image of page 3

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
CSE 721, Winter 2011 4 Grading plan Assignments: 20% Midterm: 25% Project: 20% Final: 35%
Background image of page 4
CSE 721, Winter 2011 5 Assignments Two to three homework plus two to three programming assignments will be given Individual accounts on OSC machines will be available for the programming assignments Some programming assignments will require the use of MPI, OpenMP, CUDA; it is expected that students are already familiar with them from CSE 621.
Background image of page 5

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
CSE 721, Winter 2011 6 Parallel Architectures: Classification Classification can be performed according to two different points of view: logical - the programmer’s view of the machine physical - the designer’s view of the hardware Programmer’s view - two important aspects of parallel programming: how to describe parallel tasks the mechanisms for task-to-task interactions
Background image of page 6
CSE 721, Winter 2011 7 Logical organization The way of describing parallel tasks is also referred to as control structure SPMD, MIMD, SIMD (S ingle/M ultiple I nstruction, M ultiple D ata) models differs in granularity of parallelism The mechanisms for specifying task-to-task interaction are also referred to as the communication model main classification: message passing vs. shared memory The logical organization of a machine is generally (but not necessarily) related to the physical view
Background image of page 7

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full DocumentRight Arrow Icon
Image of page 8
This is the end of the preview. Sign up to access the rest of the document.

This note was uploaded on 03/08/2012 for the course CSE 721 taught by Professor Saday during the Winter '11 term at Ohio State.

Page1 / 41

ArchModels - CSE721 - Introduction to Parallel Computing...

This preview shows document pages 1 - 8. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online