23-Parallel Processing

23-Parallel Processing - Parallel Processing Presenter...

Info iconThis preview shows pages 1–14. Sign up to view the full content.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon

Info iconThis preview has intentionally blurred sections. Sign up to view the full version.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: Parallel Processing Presenter Tathagata Bhattacharjee Tathagata Bhattacharjee hy Parallel Processing? Computation requirements are ever increasing -- visualization, distributed databases, simulations, scientific prediction (earthquake), etc. Sequential architectures reaching physical limitation (speed of light, thermodynamics) Tathagata Bhattacharjee Human Architecture! Growth Performance Age Growth 5 10 15 20 25 30 35 40 45 . . . . Vertical Horizontal Tathagata Bhattacharjee No. of Processors C.P.I. 1 2 . . . . Computational Power Improvement Multiprocessor Uniprocessor Tathagata Bhattacharjee caution..... z Speed of computers is proportional to the square of their cost. i.e. cost = Speed Speedup by a parallel computer increases as the logarithm of the number of processors. z Speedup = log2(no. of processors) S P l o g 2 P C S (speed = cost 2 ) Tathagata Bhattacharjee Multiple Processor Organization Single instruction, single data stream - SISD Single instruction, multiple data stream - SIMD Multiple instruction, single data stream - MISD Multiple instruction, multiple data stream- MIMD Tathagata Bhattacharjee SISD : A Conventional Computer Processor Processor Data Input Data Output I n s t r u c t i o n s Î Speed is limited by the rate at which computer can transfer information internally. Ex:PC, Macintosh, Workstations Tathagata Bhattacharjee Single Instruction, Single Data Stream - SISD Single processor Single instruction stream Data stored in single memory Uni-processor Tathagata Bhattacharjee SIMD Architecture C i <= A i * B i Instruction Stream Processor A Processor B Processor C Data Input stream A Data Input stream B Data Input stream C Data Output stream A Data Output stream B Data Output stream C Ex: CRAY machine vector processing, Thinking machine cm* Intel MMX (multimedia support) Tathagata Bhattacharjee Single Instruction, Multiple Data Stream - SIMD Single machine instruction Controls simultaneous execution Number of processing elements Each processing element has associated data memory Each instruction executed on different set of data by different processors Vector and array processors Tathagata Bhattacharjee The MISD Architecture Data Input Stream Data Output Stream Processor A Processor B Processor C Instruction Stream A Instruction Stream B Instruction Stream C Î More of an intellectual exercise than a practicle configuration. Few built, but commercially not available Tathagata Bhattacharjee Multiple Instruction, Single Data Stream - MISD Sequence of data Transmitted to set of processors Each processor executes different instruction sequence Never been implemented Tathagata Bhattacharjee MIMD Architecture Processor A Processor B Processor C Data Input stream A Data Input stream B Data Input stream C Data Output stream A Data Output stream B Data Output stream C Instruction Stream A Instruction Stream B Instruction Stream C Unlike SISD, MISD, MIMD computer works asynchronously....
View Full Document

{[ snackBarMessage ]}

Page1 / 55

23-Parallel Processing - Parallel Processing Presenter...

This preview shows document pages 1 - 14. Sign up to view the full document.

View Full Document Right Arrow Icon
Ask a homework question - tutors are online