Next: The Need for HPC's Up: Parallel Documentation Index

Undergraduate Year 2 - Parallel Processing Course

Lecture notes + associated exercises and answers

Index

The Need For High Performance Computers
Classification of Parallel Machines
SISD
MISD
SIMD
MIMD
SPMD
Fundamentals of Interprocessor Communication
Shared Memory Basics
Interconnection Networks Basics
Examples
Shared Memory and Message Passing
EREW
CREW
ERCW
CRCW
Interconnection Networks
All-to-All
Mesh
Rings
Hypercube
Shuffle Exchange
Cube Connected Cycles
Metrics for Interconnection Networks
Parallel Algorithm Construction
Algorithmic Parallelism
Geometric Parallelism
Asynchronous / Relaxed Parallelism
Factors That Limit Speedup
Defining Speedup and Efficiency
Factors That Limit Speedup
Amdahls Law

Computer Science Home Page Page