I. Fundamental Parallel Programming

1. Introduction to Parallel Programming (basic about parallel systems and concepts)
2. Message-Passing Computing

Introduction to message passing interface (MPI) (basic blocking communication, I/O, and nonblocking communication)

Collective communication in MPI

3. Embarrassingly Parallel Computations
4. Partitioning and Divide-and-Conquer Strategies
5. Pipelined Computations
6. Synchronous Computations
7. Load Balancing and Termination Detection
8. Programming with Shared Memory

II. ALGORITHMS AND APPLICATIONS

9. Sorting Algorithms
10. Numerical Algorithms
11. Image Processing
12. Searching and Optimization

 

Main page
Table of Content
Homework/Projects, Quiz and Exams
Syllabus
Policy