Parallel and Distributed Computing (CSC4160)

Instructor: Dr. John C.S. Lui

This course introduces concepts, models, and implementations related to parallel and distributed computing.

For parallel computing, we will discuss computational models, parallel communication operations, performance and scalability, parallel matrix algorithms, parallel algorithms for solving systems of linear equations, parallel sorting algorithms, parallel graph algorithms, parallel algorithms for dynamic programming, parallel searching algorithms.

For distributed computing, we will discuss remote procedure calls, distributed time and coordination, distributed replications, concurrency control, commitment protocols, distributed checkpointing algorithms, global state and the snapshot algorithm.

Programming assignments will be given so that students can understand the topics discussed in class.

Related textbooks

• Introduction to Parallel Computing
  by V. Kumar, A. Grama, A. Gupta, G. Kaarypis (Addison Wesley Press)

• Distributed Systems: Concepts and Design
  by G. Coulouris, J. Dollimore and T. Kindberg (Addison Wesley Press)

• Advanced Concepts in Operating Systems ( reference book )
  by M. Singhal, N.G. Shivaratri (McGraw-Hall International)

• Distributed Systems ( reference book )
  edited by S. Mullender (Addison Wesley Press)

• Fault Tolerance in Distributed Systems ( reference book )
  by Pankaj Jalote (Prentice Hall Press)

Lecture Notes