Lesson 12 Date: 4/16/2014

High Performance Computing (part I)

Linux for Engineering and IT applications

Message Passing Interface (MPI) MPI is the standard of programming parallel applications using message passing. Processes run on network distributed hosts and communicate by exchanging messages. A community of communicating processes is called a Communicator. The default communicator is called MPI_COMM_WORLD. Inside a communicator, each process is attributed a "process ID", called rank.

Parallel Computing HPC paradigms Amdahl's law OpenMP Parallel regions and loops Parallel sections Synchronization Constructs Message Passing Interface (MPI) General MPI Program Structure Point to Point Communication MPI Standard Data Types MPI Send/Receive example MPI Collective Communications Collective Communication Example Master-Slave Task Farming Computing Partial Sums VM for MPI cluster OpenMPI installation MPI code compilation and run in OpenMPI References Take me to the Course Website