Parallel Programming Practice (3:1)


class-PPP2006.jpg (776065 bytes)


Sathish Vadhiyar



    1. Introduction
      1. Scope of parallel computing
      2. Definitions of speedup, utilization, efficiency, scalability
      3. Amdahl's law - Parallel Processing
      4. Parallel architecture models , physical organization of parallel platforms
      5. Parallel programming paradigms, algorithm models
      6. Communication costs in parallel machines
      7. Principles of parallel algorithm design - Preliminaries, Decomposition techniques, Data distribution methods, Mapping techniques for load balancing
      8. Analytical modeling of parallel programs - Sources of overhead in parallel programs, Performance metrics for parallel programs, Asymptotic analysis of parallel programs, Other scalability metrics, Communication costs in parallel machines
    2.  Programming using the Message passing paradigm
      1. Principles of message-passing programming
      2. MPI: The Message Passing Interface
      3. Point-point, collectives
      4. Groups and communicators
      5. Process topologies
      6. Profiling interface
      7. Collective communication implementations
      8. MPI-2 overview
      9. An extended session on MPI I/O
    3. A Few Parallel Programs
      1. Vibrating string, Laplace equation, Molecular dynamics, WaTor
    1. Programming shared address space platforms
      1. Thread basics
      2. OpenMP: A standard for directive based parallel programming
    1. Linear algebra
      1. Matrix-vector multiplication
      2. Matrix-matrix multiplication
      3. Solving a system of linear equations
      4. Brief look at BLAS, LAPACK, ScaLAPACK
      5. Iterative methods for linear systems - Parallel conjugate gradient
      6. Parallel preconditioning
      7. Eigenvalue problems - parallel aspects
      8. Sparse solutions
        1. Sparse matrix direct methods
        2. Multifrontal methods
        3. Iterative methods
      9. Templates and linear algebra
    2. Advanced Topics
      1. Load balancing and scheduling
      2. FFT
      3. Checkpointing
      4. Benchmarks
      5. Others


  1. Fundamental Concepts, point-point benchmarking, collective communication implementations

  2. Parallel Matrix-Matrix multiply

  3. Parallel Ordering Using Kernighan-Lin

  4. MPI-I/O