SE 292: High Performance Computing (3:0)

Class

1. Ankit Shrivatsava
2. Md. Imbesat Hassan Rizvi
3. GVK Madhav
4. Manglani Krishna Prem
5. Ponnezhil Dass MP
6. Prateek Kushwaha
7. Rajrup Ghosh
8. Rakesh Kumar Mallik
9. Snehansu Sekar Sahu
10. Srinivas K
11. Vandana AS

Instructors

Matthew Jacob and Sathish Vadhiyar

Reading Materials

• Computer Systems - A Programmer's Perspective
  by  Bryant and O'Hallaron.
• Operating System Concepts, 8th Edition
  by  Silberschatz, Galvin and Gagne. John Wiley & Sons. ISBN: 978-0-470-12872-5
• Introduction to Parallel Computing
  by  Ananth Grama, Anshul Gupta, George Karypis, Vipin Kumar Publisher: Addison Wesley; (2003) ISBN: 0-201-64865-2
• Parallel Computing Architecture
  by  David Culler, Jaswant Singh Publisher: Morgan Kauffman
• MPI: The Complete Reference. Available Online.
• Various publication materials, lecture slides

Meeting Hours

  Tuesday: 3:30-5:00 PM, Friday: 9:30-11:00 AM. SERC 221.

Grading System (for Sathish Vadhiyar's portions)

• Sessionals

  • 1 Mid-Term Exam (November 6) - 10

  • Assignments & Home Works - 15

• Terminal

  • Final Exam (December 2 afternoon) - 25

Syllabus (for Sathish Vadhiyar's portions)

1. Memory and Process Management ppt
   1. Main Memory - Swapping, Allocation, Paging, Page tables, Segmentation
   2. Virtual Memory - Demand Paging, Copy-on-Write, Page replacement, Frames, Thrashing
   3. Reading:
      1. Bryant and O'Hallaron - 697-700, 704-705, 709-711, 727, 735-736, 755-757
      2. Silberschatz et al. - 365-369, 372-373, 378-381, 386-391, 396-397, 400-401
      3. Silberschatz et al. - 187-198
2. Concurrency ppt
   1. Interprocess communication
   2. Synchronization - Mutual exclusion, critical section, locks, testandwait, semaphores, classical problems
   3. Threads, Multi-threading
   4. Parallel architecture, classification, interconnection networks, cache coherence
   5. Reading
      1. Bryant and O'Hallaron - sections 13.1, 13.3, pages 869-882, sections 13.7.1, 13.7.4, 13.7.5
      2. Silberschatz et al. - 3.5.1, 3.6
      3. Silberschatz et al. - 4.1.1, 4.1.2, 4.2, 4.3.1, 4.4.6
      4. Silberschatz et al. - 5.4
      5. Silberschatz et al. - 6.2, 6.4 (231, 232), 6.5, 6.6.1, 6.6.3
      6. Silberschatz et al. - 7.2, 7.5.1, 7.5.3
      7. Grama et al. - 2.4
3. Parallelization ppt
   1. Motivations for parallel programming, challenges, metrics, programming models
   2. steps in parallelization - decomposition, assignment, orchestration, mapping
   3. Reading
      1. Grama et al. - 3.1, 3.5
      2. Grama et al. - 5.1-5.6
      3. Culler and Singh - Sections 2.2 and 2.3
4.  Popular programming languages - MPI, OpenMP, Cuda
5. Storage Management ppt
   1. File System Interface and Implementation - Concept, Access Methods, Structures, Allocation, Implementation, Efficiency, NFS
   2. Storage Structures - Scheduling, Management, Implementation, RAID
   3. I/O Systems
   4. Reading
      1. Silberschatz et al. - sections 11.1, 11.2.1, 11.4, 11.6, 11.7
      2. Silberschatz et al. - sections 12.1.1, 12.3, 12.4, 12.7.1, 12.7.2,
      3. Silberschatz et al. - sections 13.2.2, 13.2.3, 13.3.4, 13.4.7, 13.5

Assignments (for Sathish Vadhiyar's portions)

• Important Notes

• Platform for Assignments

• Assignment 1 - Questions on virtual memory and processes

• Assignment 2 - Binary search tree using pthreads

• Assignment 3 - Lower triangle matrix - vector multiplication using OpenMP

• Assignment 4 - Jacobi using MPI, Merge-Sort using CUDA