Topics in Grid Computing

SE 293 (3:0)

Topics in Grid Computing

Class

Instructor

Sathish Vadhiyar

Books

The Grid: Blueprint for a New Computing Infrastructure (2nd edition) by Ian Foster (Editor), Carl Kesselman (Editor) Publisher: Morgan Kaufmann; 2^nd edition (November 2003) ISBN: 1-558-60933-4.
Grid Computing: Making the Global Infrastructure a Reality by Francine Berman (Editor), Geoffrey Fox (Editor), Tony Hey (Editor) Publisher: John Wiley & Sons; (April 8, 2003) ISBN: 0-470-85319-0.
Grid Resource Management: State of the Art and Future Trends by Jarek Nabrzyski (Editor), Jennifer M. Schopf (Editor), Jon Weglarz (Editor) Publisher: Kluwer Academic Publishers; (September 2003) ISBN: 1-402-07575-8.

Syllabus

Orientation

Introduction
1. Motivation
2. Definitions of Grid Computing
3. Evolution of the Grid
4. Differences with similar efforts (Meta, cluster, heterogeneous, Internet)
5. Examples of usage
6. Research possibilities / scope in Grid Computing
7. Thrust area in this course
High Performance computing across installation sites
1. PACX-MPI, MPI-Connect, P-MPI
2. I-WAY experiment
Earliest Grid Tools / Projects
1. Condor Part 1, Part 2
2. Globus Part 1, Part 2
3. Nimrod
Grid Basics - Technologies / Challenges
1. Security - Different models
  1. SSL
  2. Kherberos
  3. SASL
  4. GSI
  5. Others
2. Information Services
  1. NWS
HPC and Grids
1. Some more about scheduling - scheduling HPC applications in Grids
  1. AppLeS
  2. Scheduling Parameter sweep applications
  3. Metascheduling Part1, Part2
2. Grid RPC mechanisms - Part1, Part2
3. Rescheduling
4. Computational Steering, Scientific visualization of Grid applications
5. Grid Applications - Everywhere and Cactus experiments
6. Data management
  1. Data distribution
  2. Redistribution
  3. Data cache maintenance
Recent Efforts / Challenges
1. Grid economy
2. Grid simulation - SimGrid, GridSim, MicroGrid
3. Grid standards and forums - OGSA, GGF and Other topics

Assignments

Simple assignments using Grid tools/services/techniques

Big Assignments - 10% each
- Simple metacomputing middleware
- Jacobi Iterations on Condor
- AppLeS and 2-D Jacobi
Small Assignments - 5% each
- NetSolve Usage
- APST Usage
- GridFTP Usage

Final Project

MPI collective communications for Grids
Executing MPI across 2 sites - one with batch scheduling and other with interactive scheduling
Modeling a HPC application's execution time on Grid systems based on NWS
Modeling data movement time based on NWS; Validating NWS network load changes and modeling network behavior
Determining Grid machine and network topologies
Grid system with HPC software signatures, ownerships and trusts
A Grid system with different scheduling strategies and dynamically choosing an appropriate scheduling strategy
Coupling of suspension and migration in Condor
Integrating Globus in NetSolve - NetSolve-G.
Computational steering in Globus/Condor/NetSolve
Incorporating logistical computing in exNode.
Dynamically defining rescheduling thresholds.

Chosen Projects:

Team	Project
Ashima Gupta, Vishal Sharda	Determining Network Topology for Collective Communications for Grids
Chidansh Bhatt, L. Ravi, Hema	A Grid system with different scheduling strategies and dynamically choosing an appropriate scheduling strategy
Himanshu Dhar, Surya Prakash	Modeling network contention
JayYagnik Narendra, S.D. Penurkar	Performance prediction of parallel application based on historical data
Nagalinga Rajan, Sunil Kumar	New forecasting techniques for NWS
Sandip Tikar	Execution traces and data redistribution
Tarun Saxena	Determining Grid machine and network topology
Rakhi Gupta	MPI collective communications for Grids