CUDA Programming

Online Course on CUDA Programming

Organized by NSM Nodal Centre for Training in HPC and AI, IIT Madras

Event Details
Date: Monday, May 2, 2022 to Friday, June 17, 2022
Venue: Online (IIT Madras)
Site URL: Course Page
 

 
About the Course
This course introduces participants to CUDA programming for GPU acceleration. Delivered via live online lectures and interactive doubt sessions, it covers foundational and advanced topics in parallel computing using CUDA.
Topics Covered:
  • Introduction to GPU computing
  • Hello World in CUDA
  • Program flow and cudamemcopies
  • Thread organization and blocks
  • GPU computation hierarchy and matrix operations
  • Thread divergence and memory types
  • Memory coalescing, AoS vs. SoA
  • Shared memory and bank conflicts
  • Compute capabilities and synchronization
  • Mutual exclusion, atomics, and barriers
  • Reductions, prefix sums, and functions
  • Multi-dimensional arrays in C/CUDA
 

 
Schedule
Each session is 90 minutes long, including Q&A. The final session includes an online exam (MCQ format).
  • May 2 – Introduction to GPU
  • May 4 – Hello World in CUDA
  • May 6 – Program Flow & cudamemcopies
  • May 9 – Thread Organization
  • May 11 – Computation Hierarchy & Matrix Squaring
  • May 13 – Thread Divergence
  • May 16 – Memory Types & Latency
  • May 18 – Memory Coalescing
  • May 20 – Shared Memory
  • May 23 – Bank Conflicts
  • May 25 – Compute Capabilities
  • May 27 – Data Race & Synchronization
  • May 30 – Mutual Exclusion
  • June 1 – Atomics
  • June 3 – Barriers
  • June 6 – Reductions & Prefix Sum
  • June 8 – Functions
  • June 10 – Support Topics
  • June 13 – CUDA Topics
  • June 15 – Multi-dimensional Arrays
  • June 17 – Online Exam
 

 
Instructor
  • Jash Khatri, MS Scholar, CSE, IIT Madras
  • Researcher in Graph Algorithms on GPUs
  • Incoming Software Engineer at Microsoft
 

 
Certificate
Participants who attend at least 15 sessions and complete the exam will receive a course completion e-certificate. The exam score will not affect certification.
 

 
Registration
  • Registration was free and mandatory
  • E-meeting details were emailed one week before the course began