MPCS 52060 Parallel Programming (Summer 2025)

Section 1
Instructor(s) Hückelheim, Jan (jhueckelheim)
Location Online
Meeting Times Wednesday 5:30pm - 7:30pm
Fulfills Core Systems Elective Specialization - High Performance Computing (HPC-2)

Syllabus

Course Description 

 
Parallel computing is found everywhere in modern computing.  Multi-core CPUs and GPUs, supercomputers, and even mobile devices such as smartphones all provide ways to efficiently utilize parallel processing on these architectures and devices. The goal of this course is to provide an introduction to the foundations of parallel programming and to consider the performance gains and trade-offs involved in implementing and designing parallel computing systems. Specifically, this course will place an emphasis on concepts related to parallel programming on multicore processors. 

Course Contents


Topics that will be explored in the course will include (but not limited to) the following:
 
  • Processes and threads 
  • Shared memory
  • Hardware mechanisms for parallel computing 
  • Synchronization and communication for parallel systems 
  • Performance optimizations 
  • Parallel data structures 
  • Memory consistency and hierarchies for parallel computing 
  • Patterns of parallel programming 
  • Parallel programming on GPUs
  • Additional topics dependent on student request and time 

Coursework 

The course will include weekly homework, two exams, and projects. The weekly assignments will contain practice problems to help enforce the concepts learned during a lecture. The projects provide the opportunity to apply the skills you learned to develop systems that can benefit from parallelization. Potential project domains could include: AI and machine learning, computer graphics, cryptocurrency technologies, scientific visualization, etc. 
 

Course Textbook(s)

 
This course will not have a required textbook. Along with the lecture notes, students may find the following references helpful in undersntading the course material: 

The Art of Multiprocessor Programming by Maurice Herlihy and Nir Shavit
 
 
Additional readings/references will be provided when necessary.  

Course Prerequisites

MPCS Students: Core Programming completed (MPCS 51036, or 51040, or 51042, or 51046, or 51100) or Core Programming Waiver.

Non-MPCS Students: Must have completed CMSC 14200, CAPP 30122 or MACS 30122 or MPCS Programming Placement Exam I.

Course request information for non-MPCS students: https://masters.cs.uchicago.edu/student-resources/non-mpcs-student-course-requests/

Other Prerequisites

This is an advanced Core Systems class and we recommend that students take MPCS 51082 Introduction to Unix Systems or MPCS 52011 Introduction to Computer Systems before enrolling in this course.

This course requires competency in Unix and Linux. If you attended the MPCS Unix Bootcamp you covered the required material. If you did not, please review the UChicago CS Student Resource Guide here: https://uchicago-cs.github.io/student-resource-guide/.

Overlapping Classes

This class is scheduled at a time that conflicts with these other classes:

  • MPCS 52011-1 -- Introduction to Computer Systems
  • MPCS 51200-1 -- Introduction to Software Engineering

Eligible Programs

MS in Computational Analysis in Public Policy (Year 1) MS in Computational Analysis in Public Policy (Year 2) MS in Molecular Engineering MA in Computational Social Science (Year 1) MA in Computational Social Science (Year 2) Bx/MS in Computer Science (Option 1: Research-Oriented) Bx/MS in Computer Science (Option 2: Professionally-oriented - CS Majors) Bx/MS in Computer Science (Option 3: Profesionally-oriented - Non-CS Majors) Masters Program in Computer Science