Parallel Computer Architecture and Programming

Course ID 15418

Description The fundamental principles and engineering tradeoffs involved in designing modern parallel computers, as well as the programming techniques to effectively utilize these machines. Topics include naming shared data, synchronizing threads, and the latency and bandwidth associated with communication. Case studies on shared-memory, message-passing, data-parallel and dataflow machines will be used to illustrate these techniques and tradeoffs. Programming assignments will be performed on one or more commercial multiprocessors, and there will be a significant course project.

Key Topics
Parallel programming models / frameworks; Characteristics of parallel hardware; Ubiquitous computing workloads

Required Background Knowledge
15-213 is required. Other experience with systems and C programming is valuable. This course 15-418 is for undergraduates. Graduate students should enroll in 15-618.

Course Relevance
From smart phones, to multi-core CPUs and GPUs, to the world's largest supercomputers and web sites, parallel processing is ubiquitous in modern computing. This class covers how these systems operate and are programmed.

Course Goals
Provide a deep understanding of the fundamental principles and engineering trade-offs involved in designing modern parallel computing systems as well as to teach parallel programming techniques necessary to effectively utilize these machines.

Learning Resources
Piazza; Course website

Assessment Structure
Programming Assignments: 40 percent; Exams: 30 percent; Final Project: 25 percent; Participation: 5 percent

Course Link
http://15418.courses.cs.cmu.edu