IKC-MH.57 Introduction to High Performance and Parallel Computing

2022-2023 Spring

Most recent announcement: June20

Announcements

Watch this space for the latest updates (If the characters do not show properly, please try viewing this page with Unicode (UTF-8) encoding). Last updated:

Tue, June 20, 2023 Final Examination grades are available, see Course Schedule section

Thu, June 1, 2023 Final Examination will be as take-home work, see Course Schedule section

Thu, June 1, 2023 Midtem Examination grades are available, see Course Schedule section

Wed, May 24, 2023 Lecture notes for week12 is published, see Course Schedule section

Wed, May 10, 2023 Lecture notes for week11 is published, see Course Schedule section

Sun, April 30, 2023 Lecture notes for week10 is published, see Course Schedule section

Wed, April 12, 2023 Lecture notes for week9 is published, see Course Schedule section

Wed, April 12, 2023 Lecture notes for week8 is published, see Course Schedule section

Wed, April 12, 2023 No lecture at week7. Midtem Examination will be as take-home work, see Course Schedule section

Fri, March 31, 2023 Lecture notes for week6 is published, see Course Schedule section

Thu, March 23, 2023 Lecture notes for week5 is published, see Course Schedule section

Thu, March 16, 2023 Lecture notes for week4 is published, see Course Schedule section

Wed, March 8, 2023 Lecture notes for week3 is published, see Course Schedule section

Thu, March 2, 2023 Lecture notes for week2 is published, see Course Schedule section

Thu, February 23, 2023 In the first lecture, there will be first meeting. The lecture notes will be published soon, see Course Schedule section.

Back to top

Lecture Information

Almost all computer systems today are multi-core processors systems. Parallel programming must be used to take benefit of the full performance of such systems. Parallel programming also describes the processes and instructions for dividing a larger problem into smaller steps. The instructions are passed to multiple processors for required calculations to be executed in parallel. A practical approach to parallel program design and development will be presented in the course content. Awareness of potential design and performance concepts in heterogeneous computer architectures will be gained. Important announcements will be posted to the Announcements section of this web page, so please check this page frequently. You are responsible for all such announcements, as well as announcements made in lecture.

Back to top

Course Overview

IKC-MH.57 is intended to provide students an introduction to parallel programming by using C and/or similar programming languages. In this course, the basics of high performance and parallel computing will be given. OpenMP (Open Multi-Processing) in multi-core systems and MPI (Message Passing Interface) message passing in distributed memory systems will be taught for parallel programming. MPI is the industry standardized parallelization paradigm in high-performance computing and enables programs to be written that run on distributed memory machines. OpenMP is a thread-based approach to parallelize a program over a single shared memory machine. An introduction to the basic concepts of hybrid and accelerated paradigms as Cuda OpenCL programming will be given. The course consists of theoretical topics and hands-on practical exercises on parallel programming.

Upon completion of this course the students will be able to understand/explain/apply;

• Learn how to work in a scientific computing environment.

• Gain awareness of Parallel and High Performance Computing concepts for systems with shared/distributed memory.

• Can write parallel programs both for systems with shared memory using threading (OpenMP ) and systems with distributed memory using message passing (MPI).

• May define the MPI message passing standard’s control of communication between processes, subroutines, or functions within the program.

• Gains basic knowledge of Cuda OpenCL hybrid and accelerated paradigms.

• Gains the ability and understanding to develop parallel programs to solve a given big numerical/engineering/scientific problem.

Back to top

Text Book

Lecture material will be based on them. It is strongly advised that student should read textbooks rather than only content with the lecture material supplied from the lecturer.

Back to top

Online Resourcess

The following resources are available online. Please inform me about the usefullness of the materials. Check this place for updates.

Back to top

Grading Criteria

• Midterms & Final Exams: There will be one midterm and one final exam, will count 30% each and 40% of your grade, respectively.

• Homeworks/Assignments (or Term Project): 30%.

Back to top

Policies

• Attendance is not compulsory (30%), but you are responsible for everything said in class.

• You are allowed to work in groups of two students on the homework unless otherwise mentioned.

• You can use ideas from the literature (with proper citation).

• You can use anything from the textbook/notes.

• Exams: 1 page of notes (double sides) is allowed.

• I encourage you to ask questions in class. You are supposed to ask questions. Don't guess, ask a question!

Back to top

Tentative Course Outline

Back to top

Tentative Course Schedule & Lecture Notes

The following schedule is tentative; it may be updated later in the semester, so check back here frequently.

Back to top

References (other than text books)

• https://www.cs.purdue.edu/homes/ayg/book/Slides/

• https://sites.cs.ucsb.edu/~tyang/class/240a17/

• https://hpc-tutorials.llnl.gov/

Back to top