Module Number

INFO-4173
Module Title

Massively Parallel Computing
Lecture Type(s)

Lecture, Tutorial
ECTS 6
Work load
- Contact time
- Self study
Workload:
180 h
Class time:
60 h / 4 SWS
Self study:
120 h
Duration 1 Semester
Frequency In the summer semester
Language of instruction English
Type of Exam

Oral examination (written exam if there are a large number of participants), successful exercises can result in a grade bonus

Content

The lecture introduces the necessary concepts of parallel processing, and gives an overview of the currently available hardware. Furthermore, basic parallel algorithms, e.g. Map, Reduce, Prefix Sum, Branching, but also parallel applications like FFT, particle systems and simulations etc. are covered. In order to develop efficient parallel solutions for new problems, appropriate approaches and complexity analyses will be taught.

Objectives

A current trend of all chip manufacturers is to integrate more and more computing units on one chip, e.g. with several hundred processors on one graphics card. In order to use these architectures efficiently, suitable algorithms must be chosen and the problems optimised in terms of memory bandwidth. (1) The aim of the lecture is to enable the students to analyse a given problem with regard to the possible increase in efficiency through parallelisation. (2) They are able to develop suitable algorithms to work out a massively parallel implementation as fast as possible. (3) They are able to optimise their programs in terms of memory bandwidth, GPU utilisation and registers by profiling.

Allocation of credits / grading
Type of Class
Status
SWS
Credits
Type of Exam
Exam duration
Evaluation
Calculation
of Module (%)
Lecture
V
o
2
3.0
ot
25
g
100
Tutorial
Ü
o
2
3.0
Prerequisite for participation There are no specific prerequisites.
Lecturer / Other Lensch
Literature

Hubert Nguyen: GPU Gems 3, Addison Wesley; T. Mattson, B. Sanders, B.
Massingill: Patterns for Parallel Programming, Addison Wesley ; gpgpu.org
- General-Purpose Computation Using Graphics Hardware; NVIDIA CUDA
page; NVIDIA CUDA Programming Guide ; Vorlesungsfolien werden bereitgestellt

Last offered Sommersemester 2022
Planned for Sommersemester 2025
Assigned Study Areas INFO-INFO, INFO-PRAK, INFO-TECH, MEDI-APPL, MEDI-INFO, MEDI-MEDI, MEDI-MMT, MEDI-PRAX, MEDI-VIS, MEDZ-MEDTECH, ML-CS