Module Number

ML-4508
Module Title

Virtual Humans
Lecture Type(s)

Lecture, Tutorial
ECTS 9
Work load
- Contact time
- Self study
Workload:
270 h
Class time:
90 h / 6 SWS
Self study:
180 h
Duration 1 Semester
Frequency In the winter semester
Language of instruction English
Type of Exam

Oral or Written (depending on the number of students)

Content

A virtual human is a digital representation of a real human. Virtual humans (VH) should look, move and eventually think like real humans. Building such VH is one of the long standing goals of Artificial Intelligence.
Learning them requires techniques and algorithms at the intersection of Machine Learning, Computer Vision and Computer Graphics. In this course, we will cover the key mathematical foundations and computational tools to learn VH from 3D scans, images and video of real humans. The course will cover classical representations of humans based on 3D meshes and textures, as well as modern ones where the appearance and behavior of virtual humans are encoded in neural networks.

Objectives

Understand the mathematical tools and algorithms to build VH from data. At the end of the course, students will be familiar with the state of the art in human motion and shape modeling, estimation of pose, shape and humans in clothing from images and video, as well as learning generative models of human motion conditioned on 3D scene geometry. Students should be able to apply the concepts in practice, develop and train models, reproduce research and conduct original research in this area.

Allocation of credits / grading
Type of Class
Status
SWS
Credits
Type of Exam
Exam duration
Evaluation
Calculation
of Module (%)
Prerequisite for participation There are no specific prerequisites.
Lecturer / Other Pons-Moll
Literature

Related literature will be posted on the course website (https://virtualhumans.mpi-inf.mpg.de/DH22/). Knowledge of linear algebra, optimization and probability (e.g, mathematics for machine learning) and coding skills (Python).
Experience with deep learning (e.g, Deep Learning course).

Last offered Wintersemester 2022
Planned for Wintersemester 2023
Assigned Study Areas INFO-INFO, INFO-PRAK, MEDI-APPL, MEDI-HCI, MEDI-INFO, MEDI-MEDI, ML-CS, ML-DIV