1. »
  2. Studium
  3. »
  4. Lehrveranstaltungen
  5. »
  6. semToDLSProc

Seminar Topics in deep learning for sequence processing

NUMMER: 310528
KÜRZEL: semToDLSProc
MODULBEAUFTRAGTE:R: Dr.Anand Subramoney
DOZENT:IN: Dr. Anand Subramoney
FAKULTÄT: Fakultät für Informatik
SPRACHE: Deutsch
SWS: 2
CREDITS: 3
WORKLOAD: 60 Stunden
ANGEBOTEN IM: jedes Wintersemester

LERNFORM

Vertiefungsseminar

LERNZIELE

After the successful completion of this course the students
∙ understand models for sequence processing including recurrent networks and transformers,
∙ understand core challenges of training these models working with time, and
∙ will be able to contextualize current publication with respect to those challenges.

INHALT

Natural language processing, robotics, video processing, stock market forecasting and other
similar tasks require models that can deal with sequence data and understand temporal dependencies. Two major classes of models that have been designed to deal with sequence data
are recurrent neural networks (RNNs/LSTMs) and transformer architectures. Designing and
understanding these models is a very active and diverse area of research. Applications of these
models are also widespread. The recent explosion of interest in topics such as language modelling and machine translation is based on advances in these models which includes GPT-3,
DALL-E, etc.
In this course you’ll first understand the fundamentals of recurrent neural networks and
transformers that led to these breakthroughs. Then we’ll go through and discuss both seminal
and recent research papers on these topics to throw light on algorithms and challenges in this
field.

VORAUSSETZUNGEN CREDITS

a) Successful presentation and positively evaluated written elaboration
b) Semester-long; successfully completed practical assignment(s) or practical project

EMPFOHLENE VORKENNTNISSE

Keine

AKTUELLE INFORMATIONEN

Stellenwert der Note für die Endnote: 3 / 112

SONSTIGE INFORMATIONEN

The allocation of the limited seminar places is done via the Moodle course "Masters Seminar:
Topics in deep learning for sequence processing" for the corresponding semester. Registration for the winter semester is possible until 11.10.2021. Please enter your degree program
in the comment field. Please also check the website for the course: https://www.ini.rub.de/
teaching/courses/topics_in_deep_learning_for_sequence_processing_winter_term_2021/