Machine learning

Lecturer(s): Emmanuel DELLANDREA, Liming CHEN, Mohsen ARDABILIAN


Deep learning has revolutionized an increasing number of domains, e.g., computer vision, natural language processing, games, etc. Structured learning is machine learning which aims to output data, e.g., sequences, matrix, graphs, which have components under some dependencies, e.g., words in a sentence. In this course, we aim to introduce fundamental concepts, theories and advanced techniques in deep structured learning, covering in particular sequence to sequence learning and Generative Adversarial Network (GAN). A number of practical works will be scheduled, including for instance image generation, image to text generation, text-to-image generation, style transfer, etc.

Palabras clave

Structured learning, recursive networks, LSTM, Attention-based models, Transformer, Bert, GAN


Sequence to sequence learning

  • Recursive Network, LSTM, GRU
  • Attention-based Model
  • Transformer
  • Language models, ELMO, BERT, GPT

Generative Adversarial Network (GAN)

  • Basics
  • Conditional GAN
  • Unsupervised cGAN
  • Theory and General framework of GANs
  • Evaluation of GAN
  • Applications: face editing, speech generation

Learning Outcomes

  • Understand the basic principles of deep structured learning
  • ◊ Know how to implement state of the art techniques and methods, e.g., LSTM, Transformer, and GANs, for practical structured learning problems
  • know how to evaluate the quality of an implemented deep structured learning method


Final exam and scores of BE