Deep learning for natural language processing

This is the website for the Deep learning for NLP (OPT11) class of Master 2 AI at Université Paris-saclay.

About

Recently, neural networks trained end-to-end have obtained impressive results in many problems related to natural languages (e.g. machine translation). These deep learning techniques do not rely on manual feature extraction or rule-based systems. However, behind the scenes a large part of this success is due to the development of neural architectures that are able to handle structured inputs and outputs.

In this course, we will study how build neural networks for problems related to natural languages. Specifically, we will learn how to:

• build dynamic computation graphs for sequential inputs,

• predict structures (e.g. text generation, semantic parsing),

• introduce inductive bias.

Moreover, we will develop a critical analysis of state-of-the-art NLP models:

• do they actually learn what we expect?

• how does deep learning for NLP handle bias in training data?

Grading Scheme

• 100%: Lab exercises

Contact

You can contact me at caio.corro@u-psud.fr, either in French or English, with a subject starting with [DL4NLP]. Please, do not worry about typos or not being overly formal enough (just treat your instructors and colleagues with the same respect you would like to be treated).

WARNING: Each mail must discuss at most one point. Don’t send e-mails to several of my addresses. Thank you