Schedule
This is a reading group for Stanford NLP’s CS224N. We will mainly follow the official CS224N schedule, with slight modification.
Before each class, please read the respective lecture notes and watch the videos for that week. Lecture notes and videos can be found on CS224N website.
This is a community-led class. We will require one or two volunteer presenters each week who will present the topic and lead the discussion.
Main textbooks and resources:
Prof. Kyunhyun Cho’s Lecture Notes for NLP class at NYU: [link].
Syllabus will be updated.
|
Week |
Date |
Topic |
Reading List |
Presenters |
|
-
|
|
Pre-class Preparation: The first class (Week 1) officially begins on 29 November, 2020.
Additional readings are optional but strongly recommended. |
Numpy Tutorial [link]
High-level Intro to Neural Nets [link]
Hugo Larochelle’s Neural Network Lectures: Video 1.1 to 2.11 [link]
Additional readings: Chapter 2 and 3 of Cho’s lecture note
|
- |
|
1 |
29 Nov 2020 |
Word Vectors 1 (Intro to Distributional Semantics)
|
Additional readings: Suggested readings for CS224N W1.
Lena Voita’s [note] |
PMH |
|
2 |
6 Dec 2020 |
Word Vectors 2 and Word Senses
|
Additional readings: Suggested readings for CS224N Week 2. |
Khin Thet Htar,Tin Latt Nandar |
|
3 |
13 Dec 2020 |
Word Window Classification, Neural Networks, and PyTorch |
CS224N Lecture Note (Jan 14)
|
Sai Htaung Kham,Win Myat Thuzar |
|
4 |
20 Dec 2020 |
Matrix Calculus and Backpropagation |
CS224N Lecture Note (Jan 16)
|
Ma Htet Htet Mon,Naing Naing Maw |
|
5 |
27 Dec 2020 |
Linguistic Structure: Dependency Parsing |
CS224N Lecture Note (Jan 21) |
Yi Yi Chan Myae Win Shein,Nann Nann |
|
6 |
3 Jan 2021 |
Language Models and Recurrent Neural Networks |
|
Yan Paing Oo,Khit Sithu |
|
7 |
10 Jan 2021 |
Recurrent Neural Networks 2 |
|
Yan Paing Oo(SG),Hsu Wai Naing |
|
8 |
17 Jan 2021
|
Machine Translation: Sequence to Sequence models and Beam Search |
|
Kyawt Kyawt San,Khin Thandar Kyaw |
|
9 |
24 Jan 2021 |
Machine Translation: Transformers |
|
Khaing Hsu Wai,Chit Thu Shine |
|
11 |
7 Feb 2021 |
Machine Reading/Question Answering |
|
Chaw Chaw Khin,Thura Aung |
|
12 |
14 Feb 2021 |
ConvNets for NLP. |
|
Phoo Pyae Pyae Linn,Khine Zar Thwe |
|
13 |
21 Feb 2021 |
Information from parts of words (Subword Models) |
|
May Aye Chann,Aung Myo Min |
|
14 |
28 Feb 2021 |
Modeling contexts of use: Contextual Representations and Pretraining. ELMo and BERT. |
|
Thura Htet Aung,Khin Me Me Chit |
|
15 |
7 Mar 2021 |
Natural Language Generation |
|
Win Myat Thuzar,Yi Yi Chan Myae Win Shein |
|
16 |
14 Mar 2021 |
Reference in Language and Coreference Resolution |
|
Khit Sithu,Khaing Hsu Wai |
|
17 |
21 Mar 2021 |
Fairness and Inclusion in AI |
|
Nann Nann,Yan Paing Oo(SG) |
|
18 |
28 Mar 2021 |
Constituency Parsing and Tree Recursive Neural Networks |
|
Tin Latt Nandar,Sai Htaung Kham |
|
19 |
4 Apr 2021 |
Recent Advances in Low Resource Machine Translation |
|
Khin Thandar Kyaw,Naing Naing Maw |
|
20 |
11 Apr 2021 |
Analysis and Interpretability of Neural NLP |
|
Ma Htet Htet Mon,Aung Myo Min |
|
21 |
18 Apr 2021 |
Project Brainstorming |
|
|
|
20 |
25 Apr 2021 |
Project Brainstorming |
|
|
|
20 |
2 May 2021 |
Guest lecture on creating benchmarks? |
|
|