Schedule

This is a reading group for Stanford NLP’s CS224N. We will mainly follow the official CS224N schedule, with slight modification.
Before each class, please read the respective lecture notes and watch the videos for that week. Lecture notes and videos can be found on CS224N website.

This is a community-led class. We will require one or two volunteer presenters each week who will present the topic and lead the discussion.

Main textbooks and resources:
Prof. Kyunhyun Cho’s Lecture Notes for NLP class at NYU: [link].
Syllabus will be updated.

Week

Date

Topic

Reading List

Presenters

-

Pre-class Preparation:

The first class (Week 1) officially begins on 29 November, 2020.
If you are new to Numpy and neural networks, please try to finish the reading list before the first class.

Additional readings are optional but strongly recommended.

Numpy Tutorial [link]

High-level Intro to Neural Nets [link]

Hugo Larochelle’s Neural Network Lectures: Video 1.1 to 2.11 [link]

Additional readings:

Chapter 2 and 3 of Cho’s lecture note

-

1

29 Nov 2020

Word Vectors 1 (Intro to Distributional Semantics)

  • Introduction and Word Vectors
  • Gensim word vectors example

CS224N W1: Video Notes Slides

Additional readings:

Suggested readings for CS224N W1.

Lena Voita’s [note]

PMH

2

6 Dec 2020

Word Vectors 2 and Word Senses

CS224N W2: Video Notes Slides

Additional readings:

Suggested readings for CS224N Week 2.

Khin Thet Htar,Tin Latt Nandar

3

13 Dec 2020

Word Window Classification, Neural Networks, and PyTorch

CS224N Lecture Note (Jan 14)

Sai Htaung Kham,Win Myat Thuzar

4

20 Dec 2020

Matrix Calculus and Backpropagation

CS224N Lecture Note (Jan 16)

Ma Htet Htet Mon,Naing Naing Maw

5

27 Dec 2020

Linguistic Structure: Dependency Parsing

CS224N Lecture Note (Jan 21)

Yi Yi Chan Myae Win Shein,Nann Nann

6

3 Jan 2021

Language Models and Recurrent Neural Networks

Yan Paing Oo,Khit Sithu

7

10 Jan 2021

Recurrent Neural Networks 2

Yan Paing Oo(SG),Hsu Wai Naing

8

17 Jan 2021

Machine Translation: Sequence to Sequence models and Beam Search

Kyawt Kyawt San,Khin Thandar Kyaw

9

24 Jan 2021

Machine Translation: Transformers

Khaing Hsu Wai,Chit Thu Shine

11

7 Feb 2021

Machine Reading/Question Answering

Chaw Chaw Khin,Thura Aung

12

14 Feb 2021

ConvNets for NLP.

Phoo Pyae Pyae Linn,Khine Zar Thwe

13

21 Feb 2021

Information from parts of words (Subword Models)

May Aye Chann,Aung Myo Min

14

28 Feb 2021

Modeling contexts of use: Contextual Representations and Pretraining. ELMo and BERT.

Thura Htet Aung,Khin Me Me Chit

15

7 Mar 2021

Natural Language Generation

Win Myat Thuzar,Yi Yi Chan Myae Win Shein

16

14 Mar 2021

Reference in Language and Coreference Resolution

Khit Sithu,Khaing Hsu Wai

17

21 Mar 2021

Fairness and Inclusion in AI

Nann Nann,Yan Paing Oo(SG)

18

28 Mar 2021

Constituency Parsing and Tree Recursive Neural Networks

Tin Latt Nandar,Sai Htaung Kham

19

4 Apr 2021

Recent Advances in Low Resource Machine Translation

Khin Thandar Kyaw,Naing Naing Maw

20

11 Apr 2021

Analysis and Interpretability of Neural NLP

Ma Htet Htet Mon,Aung Myo Min

21

18 Apr 2021

Project Brainstorming

20

25 Apr 2021

Project Brainstorming

20

2 May 2021

Guest lecture on creating benchmarks?