Link Search Menu Expand Document

Calendar

Schedule of Classes

Aug 22
intro, applications
E 1
project assignment out (due 9/19)
Aug 24
data processing. data resources, evaluation, annotation
E 4.5, JM 2, 4.9, Nathan Schneider’s unix notes, Unix for poets, sculpting text
Aug 29
linear classifiers
E 2.2, 2.3, 2.4. JM 4, 5, Thumbs up? Sentiment Classification using Machine Learning Techniques, Goldwater probability tutorial. The Perceptron (Rosenblatt 1958) (optional)
HW1 out (due 9/14)
Aug 31
nonlinear classifiers, backprop, gradient descent
E 3. JM 7.2–7.4, 7.6.
Sep 5
LABOR DAY NO CLASS
Sep 7
distributional feature representations: PPMI, LSA, word2vec, bilingual dictionary induction
E 14.3, 14.5–6. JM 6.
(Sep 9): Drop deadline (for refund, without W))
Sep 12
ngram language models
E 6.1–2, 6.4. 7.5, 7.7. JM 3 Exploring the limits of language modeling
Sep 14
recurrent and transformer language models, ELMo, BERT
E 6.3, JM 9. Attention is all you need
HW1 due
Sep 19
Transformers, actually
project proposal due
Sep 21
ethics
The Social Impact of Natural Language Processing, Energy and Policy Considerations for Deep Learning in NLP, Model Cards for Model Reporting
Sep 26
ROSH HASHANAH NO CLASS : :
HW2 out (due 10/12)
Sep 28
POS tags, HMMs, treebanks
E 7.1–7.4, JM 8.1–8.5, 12 (through 12.4.2)
Oct 3
constituencies, cky, dependencies, shift-reduce
E 10.1–10.4, JM 13.1–13.4, 14–14.4.4
Oct 5
YOM KIPPUR NO CLASS :
Oct 10
dependencies
Omey - TweetSpin - Propaganda detection in Social Media using Multi-View Representations
Alireza - Hate Speech and Counter Speech Detection: Conversational Context Does Matter
Oct 12
shift-reduce :
Smit - Aligning to Social Norms and Values in Interactive Narratives
Syeda - How Gender Debiasing Affects Internal Model Representations, and Why It Matters
HW2 due
Oct 17
machine translation: history, evaluation, data
“Oh, yes, everything’s right on schedule, Fred”
Mahak - Time Waits for No One! Analysis and Challenges of Temporal Misalignment
Amin - Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora
Oct 19
machine translation: statistical, recurrent, transformer, transfer learning, unsupervised, nonautoregressive
E 18, JM 10
Zhuoyu - Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection
Hirona - Recognition of They/Them as Singular Personal Pronouns in Coreference Resolution
Oct 24
MEGA (Guest Lecture by Xuezehe Ma)
Mega Paper; Annotated S4
Robert - Non-Autoregressive Machine Translation: It’s Not as Fast as it Seem
Yixiang - Ask Me Anything in Your Native Language
HW3 out (due 11/16)
Oct 26
semantics: logical/compositional, frames and roles, amr, distributional
E 12.1, 12.2, 13.1, 13.3, 14.1-3, 14.6-8, JM 15.1-3, 6
Charles - Theory-Grounded Measurement of U.S. Social Stereotypes in English Language Models
Mina - How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns
Oct 31
Vision-and-language Models (Guest lecture: Xuezhe Ma)
Denoising Diffusion Probabilistic Models, Score-Based Generative Modeling through Stochastic Differential Equations, Variational Diffusion Models, Understanding Diffusion Models: A Unified Perspective
Basem - Explaining Dialogue Evaluation Metrics using Adversarial Behavioral Analysis
Leticia - Learning Dialogue Representations from Consecutive Utterances
Nov 2
dialogue: task-oriented and chatbots
E 19.3, JM 24 The original ELIZA
Zhivar - Semantic Diversity in Dialogue with Natural Language Inference
Fazle - On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?
Project Report Version 1 due
Nov 7
question answering, information retrieval
JM 23
James - Learning as Conversation: Dialogue Systems Reinforced for Information Acquisition
Yanze - Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterances
Nov 9
natural language inference and common sense tasks
Modeling Semantic Containment and Exclusion in Natural Language Inference, Commonsense Reasoning and Commonsense Knowledge in Artificial Intelligence
Sophie - Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
Jiarui - JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering
Nov 14
prompts, multi task large language models
InstructGPT paper (pp1–20), Large Language Models are Human-Level Prompt Engineers
Darpan - Robust Conversational Agents against Imperceptible Toxicity Triggers
Nov 16
adapters, prefix tuning, few-parameter fine-tuning
TBD
Sahana - Learning to Transfer Prompts for Text Generation
HW3 due
Nov 21
information extraction
JM 17, E 17, 25 years of IE
Nov 23
THANKSGIVING BREAK; NO CLASS
Nov 28
Project presentations
Nov 30
Project presentations