- 11/29 [473/673] Assignment 3 is available.
It's due 12/12, by 11:59 PM.
- 10/30 [473/673] The project prompt is available.
The proposal is due 11/13 and the final submission is due 12/20.
- 10/9 [473/673] Assignment 2 is available.
It's due 10/25, by 11:59 PM.
- 9/29 [673] The Graduate Assessment prompt is available.
You can read the short overview document, just the portions relevant to the "Implementation Track,", or just the portions relevant to the "Paper Track."
There are multiple milestones and due dates.
- 9/6 [473/673] Assignment 1 is available.
It's due 9/18, by 11:59 PM.
- 8/28 [473/673]
The Discord server is available.
- 8/28 [473/673] Assignments and coursework can be submitted through the submission site, available at https://www.csee.umbc.edu/courses/undergraduate/473/f23/submit.
You must be logged in with your UMBC ID.
- 8/28 [473/673]
The syllabus (version 0.9) is available.
Check out the syllabus for all this information, including policies on academic honesty, accomodations, and late assignments.
- Meeting Times
-
Sondheim 113
Monday & Wednesday, 1pm - 2:15pm
- Instructor
-
Frank Ferraro
ferraro [at] umbc [dot] edu
ITE 358/remote
Monday 2:15 - 3pm
by appointment
- TA
-
Duong Ta
dta1 [at] umbc [dot] edu
TBD
TBD
by appointment
- Topics
-
The topics covered will include
- probability, classification, and the efficacy of simple counting methods
- language modeling (n-gram models, smoothing heuristics, maxent/log-linear models, and distributed/vector-valued representations)
- sequences of latent variables (e.g., hidden Markov models, some basic machine translation alignment)
- trees and graphs, as applied to syntax and semantics
- some discourse-related applications (coreference resolution, textual entailment), and
- special and current topics (e.g., fairness and ethics in NLP).
- modern, neural approaches to NLP, such as recurrent neural networks and transformers (e.g., BERT or GPT-2).
- Goals
-
After taking this course, you will
- be introduced to some of the core problems and solutions of NLP;
- learn different ways that success and progress can be measured in NLP;
- be exposed to how these problems relate to those in statistics, machine learning, and linguistics;
- have experience implementing a number of NLP programs;
- read and analyze research papers;
- practice your (written) communication skills.
The following schedule of topics is subject to change.
Legend:
Date |
Topic |
Suggested Reading |
Assignment Out |
Assignment Due |
Wednesday, 8/30
|
-
Intro/administrivia
|
Eisenstein: Ch. 1 (Optional: 1.2.2)
|
—
|
— |
Wednesday, 9/6
|
-
What is NLP?, including intro to NLP research/research community
Also: misc. Torch/intro
|
- What is NLP?: Eisenstein: Ch. 1 (Optional 1.2.2)
|
Assignment 1 |
— |
Monday, 9/11
|
None required, though this will cover approximately the intro of every chapter in either Eisenstein or SLP.
|
—
|
— |
Wednesday, 9/13
|
- (Lossy) Overview of Different Types of NLP Tasks
|
|
—
|
— |
Monday, 9/18
|
|
— |
Assignment 1 |
Wednesday, 9/20
|
(finish up NLP task overview, then)
- Machine Learning: Methodology and Evaluation
|
- Eisenstein: Ch 4 (optional: 4.4.3, 4.4.4, and 4.5, unless planning to do doctoral work)
- 3SLP: intro of Ch 4, 4.7, 4.8, and 4.10
|
—
|
— |
Monday, 9/25
|
—
|
— |
Wednesday, 9/27
|
673 only: Grad Assessment |
— |
Monday, 10/2
|
- Classification with Maxent Models
|
- Eisenstein: Ch 2.5
- 3SLP: Ch. 5
|
—
|
— |
Wednesday, 10/04
|
— |
— |
Monday, 10/09
|
Guest speaker: Dr. Lara Martin
| — |
Assignment 2 |
Grad Assessment: Milestone 1 |
Wednesday, 10/11
|
finish up classification with maxent models |
|
—
|
— |
Monday, 10/16
|
- Distributed Representations
|
- 3SLP: Ch. 6
- Eisenstein: Ch. 14
|
—
|
— |
Wednesday, 10/18 |
— |
— |
Monday, 10/23 |
— |
— |
Wednesday, 10/25 |
- (Generative) Language Modeling
|
- Eisenstein: Ch. 6 (except 6.2.2-6.2.4, 6.3.1)
|
— |
Assignment 2 |
Monday, 10/30
|
Course Project Prompt |
— |
Wednesday, 11/1
|
A3
|
— |
Monday, 11/06
|
—
|
673 only: GA milestone 2 |
Wednesday, 11/08
|
—
|
— |
Monday, 11/13
|
—
|
— |
Wednedsay 11/15
|
- Recurrent Neural Language Modeling
|
- Eisenstein: Ch. 6 (except 6.2.2-6.2.4, 6.3.1)
- 3SLP: Ch. 9
|
—
|
— |
Monday, 11/20
|
—
|
— |
Monday 11/27
|
- General Language Modeling: Attention and Transformers
|
|
A4 |
A3 |
Wednesday, 11/29
|
—
|
— |
Monday, 12/04
|
— |
— |
Wednesday 12/06
|
- Multi-task Learning and Prompting
In-class LLM/Huggingface demo
|
|
—
|
Final Graduate Assessment (12/08) |
Monday 12/11
|
-
Course Recap
|
|
—
|
A4 (12/12) |