CSCI 544 Fall 2017 course page

Jonathan May

Website https://www.isi.edu/~jonmay/cs544_fa17_web/

Lectures SAL 101, Wednesdays and Fridays 8:00-9:50 am

Instructor office hours Jonathan May, RTH 512, Wednesdays and Fridays 10-11am or 11am-12pm with appointment

Textbook None required; Speech and Language Processing, 2nd Edition¹ is optional. All required readings will be listed in the syllabus.

TA Office hours Dong Guo, 3pm-5pm Tue, EEB 220

Siddharth Jain, 8am-10am Mon, SAL lab

Ramesh Manuvinakurike, 8am-10am Thu, SAL lab

Homeworks (60% of grade) 8 x 7.5% of grade each. A mix of programming and written assignments, electronic submission due 11:59 PM local Pacific time per table below.

Late days Four (4) cumulative with no more than two (2) per assignment. 50% penalty first day thereafter; no credit afterward.

Midterm (15% of grade) Friday, October 6, 8:00-9:45 am. Covers lectures, readings, and homeworks from 8/23-10/4

Final exam (25% of grade) Wednesday, December 6, 8:00-10:00 am. Covers lectures, readings, and homeworks from 8/23-11/29 (i.e. the entire class)

Contact us On Piazza or in class/office hours. Please do not email (unless notified otherwise).

Syllabus/schedule - subject to change - latest version is always on the website!

FINAL ROOM ASSIGNMENT: `finalassignment.txt`

week/theme	date	material	reading	HW out	HW due
1: Corpus Processing	8/23	intro, applications	jm v2 c1 ², hirschberg & manning ³
	8/25	corpora, text processing, words, regular expressions (lec 2 starting code ⁴)	NLTK ch.2 ⁵, jmv3 c2⁶, nathan schneider's notes ⁷, Unix for poets⁸, sculpting text⁹,	HW 1 (due 9/8)
2: Morphology, Regular languages	8/30	Morphology, Finite-State Automata, FSA relationship to regex, finite state transducers	jm v2 c3 ¹⁰
	9/1	probability	Goldwater probability tutorial ¹¹,	HW 2 (due 9/15)
3: Classification and tagging	9/6	Classifiers, features, naive Bayes, perceptron, logistic regression	jm v3 c6¹², Eisenstein notes pp. 21-48¹³
	9/8	pos tagging, hmm, search	jm v3 c9¹⁴, blunsom notes¹⁵, collins notes (optional, more detailed)¹⁶		HW1
4: Syntax and Parsing 1	9/13	(guest lecture) parsing and syntax 1: treebanks, evaluation, cky, grammar induction	penn treebank ¹⁷, jm v3 c12¹⁸, jm v3 c13¹⁹	HW3 (due 9/27)
	9/15	(guest lecture) parsing and syntax 2: pcfgs, restructuring, lexicalization, smoothing, beaming	chiang notes²⁰		HW2
5: Syntax and Parsing 2	9/20	parsing and syntax 3: dependencies, mst and shift reduce algorithms	jm v3 c14²¹	HW 4 (due 10/4)
	9/22	NO CLASS
6: Language Models	9/27	ngram LMs	jm v3 c4²²		HW 3
	9/29	smoothing, interpolation	(optional) chen and goodman²³
7	10/4	feed forward lm, rnn lm	jm v3 c8²⁴		HW 4
	10/6	MIDTERM
8: Semantics	10/11	classical lexical semantics	jm v3 c17²⁵
	10/13	distributional lexical semantics	jm v3 c15²⁶, jm v3 c16²⁷	HW 5 (due 10/27)
9: Information Extraction	10/18	(guest lecture) Information Extraction 1	jmv3 c21²⁸
	10/20	MT introduction, evaluation	alpac report (optional; skip appendices)²⁹, 20 years of bitext³⁰ , Bleu³¹	HW 6 (due 11/10)
10:	10/25	(guest lecture) Information Extraction 2
	10/27	(guest lecture) NLP and ML research at Amazon			HW 5
11: Machine Translation 1	11/1	introduction, evaluation	arcturan and centauri³²
	11/3	alignment, em, model 1	Brown et al. ³³ (mathy bits of models 3+ can be skimmed), Knight workbook³⁴
12: Machine Translation 2	11/8	pbmt, search, features, tuning
	11/10	features, tuning	mert³⁵, pro³⁶	HW 7 (due 12/1)	HW 6
13:	11/15	syntax, neural
	11/17	(guest lecture) Information Retrieval/Question Answering	jm v3 c28 ³⁷
14: Thanksgiving	11/22	NO CLASS
	11/24	NO CLASS
15: Data Mining	11/29	(guest lecture) Social Media Mining
	12/1	Review			HW 7
	12/6	FINAL	ROOM ASSIGNMENT³⁸

Footnotes

... Edition ¹: https://www.amazon.com/Speech-Language-Processing-Daniel-Jurafsky/dp/0131873210/
... c1 ²: http://www.cs.colorado.edu/~martin/SLP/Updates/1.pdf
... manning ³: https://cs224d.stanford.edu/papers/advances.pdf
... code ⁴: https://www.isi.edu/~jonmay/cs544_fa17_web/lec2.startercode.zip
... ch.2 ⁵: http://www.nltk.org/book/ch02.html
... c2 ⁶: https://web.stanford.edu/~jurafsky/slp3/2.pdf
... notes ⁷: https://github.com/nschneid/unix-text-commands
... poets ⁸: https://www.cs.upc.edu/~padro/Unixforpoets.pdf
... text ⁹: http://matt.might.net/articles/sculpting-text/
... c3 ¹⁰: http://ling.umd.edu/~idsardi/620/Jurafsky/jurafsky2000-3.pdf
... tutorial ¹¹: http://homepages.inf.ed.ac.uk/sgwater/teaching/general/probability.pdf
... c6 ¹²: https://web.stanford.edu/~jurafsky/slp3/6.pdf
... 21-48 ¹³: https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf
... c9 ¹⁴: https://web.stanford.edu/~jurafsky/slp3/9.pdf
... notes ¹⁵: http://digital.cs.usu.edu/~cyan/CS7960/hmm-tutorial.pdf
... detailed)¹⁶: http://www.cs.columbia.edu/~mcollins/courses/nlp2011/notes/hmms.pdf
... treebank ¹⁷: http://aclweb.org/anthology/J93-2004
... c12 ¹⁸: https://web.stanford.edu/~jurafsky/slp3/12.pdf
... c13 ¹⁹: https://web.stanford.edu/~jurafsky/slp3/13.pdf
... notes ²⁰: https://www3.nd.edu/~dchiang/teaching/nlp/2016/notes/chapter13v2.pdf
... c14 ²¹: https://web.stanford.edu/~jurafsky/slp3/14.pdf
... c4 ²²: https://web.stanford.edu/~jurafsky/slp3/4.pdf
... goodman ²³: https://people.eecs.berkeley.edu/~klein/cs294-5/chen_goodman.pdf
... c8 ²⁴: https://web.stanford.edu/~jurafsky/slp3/8.pdf
... c17 ²⁵: https://web.stanford.edu/~jurafsky/slp3/17.pdf
... c15 ²⁶: https://web.stanford.edu/~jurafsky/slp3/15.pdf
... c16 ²⁷: https://web.stanford.edu/~jurafsky/slp3/16.pdf
... c21 ²⁸: https://web.stanford.edu/~jurafsky/slp3/21.pdf
... appendices)²⁹: http://www.mt-archive.info/ALPAC-1966.pdf
... bitext ³⁰: http://cs.jhu.edu/~post/bitext/
... Bleu ³¹: http://www.aclweb.org/anthology/P02-1040.pdf
... centauri ³²: https://www.isi.edu/natural-language/mt/aimag97.pdf
... al.³³: http://www.aclweb.org/anthology/J93-2003
... workbook ³⁴: https://www.isi.edu/natural-language/mt/wkbk-rw.pdf
...mert ³⁵: http://www.aclweb.org/anthology/P03-1021
... pro ³⁶: http://www.aclweb.org/anthology-new/D/D11/D11-1125.pdf
... c28 ³⁷: https://web.stanford.edu/~jurafsky/slp3/28.pdf
... ASSIGNMENT ³⁸: finalassignment.txt

[email protected]

Website	`https://www.isi.edu/~jonmay/cs544_fa17_web/`
Lectures	SAL 101, Wednesdays and Fridays 8:00-9:50 am
Instructor office hours	Jonathan May, RTH 512, Wednesdays and Fridays 10-11am or 11am-12pm with appointment
Textbook	None required; Speech and Language Processing, 2nd Edition¹ is optional. All required readings will be listed in the syllabus.
TA Office hours	Dong Guo, 3pm-5pm Tue, EEB 220
	Siddharth Jain, 8am-10am Mon, SAL lab
	Ramesh Manuvinakurike, 8am-10am Thu, SAL lab
Homeworks (60% of grade)	8 x 7.5% of grade each. A mix of programming and written assignments, electronic submission due 11:59 PM local Pacific time per table below.
Late days	Four (4) cumulative with no more than two (2) per assignment. 50% penalty first day thereafter; no credit afterward.
Midterm (15% of grade)	Friday, October 6, 8:00-9:45 am. Covers lectures, readings, and homeworks from 8/23-10/4
Final exam (25% of grade)	Wednesday, December 6, 8:00-10:00 am. Covers lectures, readings, and homeworks from 8/23-11/29 (i.e. the entire class)
Contact us	On Piazza or in class/office hours. Please do not email (unless notified otherwise).

CSCI 544 Fall 2017 course page

Syllabus/schedule - subject to change - latest version is always on the website!

FINAL ROOM ASSIGNMENT: finalassignment.txt

Footnotes

FINAL ROOM ASSIGNMENT: `finalassignment.txt`