next_inactive up previous


CSCI 544 Fall 2017 course page

Jonathan May

Website https://www.isi.edu/~jonmay/cs544_fa17_web/
Lectures SAL 101, Wednesdays and Fridays 8:00-9:50 am
Instructor office hours Jonathan May, RTH 512, Wednesdays and Fridays 10-11am or 11am-12pm with appointment
Textbook None required; Speech and Language Processing, 2nd Edition1 is optional. All required readings will be listed in the syllabus.
TA Office hours Dong Guo, 3pm-5pm Tue, EEB 220
Siddharth Jain, 8am-10am Mon, SAL lab
Ramesh Manuvinakurike, 8am-10am Thu, SAL lab
Homeworks (60% of grade) 8 x 7.5% of grade each. A mix of programming and written assignments, electronic submission due 11:59 PM local Pacific time per table below.
Late days Four (4) cumulative with no more than two (2) per assignment. 50% penalty first day thereafter; no credit afterward.
Midterm (15% of grade) Friday, October 6, 8:00-9:45 am. Covers lectures, readings, and homeworks from 8/23-10/4
Final exam (25% of grade) Wednesday, December 6, 8:00-10:00 am. Covers lectures, readings, and homeworks from 8/23-11/29 (i.e. the entire class)
Contact us On Piazza or in class/office hours. Please do not email (unless notified otherwise).

Syllabus/schedule - subject to change - latest version is always on the website!

FINAL ROOM ASSIGNMENT: finalassignment.txt

week/theme date material reading HW out HW due
1: Corpus Processing 8/23intro, applicationsjm v2 c1 2, hirschberg & manning 3
8/25corpora, text processing, words, regular expressions (lec 2 starting code 4)NLTK ch.2 5, jmv3 c26, nathan schneider's notes 7, Unix for poets8, sculpting text9,HW 1 (due 9/8)
2: Morphology, Regular languages 8/30Morphology, Finite-State Automata, FSA relationship to regex, finite state transducers jm v2 c3 10
9/1 probability Goldwater probability tutorial 11, HW 2 (due 9/15)
3: Classification and tagging 9/6Classifiers, features, naive Bayes, perceptron, logistic regressionjm v3 c612, Eisenstein notes pp. 21-4813
9/8pos tagging, hmm, search jm v3 c914, blunsom notes15, collins notes (optional, more detailed)16HW1
4: Syntax and Parsing 1 9/13(guest lecture) parsing and syntax 1: treebanks, evaluation, cky, grammar inductionpenn treebank 17, jm v3 c1218, jm v3 c1319HW3 (due 9/27)
9/15(guest lecture) parsing and syntax 2: pcfgs, restructuring, lexicalization, smoothing, beamingchiang notes20HW2
5: Syntax and Parsing 2 9/20parsing and syntax 3: dependencies, mst and shift reduce algorithmsjm v3 c1421HW 4 (due 10/4)
9/22NO CLASS
6: Language Models 9/27ngram LMsjm v3 c422HW 3
9/29smoothing, interpolation(optional) chen and goodman23
7 10/4feed forward lm, rnn lmjm v3 c824HW 4
10/6MIDTERM
8: Semantics 10/11classical lexical semantics jm v3 c1725
10/13distributional lexical semanticsjm v3 c1526, jm v3 c1627HW 5 (due 10/27)
9: Information Extraction 10/18(guest lecture) Information Extraction 1jmv3 c2128
10/20MT introduction, evaluationalpac report (optional; skip appendices)29, 20 years of bitext30 , Bleu31HW 6 (due 11/10)

10:

10/25(guest lecture) Information Extraction 2
10/27(guest lecture) NLP and ML research at AmazonHW 5
11: Machine Translation 1 11/1introduction, evaluationarcturan and centauri32
11/3alignment, em, model 1Brown et al. 33 (mathy bits of models 3+ can be skimmed), Knight workbook34
12: Machine Translation 2 11/8pbmt, search, features, tuning
11/10features, tuningmert35, pro36HW 7 (due 12/1) HW 6
13: 11/15 syntax, neural
11/17 (guest lecture) Information Retrieval/Question Answeringjm v3 c28 37
14: Thanksgiving 11/22NO CLASS
11/24NO CLASS
15: Data Mining 11/29(guest lecture) Social Media Mining
12/1ReviewHW 7
12/6FINALROOM ASSIGNMENT38



Footnotes

... Edition1
https://www.amazon.com/Speech-Language-Processing-Daniel-Jurafsky/dp/0131873210/
... c12
http://www.cs.colorado.edu/~martin/SLP/Updates/1.pdf
... manning3
https://cs224d.stanford.edu/papers/advances.pdf
... code4
https://www.isi.edu/~jonmay/cs544_fa17_web/lec2.startercode.zip
... ch.25
http://www.nltk.org/book/ch02.html
... c26
https://web.stanford.edu/~jurafsky/slp3/2.pdf
... notes7
https://github.com/nschneid/unix-text-commands
... poets8
https://www.cs.upc.edu/~padro/Unixforpoets.pdf
... text9
http://matt.might.net/articles/sculpting-text/
... c310
http://ling.umd.edu/~idsardi/620/Jurafsky/jurafsky2000-3.pdf
... tutorial11
http://homepages.inf.ed.ac.uk/sgwater/teaching/general/probability.pdf
... c612
https://web.stanford.edu/~jurafsky/slp3/6.pdf
... 21-4813
https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf
... c914
https://web.stanford.edu/~jurafsky/slp3/9.pdf
... notes15
http://digital.cs.usu.edu/~cyan/CS7960/hmm-tutorial.pdf
... detailed)16
http://www.cs.columbia.edu/~mcollins/courses/nlp2011/notes/hmms.pdf
... treebank17
http://aclweb.org/anthology/J93-2004
... c1218
https://web.stanford.edu/~jurafsky/slp3/12.pdf
... c1319
https://web.stanford.edu/~jurafsky/slp3/13.pdf
... notes20
https://www3.nd.edu/~dchiang/teaching/nlp/2016/notes/chapter13v2.pdf
... c1421
https://web.stanford.edu/~jurafsky/slp3/14.pdf
... c422
https://web.stanford.edu/~jurafsky/slp3/4.pdf
... goodman23
https://people.eecs.berkeley.edu/~klein/cs294-5/chen_goodman.pdf
... c824
https://web.stanford.edu/~jurafsky/slp3/8.pdf
... c1725
https://web.stanford.edu/~jurafsky/slp3/17.pdf
... c1526
https://web.stanford.edu/~jurafsky/slp3/15.pdf
... c1627
https://web.stanford.edu/~jurafsky/slp3/16.pdf
... c2128
https://web.stanford.edu/~jurafsky/slp3/21.pdf
... appendices)29
http://www.mt-archive.info/ALPAC-1966.pdf
... bitext30
http://cs.jhu.edu/~post/bitext/
... Bleu31
http://www.aclweb.org/anthology/P02-1040.pdf
... centauri32
https://www.isi.edu/natural-language/mt/aimag97.pdf
... al.33
http://www.aclweb.org/anthology/J93-2003
... workbook34
https://www.isi.edu/natural-language/mt/wkbk-rw.pdf
...mert35
http://www.aclweb.org/anthology/P03-1021
... pro36
http://www.aclweb.org/anthology-new/D/D11/D11-1125.pdf
... c2837
https://web.stanford.edu/~jurafsky/slp3/28.pdf
... ASSIGNMENT38
finalassignment.txt

next_inactive up previous
jonmay@isi.edu