Abstract

These notes are possibly the most likely of all notes you’ll get in class to go out of date. As of 2023, when I’m writing this preamble, the latest and greatest models are coming out and making big splashes on a daily basis. It’s not going to be possible to keep up. So we will focus on the general idea of pretrained LMs in the notes and talk about the latest ones in class.

Date

2023

Authors

Jonathan May