← All drills

From Classical ML to Generative AI

What you'll be able to do

Tour the last decade of NLP on a task you already know: spam or not spam. See what changed with each era, and what it costs, with numbers measured on your own machine.

⌁ Every text classifier from the spam filter in an email client to content moderation and support-ticket routing. Teams choose between these same approaches, and the choice is usually about labelled data and cost, not only accuracy.
Start this internship
Create an account to unlock the 4 sections, the workbench, and askThili.
Begin

Sections

1. Why this course: from what you teach to where the field is now
🔒 locked
2. The Classical Era: Count the Words
🔒 locked
3. The Pretrained Turn
🔒 locked
4. Reading the Table
🔒 locked

Dig deeper

🔗SMS Spam Collection (Almeida & Hidalgo, 2011), UCI Machine Learning Repository, CC BY 4.0
article
📄Efficient Estimation of Word Representations in Vector Space (Mikolov et al., 2013)
paper
📄Attention Is All You Need (Vaswani et al., 2017)
paper
📄BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (Devlin et al., 2018)
paper
📄Language Models are Few-Shot Learners (Brown et al., 2020)
paper