← All drills

Build a Document Search Engine

What you'll be able to do

Build the retrieval layer under a search box or a "chat with your documents" system — an index, a ranker, and a test harness that tells you whether a change helped.

⌁ The keyword search inside Elasticsearch, Apache Lucene and Solr, and Algolia — the retrieval baseline that embedding-based and hybrid search systems are measured against.
Start this internship
Create an account to unlock the 4 sections, the workbench, and askThili.
Begin

Sections

1. Build a Document Search Engine
🔒 locked
2. Lesson 1 - The inverted index
🔒 locked
3. Lesson 2 - Is it any good?
🔒 locked
4. Lesson 3 - Real queries are messy
🔒 locked

Dig deeper

📄A Statistical Interpretation of Term Specificity and Its Application in Retrieval (Sparck Jones, 1972, Journal of Documentation 28(1))
paper
📄The Probabilistic Relevance Framework: BM25 and Beyond (Robertson & Zaragoza, 2009, Foundations and Trends in Information Retrieval)
paper
🔗Project Gutenberg — the public-domain books the lessons search
article