← All drills

Generate Your Own Industry Dataset

What you'll be able to do

Drill 1 of the Freight & Logistics track. Start here, because drills 2 to 5 all run on the dataset you build in this one. You build a small, tested Python package that produces realistic, labelled data for an AI system when real customer data cannot be used, which is where almost every enterprise AI project begins.

⌁ Logistics, healthcare, insurance and banking teams all build evaluation corpora this way, because customer data cannot leave the building. The same pipeline produces the instruction data behind models like Phi and the Cosmopedia corpus.
Start this internship
Create an account to unlock the 11 sections, the workbench, and askThili.
Begin

Sections

1. Generate Your Own Industry Dataset
🔒 locked
2. 1 · The booking desk's first request
🔒 locked
3. 2 · The first batch comes back
🔒 locked
4. 3 · Record first, text second
🔒 locked
5. 4 · Making the model obey, and where that stops
🔒 locked
6. 5 · Rendering the mess, then checking it
🔒 locked
7. 6 · Injecting the failure modes on purpose
🔒 locked
8. 7 · Diversity, measured
🔒 locked
9. 8 · Volume, and the corpus card
🔒 locked
10. 9 · What happens if you train on your own output
🔒 locked
11. 10 · The pack
🔒 locked

Dig deeper

📄Self-Instruct: Aligning Language Models with Self-Generated Instructions (Wang et al., 2022, arXiv:2212.10560)
paper
📄Best Practices and Lessons Learned on Synthetic Data for Language Models (Liu et al., 2024, arXiv:2404.07503)
paper
📄Textbooks Are All You Need (Gunasekar et al., 2023, arXiv:2306.11644)
paper
📄Efficient Guided Generation for Large Language Models (Willard & Louf, 2023, arXiv:2307.09702)
paper
📄The Curse of Recursion: Training on Generated Data Makes Models Forget (Shumailov et al., 2023, arXiv:2305.17493)
paper
📄DocILE Benchmark for Document Information Localization and Extraction (Simsa et al., 2023, arXiv:2302.05658)
paper
🔗thili-ai/thilisynth: the finished version of the package you build in this course, if you only want to use it
code