← All drillsGenerate Your Own Industry Dataset
What you'll be able to do- ✓Build a seeded sampler and reference tables, so the record is the label and the whole corpus regenerates from a seed
- ✓Build a renderer layer that puts a local LLM behind one interface, and measure what it costs to run on your own hardware
- ✓Build a schema-constrained extraction call with nullable fields, so a model can say a value is absent instead of inventing it
- ✓Build a verifier that tells a missing value from a contradicted one, and reject every render that contradicts its record
- ✓Build a catalogue of defects whose flags are true by construction, and report the rates the corpus actually contains
- ✓Build the measures that tell you what a corpus holds, and aim one at a named failure instead of trusting a general number
- ✓Build a pipeline, a split by customer and a corpus card, so a teammate can regenerate and trust the dataset
- ✓Build a domain-agnostic core and a second industry pack, and prove with tests that the core never imports a pack
Drill 1 of the Freight & Logistics track. Start here, because drills 2 to 5 all run on the dataset you build in this one. You build a small, tested Python package that produces realistic, labelled data for an AI system when real customer data cannot be used, which is where almost every enterprise AI project begins.
⌁ Logistics, healthcare, insurance and banking teams all build evaluation corpora this way, because customer data cannot leave the building. The same pipeline produces the instruction data behind models like Phi and the Cosmopedia corpus.
Start this internshipCreate an account to unlock the 11 sections, the workbench, and askThili.
BeginSections
1. Generate Your Own Industry Dataset
🔒 locked2. 1 · The booking desk's first request
🔒 locked3. 2 · The first batch comes back
🔒 locked4. 3 · Record first, text second
🔒 locked5. 4 · Making the model obey, and where that stops
🔒 locked6. 5 · Rendering the mess, then checking it
🔒 locked7. 6 · Injecting the failure modes on purpose
🔒 locked8. 7 · Diversity, measured
🔒 locked9. 8 · Volume, and the corpus card
🔒 locked10. 9 · What happens if you train on your own output
🔒 locked11. 10 · The pack
🔒 lockedDig deeper
📄Self-Instruct: Aligning Language Models with Self-Generated Instructions (Wang et al., 2022, arXiv:2212.10560)
paper📄Best Practices and Lessons Learned on Synthetic Data for Language Models (Liu et al., 2024, arXiv:2404.07503)
paper📄Textbooks Are All You Need (Gunasekar et al., 2023, arXiv:2306.11644)
paper📄Efficient Guided Generation for Large Language Models (Willard & Louf, 2023, arXiv:2307.09702)
paper📄The Curse of Recursion: Training on Generated Data Makes Models Forget (Shumailov et al., 2023, arXiv:2305.17493)
paper📄DocILE Benchmark for Document Information Localization and Extraction (Simsa et al., 2023, arXiv:2302.05658)
paper🔗thili-ai/thilisynth: the finished version of the package you build in this course, if you only want to use it
code