← All drills

Build a Server-Metrics Anomaly Detector

What you'll be able to do

Build the alerting an operations or fraud team runs on a metric with a daily rhythm — learn what is normal at each time of day, catch what a fixed threshold cannot, and set the threshold from the number of alerts a person will read.

⌁ The monitoring and alerting behind cloud operations and payment systems — Datadog, PayPal and Splunk — wherever a few rare, unlabelled events must be found in a steady stream of normal ones.
Start this internship
Create an account to unlock the 4 sections, the workbench, and askThili.
Begin

Sections

1. Build a Server-Metrics Anomaly Detector
🔒 locked
2. Lesson 1 - The threshold that fires every evening
🔒 locked
3. Lesson 2 - Let the forest find it
🔒 locked
4. Lesson 3 - How many alerts will a person read?
🔒 locked

Dig deeper

📄Isolation Forest (Liu, Ting & Zhou, 2008, IEEE ICDM)
paper
📄LOF: Identifying Density-Based Local Outliers (Breunig, Kriegel, Ng & Sander, 2000, ACM SIGMOD)
paper
📄Anomaly Detection: A Survey (Chandola, Banerjee & Kumar, 2009, ACM Computing Surveys)
paper
🔗Numenta Anomaly Benchmark (NAB) — real server metrics with labelled incidents, MIT licence
article