Data Leakage Detective Game

Inspect suspicious features, expose hidden leakage, repair flawed validation pipelines, and build trustworthy models through interactive investigations, timed challenges, hints, and detailed feedback reports.

Case Controls
Configure the investigation before starting.


Data and Session

Keyboard: 1 safe, 2 possible, 3 definite, H hint.

Score
0
Accuracy, confidence, and speed
Timer
03:00
Pause freezes the case
Case Progress
0/0
Classified feature cards
Detective Rank
Data Rookie
Stored locally on this browser

Select a case and start

No active case

Drag each feature card into the appropriate evidence zone.

Safe Possible Definite
No feature selected.

Detective Tools

Use tools carefully. Each hint reduces the maximum score.

Tool output

Start a case, select a feature, then choose an investigation tool.

Prediction-Time Timeline

Features available after the cutoff can create future-information leakage.

Historical dataPrediction cutoffOutcome known

Availability check

Select a card to inspect when its value becomes available.

Pipeline Repair Board

Drag steps into a safe order. Evaluation data must remain isolated.

Start a case to load pipeline steps.

Learning Reference

Use this checklist before trusting any validation score.

Leakage warning signs

  • Near-perfect validation with ordinary features.
  • A feature is recorded after the event.
  • One identifier dominates feature importance.
  • Deployment performance collapses.
  • Duplicates cross validation folds.

Safe validation checklist

  • Split before fitting preprocessing steps.
  • Fit transforms inside each training fold.
  • Use grouped or chronological validation when required.
  • Reserve the test set for final evaluation.
  • Verify every feature exists at prediction time.

Related Calculators

Missing Value RescueOutlier HunterData Cleaning RaceFeature Scaling ChallengeCategorical Encoding PuzzleTrain-Test Split GameImbalanced Dataset DefenderFeature Engineering WorkshopPipeline Builder

Important Note: All the Calculators listed in this site are for educational purpose only and we do not guarentee the accuracy of results. Please do consult with other sources as well.