2025-01-18 · observability · dashboards · incidents
Telemetry tables that survive the 3 a.m. zoom
By Sera Alvarez
Night incidents punish busy dashboards. We ask learners to cap primary triage tiles at five signals and push everything else to a secondary layer reachable in two clicks. The discipline feels painful during daytime design reviews but pays off when adrenaline is high.
Color contrast matters more than brand polish. We standardize on three accent hues borrowed from our studio theme so eyes know where to land without relearning a palette per service.
Annotations should carry verbs: "shifted traffic", "rolled back commit", "widened canary". Nouns-only annotations recreate mystery for the next commander.
We end the module with a five-minute silent review—learners stare at a frozen board and write what they think happened, then compare with the mentor key. The gap between perception and ground truth is where the real learning lives.