John Heidemann

Collecting and Visualizing Outages Over the Long Haul

TitleCollecting and Visualizing Outages Over the Long Haul
Publication TypeMiscellaneous
Year of Publication2017
AuthorsJ. Heidemann

We have been collecting data about outages in the Internet since Oct. 2014. Our outage detection system, Trinocular, uses active probing from four sites to study about 4 million /24 IPv4 address blocks. Long-duration measurements bring challenges that don't occur in short observations. Most importantly, our target (``the Internet'') changes as we measure it, as new blocks come on-line, old blocks are reused in different ways, and ISPs observe and sometimes block our traffic. Our measurement platform also sees occasional hardware failures. Visualization can assist detection of these problems, allowing human perception to detect changes in data collection that have not previously been anticipated. This talk will discuss the challenges of long-term outage measurement and describe our new algorithm that scales to support clustering of 4M blocks and 3 months of observations for visualization. \newline─▒ndent Our visualization is joint work with Yuri Pradkin, and analysis of our long-term outages includes work with Abdulla Alwabel.