John Heidemann / Papers / Collecting and Visualizing Outages Over the Long Haul

Collecting and Visualizing Outages Over the Long Haul
John Heidemann
USC/Information Sciences Institute

Citation

John Heidemann. Collecting and Visualizing Outages Over the Long Haul. Talk at CAIDA Active Internet Measurement Workshop (AIMS). [PDF] [alt PDF]

Abstract

We have been collecting data about outages in the Internet since Oct. 2014. Our outage detection system, Trinocular, uses active probing from four sites to study about 4 million /24 IPv4 address blocks. Long-duration measurements bring challenges that don’t occur in short observations. Most importantly, our target (“the Internet”) changes as we measure it, as new blocks come on-line, old blocks are reused in different ways, and ISPs observe and sometimes block our traffic. Our measurement platform also sees occasional hardware failures. Visualization can assist detection of these problems, allowing human perception to detect changes in data collection that have not previously been anticipated. This talk will discuss the challenges of long-term outage measurement and describe our new algorithm that scales to support clustering of 4M blocks and 3 months of observations for visualization. \newline\indent Our visualization is joint work with Yuri Pradkin, and analysis of our long-term outages includes work with Abdulla Alwabel.

Bibtex Citation

@misc{Heidemann17b,
  author = {Heidemann, John},
  title = {Collecting and Visualizing Outages Over the Long Haul},
  howpublished = {Talk at  CAIDA Active Internet Measurement Workshop (AIMS)},
  month = mar,
  year = {2017},
  sortdate = {2017-03-01},
  project = {ant, nocredit, lacrend, retrofuturebridge, duoi},
  jsubject = {dns},
  jlocation = {johnh: pafile},
  keywords = {dns, outage detection, visualization},
  url = {https://ant.isi.edu/%7ejohnh/PAPERS/Heidemann17b.html},
  pdfurl = {https://ant.isi.edu/%7ejohnh/PAPERS/Heidemann17b.pdf},
  blogurl = {https://ant.isi.edu/blog/?p=969},
  myorganization = {USC/Information Sciences Institute},
  copyrightholder = {authors}
}
Copyright © by John Heidemann