John Heidemann / Papers / When the Internet Sleeps: Correlating Diurnal Networks With External Factors

When the Internet Sleeps: Correlating Diurnal Networks With External Factors
Lin Quan, John Heidemann and Yuri Pradkin
USC/Information Sciences Institute

Citation

Lin Quan, John Heidemann and Yuri Pradkin. When the Internet Sleeps: Correlating Diurnal Networks With External Factors. Proceedings of the ACM Internet Measurement Conference (Vancouver, BC, Canada, Nov. 2014), 87–100. [DOI] [PDF] [alt PDF]

Abstract

As the Internet matures, policy questions loom larger in its operation. When should an ISP, city, or government invest in infrastructure? How do their policies affect use? In this work, we develop a new approach to evaluate how policies, economic conditions and technology correlates with Internet use around the world. First, we develop an adaptive and accurate approach to estimate block availability, the fraction of active IP addresses in each /24 block over short timescales (every 11 minutes). Our estimator provides a new lens to interpret data taken from existing long-term outage measurements, thus requiring no additional traffic. (If new collection was required, it would be lightweight, since on average, outage detection requires less than 20 probes per hour per /24 block; less than 1% of background radiation.) Second, we show that spectral analysis of this measure can identify diurnal usage: blocks where addresses are regularly used during part of the day and idle in other times. Finally, we analyze data for the entire responsive Internet (3.7M /24 blocks) over 35 days. These global observations show when and where the Internet sleeps—networks are mostly always-on in the US and Western Europe, and diurnal in much of Asia, South America, and Eastern Europe. ANOVA (Analysis of Variance) testing shows that diurnal networks correlate negatively with country GDP and electrical consumption, quantifying that national policies and economics relate to networks.

Bibtex Citation

@inproceedings{Quan14c,
  author = {Quan, Lin and Heidemann, John and Pradkin, Yuri},
  title = {When the {Internet} Sleeps: Correlating
                    Diurnal Networks With External Factors},
  booktitle = {Proceedings of the ACM Internet Measurement Conference},
  year = {2014},
  sortdate = {2014-11-01},
  project = {ant, lacrend, retrofuture},
  jsubject = {routing},
  pages = {87--100},
  month = nov,
  address = {Vancouver, BC, Canada},
  publisher = {ACM},
  jlocation = {johnh: pafile},
  keywords = {routing outage detection, diurnal network
                    behavior, active probing,
                    ntework outages},
  doi = {http://dx.doi.org/10.1145/2663716.2663721},
  url = {https://ant.isi.edu/%7ejohnh/PAPERS/Quan14b.html},
  pdfurl = {https://ant.isi.edu/%7ejohnh/PAPERS/Quan14b.pdf},
  otherurl = {ftp://ftp.isi.edu/isi-pubs/tr-699b.pdf},
  myorganization = {USC/Information Sciences Institute},
  copyrightholder = {authors},
  copyrightterms = {
  	Permission to make digital or hard copies of all or part of
  	this work for personal or classroom use is granted
  	without fee provided that copies are not made or
  	distributed for profit or commercial advantage and
  	that copies bear this notice and the full citation
  	on the first page. Copyrights for components of this
  	work owned by others than ACM must be
  	honored. Abstracting with credit is permitted. To
  	copy otherwise, or republish, to post on servers or
  	to redistribute to lists, requires prior specific
  	permission and/or a fee. Request permissions from
  	Permissions@acm.org. Copyright is held by the
  	owner/author(s). Publication rights licensed to ACM.
  }
}

Copyright

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Permissions@acm.org. Copyright is held by the owner/author(s). Publication rights licensed to ACM.
Copyright © by John Heidemann