Flash Crowd Mitigation via Adaptive Admission Control Based on Application-Level Observation

Xuan Chen and John Heidemann
USC/Information Sciences Institute

Abstract

We design an adaptive admission control mechanism, network early warning system (NEWS), to protect servers and networks from flash crowds and maintain high performance for end-users. NEWS detects flash crowds from performance degradation in responses and mitigates flash crowds by admitting incoming requests adaptively. We evaluate NEWS performance with both simulations and testbed experiments. We first investigate a network-limited scenarion in simulations. We find that NEWS detects flash crowds within 20 seconds. By discarding 32% of incoming requests, NEWS protects the target server and networks from overloading, reducing the response packet drop rate from 25% to 2%. For admitted requests, NEWS increases their response rate by two times. This performance is similar to the best static rate limiter deployed in the same scenario. We also investigate the impact of detection intervals on NEWS performance, showing it affects both detection delay and false alarm rate. We further consider a server memory-limited scenario in testbed experiments, confirming that NEWS is also effective in this case. We also examine the runtime cost of NEWS traffic monitoring in practice and find that it consumes little CPU time and relatively small memory. Finally, we show NEWS effectively protects bystander traffic from flash crowds.

Availability

This paper is available in several formats: abstract web page with pointers and cites, PDF, paper copies can be obtained by mail to the authors. Copyright terms for this paper appear below.

Reference

Chen05a
Xuan Chen and John Heidemann. Flash Crowd Mitigation via Adaptive Admission Control Based on Application-Level Observation. ACM Transactions on Internet Technology, 5 (3 ), pp. 532-562, August, 2005. <http://www.isi.edu/~johnh/PAPERS/Chen05a.html>.
@article{Chen05a,
	author = "Xuan Chen and John Heidemann",
	title = "Flash Crowd Mitigation via Adaptive Admission Control Based on Application-Level Observation",
	journal = "{ACM} Transactions on Internet Technology",
	year = "2005",
	volume = "5",
	number = "3",
	month = "August",
	pages = "532--562",
	keywords = "NEWS, admission control, congestion control",
	url = "http://www.isi.edu/~johnh/PAPERS/Chen05a.html",
	pdfurl = "http://www.isi.edu/~johnh/PAPERS/Chen05a.pdf",
	copyrightholder = "{ACM}",
	myorganization = "USC/Information Sciences Institute",
	doi = "http://doi.acm.org/10.1145/1084772.1084776",
	otherurl = "http://portal.acm.org/ft_gateway.cfm?id=1084776&type=pdf&coll=portal&dl=ACM&CFID=58869837&CFTOKEN=77379250",
}

Copyright

This paper is copyright © 2005 by ACM. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee.