A Proposed Framework for Calibration of Available Bandwidth Estimation Tools
Show full item record
File(s):
- Author(s)
-
Sommers, Joel; Barford, Paul; Willinger, Walter
- Publisher
- University of Wisconsin-Madison Department of Computer Sciences
- Date
- Mar 15, 2012
- Abstract
- Examining the validity or accuracy of proposed available bandwidth estimation tools remains a challenging problem. A common approach consists of evaluating a newly developed tool using a combination of simple ns-type simulations and feasible experiments in situ (i.e., using parts of the actual Internet). In this paper, we argue that this strategy tends to fall short of establishing a reliable "ground truth," and we advocate an alternative in vitro-like methodology for calibrating available bandwidth estimation tools that has not been widely used in this context. Our approach relies on performing controlled laboratory experiments and using tools to visualize and analyze the relevant tool-specific traffic dynamics. We present a case study of how two canonical available bandwidth estimation tools, Spruce and Pathload, respond to increasingly more complex cross traffic and network path conditions. We expose measurement bias and algorithmic omissions that lead to poor tool calibration. As a result of this evaluation, we designed a calibrated available bandwidth
estimation tool called Yaz that builds on the insights of Pathload. We show that in head to head comparisons with Spruce and Pathload, Yaz is significantly and consistently more accurate with respect to ground truth, and reports results more quickly with a small number of probes.
- Permanent link
-
http://digital.library.wisc.edu/1793/60474
- Export
-
Export to RefWorks
Part of
Show full item record