Generating Representative Web Workloads for Network and Server Performance Evaluation


One role for workload generation is as a means for understanding how servers and networks respond to variation in load. This enables management and capacity planning based on current and projected usage. This paper applies a number of observations of Web server usage to create a realistic Web workload generation tool which mimics a set of real users accessing a server. The tool, called <sc>Surge</sc> (Scalable URL Reference Generator) generates references matching empirical measurements of 1) server file size distribution; 2) request size distribution; 3) relative file popularity; 4) embedded file references; 5) temporal locality of reference; and 6) idle periods of individual users. This paper reviews the essential elements required in the generation of a representative Web workload. It also addresses the technical challenges to satisfying this large set of simultaneous constraints on the properties of the reference stream, the solutions we adopted, and their associated accuracy. Finally, we present evidence that <sc>Surge</sc> exercises servers in a manner significantly different from other Web server benchmarks.

DOI: 10.1145/277851.277897

Extracted Key Phrases

10 Figures and Tables

Citations per Year

1,760 Citations

Semantic Scholar estimates that this publication has 1,760 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@inproceedings{Barford1998GeneratingRW, title={Generating Representative Web Workloads for Network and Server Performance Evaluation}, author={Paul Barford and Mark Crovella}, booktitle={SIGMETRICS}, year={1998} }