Application-Level Optimization of Big Data Transfers through Pipelining, Parallelism and Concurrency

  title={Application-Level Optimization of Big Data Transfers through Pipelining, Parallelism and Concurrency},
  author={Esma Yildirim and Engin Arslan and JangYoung Kim and Tevfik Kosar},
  journal={IEEE Transactions on Cloud Computing},
In end-to-end data transfers, there are several factors affecting the data transfer throughput, such as the network characteristics (e.g., network bandwidth, round-trip-time, background traffic); end-system characteristics (e.g., NIC capacity, number of CPU cores and their clock rate, number of disk drives and their I/O rate); and the dataset characteristics (e.g., average file size, dataset size, file size distribution). Optimization of big data transfers over inter-cloud and intra-cloud… CONTINUE READING
Highly Cited
This paper has 27 citations. REVIEW CITATIONS
16 Citations
27 References
Similar Papers


Publications citing this paper.
Showing 1-10 of 16 extracted citations


Publications referenced by this paper.
Showing 1-10 of 27 references

Data-aware distributed computing

  • E. Yildirim, M. Balman, T. Kosar
  • Data-Intensive Distributed Computing: Challenges…
  • 2012
1 Excerpt

Optimizing the sample size for a cloud-hosted data scheduling service

  • E. Yildirim, J. Kim, T. Kosar
  • Proc. 2nd Int. Workshop Cloud Comput. Sci. Appl…
  • 2012
1 Excerpt

Similar Papers

Loading similar papers…