High-Performance Design of Hadoop RPC with RDMA over InfiniBand

  title={High-Performance Design of Hadoop RPC with RDMA over InfiniBand},
  author={Xiaoyi Lu and Nusrat S. Islam and Md. Wasi-ur-Rahman and Jithin Jose and Hari Subramoni and Hao Wang and Dhabaleswar K. Panda},
  journal={2013 42nd International Conference on Parallel Processing},
Hadoop RPC is the basic communication mechanism in the Hadoop ecosystem. It is used with other Hadoop components like MapReduce, HDFS, and HBase in real world data-centers, e.g. Facebook and Yahoo!. However, the current Hadoop RPC design is built on Java sockets interface, which limits its potential performance. The High Performance Computing community has exploited high throughput and low latency networks such as InfiniBand for many years. In this paper, we first analyze the performance of… CONTINUE READING
Highly Influential
This paper has highly influenced 11 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 95 citations. REVIEW CITATIONS
61 Citations
21 References
Similar Papers


Publications citing this paper.
Showing 1-10 of 61 extracted citations

95 Citations

Citations per Year
Semantic Scholar estimates that this publication has 95 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-10 of 21 references

Similar Papers

Loading similar papers…