Fast top-k similarity join for SimRank

Abstract

SimRank is a well-studied similarity measure between two nodes in a network. However, evaluating SimRank of all nodes in a network is not only time-consuming but also not pragmatic, since users are only interested in the most similar pairs in many real-world applications. This paper focuses on topk similarity join based on SimRank. In this work, we first present an incremental algorithm for computing SimRank. On top of that, we derive an iterative batch pruning framework, which is able to iteratively filter out unpromising nodes and obtain the topk pairs in a fast mode. Specifically, we define the concept of super node such that for a node in the network, the SimRank with its super node is not less than that with any others. Based on this feature, we propose a tight upper bound for each node that can be easily calculated after each iteration. Experiments on both real-life and synthetic datasets demonstrate that our method achieves better performance and scalability, in comparison with the state-of-the-art solution. © 2016 Elsevier Inc. All rights reserved.

DOI: 10.1016/j.ins.2016.10.042

14 Figures and Tables

Cite this paper

@article{Li2017FastTS, title={Fast top-k similarity join for SimRank}, author={Ruiqi Li and Xiang Zhao and Haichuan Shang and Yifan Chen and Weidong Xiao}, journal={Inf. Sci.}, year={2017}, volume={381}, pages={1-19} }