Web unit mining: finding and classifying subgraphs of web pages


In web classification, most researchers assume that the objects to classify are individual web pages from one or more web sites. In practice, the assumption is too restrictive since a web page itself may not always correspond to a concept instance of some semantic concept (or category) given to the classification task. In this paper, we want to relax this assumption and allow a concept instance to be represented by a subgraph of web pages or a set of web pages. We identify several new issues to be addressed when the assumption is removed, and formulate the <b>web unit mining</b> problem. We also propose an iterative web unit mining (iWUM) method that first finds subgraphs of web pages using some knowledge about web site structure. From these web subgraphs, web units are constructed and classified into semantic concepts (or categories) in an iterative manner. Our experiments using the WebKB dataset showed that iWUM improves the overall classification performance and works very well on the more structured parts of a web site.

DOI: 10.1145/956863.956885

Extracted Key Phrases

6 Figures and Tables

Cite this paper

@inproceedings{Sun2003WebUM, title={Web unit mining: finding and classifying subgraphs of web pages}, author={Aixin Sun and Ee-Peng Lim}, booktitle={CIKM}, year={2003} }