Vision Based Important Change Detection Method for Web Pages [基于视觉的网页重要变化检测方法]

作者：Shi C.^*; Yu X.; Liu Y.; Jin X.; Cheng X.

来源：Pattem Recognition and Aitificial Intelligence, 2020, 33(11): 1004-1012.

DOI：10.16451/j.cnki.issn1003-6059.202011005

• Change Detection
• Low Dimensional Vector
• Visual Feature
• Web Content

Duplicate Web indexes of Web crawling can be reduced effectively by detecting important changes and determining changes of essential content in Web pages. Therefore, a vision based detection method is proposed to detect changes in different semantic regions of the page and compress the page into a low dimensional vector representation. The proposed method is utilized to understand the difference of semantic importance in different regions from the perspective of users. Compared with the existing methods, the proposed method is independent of the analysis of HTML, and thus it is suitable for new media, such as mobile Internet. Experiments show the effectiveness of the proposed method.

• 单位
  中国科学院大学