基于MPI的并行文本特征关联分析算法

作者：严善楷; 张平健

来源：中国,广东省,广州市.

• 文本挖掘
• 关联分析
• 并行处理
• 多点接口

　　With the rapid growth of the text mining technology,knowledge discovery in text is appealing more and more to researchers.Furthermore,association rule mining,an essential issue in data mining,is widely used in the field of text information.However,due to the exploding amount of information in different fields,the serial association rule mining algorithm has left much to be desired.In this paper,we propose a new parallel association rule mining algorithm on corpus,using MPI programming interface.The algorithm mainly makes use of distributed inverted hash index and the communication pattern based on chessboard decomposition to accelerate the generation of candidate itemsets.We implemented the algorithm and ran some test on the computer cluster.The performance evaluations show that the speedup rate can reach 16 when using 49 processes.

• 单位
  华南理工大学