首页    期刊浏览 2024年11月27日 星期三
登录注册

文章基本信息

  • 标题:Application of Improved Recommendation System Based on Spark Platform in Big Data Analysis
  • 本地全文:下载
  • 作者:Li Xie ; Wenbo Zhou ; Yaosen Li
  • 期刊名称:Cybernetics and Information Technologies
  • 印刷版ISSN:1311-9702
  • 电子版ISSN:1314-4081
  • 出版年度:2016
  • 卷号:16
  • 期号:6
  • 页码:245
  • 出版社:Bulgarian Academy of Science
  • 摘要:In the era of big data, people have to face information filtration problem. For those cases when users do not or cannot express their demands clearly, recommender system can analyse user’s information more proactive and intelligent to filter out something users want. This property makes recommender system play a very important role in the field of e-commerce, social network and so on. The collaborative filtering recommendation algorithm based on Alternating Least Squares (ALS) is one of common algorithms using matrix factorization technique of recommendation system. In this paper, we design the parallel implementation process of the recommendation algorithm based on Spark platform and the related technology research of recommendation systems. Because of the shortcomings of the recommendation algorithm based on ALS model, a new loss function is designed. Before the model is trained, the similarity information of users and items is fused. The experimental results show that the performance of the proposed algorithm is better than that of algorithm based on ALS.
  • 关键词:Spark; recommendation system; collaborative filtering; alternating least squares.
国家哲学社会科学文献中心版权所有