Exploiting Visual Contents in Posters and Still Frames for Movie Recommendation

Xiaojie Chen, Pengpeng Zhao, Jiajie Xu, Zhixu Li, Lei Zhao, Yanchi Liu, Victor S. Sheng, Zhiming Cui

Research output: Contribution to journalArticlepeer-review

8 Scopus citations


Recommender systems, e.g., movie recommendation, play an important role in our life. However, few movie recommendation methods have considered the rich visual content information in posters and still frames, which can be used to alleviate the data sparsity and cold start problems in recommendation. Moreover, no existing paper has taken visual feature learning and recommendation into a unified optimization process. To this end, in this paper, we focus on how to use visual contents to improve the performance of movie recommendation and propose a novel movie recommendation model named unified visual contents matrix factorization (UVMF) that integrates visual feature extraction and recommendation into a unified framework. Specifically, we integrate convolutional neural network into probabilistic matrix factorization, and the model can be trained end-to-end. Moreover, we unfix weights in the last few layers of VGG16 to learn features and adapt them for the movie recommendation task. Finally, the experimental results on real-world data show that UVMF outperforms other benchmark methods in terms of recommendation accuracy.

Original languageEnglish
Article number8529200
Pages (from-to)68874-68881
Number of pages8
JournalIEEE Access
StatePublished - 2018


  • Movie recommendation
  • probabilistic matrix factorization
  • visual contents


Dive into the research topics of 'Exploiting Visual Contents in Posters and Still Frames for Movie Recommendation'. Together they form a unique fingerprint.

Cite this