Photo2Trip: Exploiting visual contents in geo-tagged photos for personalized tour recommendation

Pengpeng Zhao, Xiefeng Xu, Yanchi Liu, Victor S. Sheng, Kai Zheng, Hui Xiong

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Scopus citations

Abstract

Recently accumulated massive amounts of geo-tagged photos provide an excellent opportunity to understand human behaviors and can be used for personalized tour recommendation. However, no existing work has considered the visual content information in these photos for tour recommendation. We believe the visual features of photos provide valuable information on measuring user/Point-of-Interest (POI) similarities, which is challenging due to data sparsity. To this end, in this paper, we propose a visual feature enhanced tour recommender system, named 'Photo2Trip', to utilize the visual contents and collaborative filtering models for recommendation. Specifically, we first extract various visual features from photos taken by tourists. Then, we propose a Visual-enhanced Probabilistic Matrix Factorization model (VPMF), which integrates visual features into the collaborative filtering model, to learn user interests by leveraging the historical travel records. Moreover, user interests together with trip constraints are formalized to an optimization problem for trip planning. Finally, the experimental results on real-world data show that our proposed visual-enhanced personalized tour recommendation method outperforms other benchmark methods in terms of recommendation accuracy. The results also show that visual features are effective on alleviating the data sparsity and cold start problems on personalized tour recommendation.

Original languageEnglish
Title of host publicationMM 2017 - Proceedings of the 2017 ACM Multimedia Conference
PublisherAssociation for Computing Machinery, Inc
Pages916-924
Number of pages9
ISBN (Electronic)9781450349062
DOIs
StatePublished - Oct 23 2017
Event25th ACM International Conference on Multimedia, MM 2017 - Mountain View, United States
Duration: Oct 23 2017Oct 27 2017

Publication series

NameMM 2017 - Proceedings of the 2017 ACM Multimedia Conference

Conference

Conference25th ACM International Conference on Multimedia, MM 2017
CountryUnited States
CityMountain View
Period10/23/1710/27/17

Keywords

  • Collaborative filtering
  • Tour recommendation
  • Visual content

Fingerprint Dive into the research topics of 'Photo2Trip: Exploiting visual contents in geo-tagged photos for personalized tour recommendation'. Together they form a unique fingerprint.

  • Cite this

    Zhao, P., Xu, X., Liu, Y., Sheng, V. S., Zheng, K., & Xiong, H. (2017). Photo2Trip: Exploiting visual contents in geo-tagged photos for personalized tour recommendation. In MM 2017 - Proceedings of the 2017 ACM Multimedia Conference (pp. 916-924). (MM 2017 - Proceedings of the 2017 ACM Multimedia Conference). Association for Computing Machinery, Inc. https://doi.org/10.1145/3123266.3123336