3D scene generation by learning from examples

Mesfin A. Dema, Hamed Sari-Sarraf

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Due to overwhelming use of 3D models in video games and virtual environments, there is a growing interest in 3D scene generation, scene understanding and 3D model retrieval. In this paper, we introduce a data-driven 3D scene generation approach from a Maximum Entropy (MaxEnt) model selection perspective. Using this model selection criterion, new scenes can be sampled by matching a set of contextual constraints that are extracted from training and synthesized scenes. Starting from a set of random synthesized configurations of objects in 3D, the MaxEnt distribution is iteratively sampled (using Metropolis sampling) and updated until the constraints between training and synthesized scenes match, indicating the generation of plausible synthesized 3D scenes. To illustrate the proposed methodology, we use 3D training desk scenes that are all composed of seven predefined objects with different position, scale and orientation arrangements. After applying the MaxEnt framework, the synthesized scenes show that the proposed strategy can generate reasonably similar scenes to the training examples without any human supervision during sampling. We would like to mention, however, that such an approach is not limited to desk scene generation as described here and can be extended to any 3D scene generation problem.

Original languageEnglish
Title of host publicationProceedings - 2012 IEEE International Symposium on Multimedia, ISM 2012
Pages58-64
Number of pages7
DOIs
StatePublished - 2012
Event14th IEEE International Symposium on Multimedia, ISM 2012 - Irvine, CA, United States
Duration: Dec 10 2012Dec 12 2012

Publication series

NameProceedings - 2012 IEEE International Symposium on Multimedia, ISM 2012

Conference

Conference14th IEEE International Symposium on Multimedia, ISM 2012
CountryUnited States
CityIrvine, CA
Period12/10/1212/12/12

Keywords

  • 3D scene generation
  • Markov random field
  • Maximum entropy

Fingerprint Dive into the research topics of '3D scene generation by learning from examples'. Together they form a unique fingerprint.

  • Cite this

    Dema, M. A., & Sari-Sarraf, H. (2012). 3D scene generation by learning from examples. In Proceedings - 2012 IEEE International Symposium on Multimedia, ISM 2012 (pp. 58-64). [6424631] (Proceedings - 2012 IEEE International Symposium on Multimedia, ISM 2012). https://doi.org/10.1109/ISM.2012.19