Reconstructing indoor scenes with omni-cameras

Abstract

We present a system similar to Debevec’s Facade [DTM96] that improves the reconstruction of indoor scenes from photographs. With confined spaces it is often impractical to use regular photos as the base of the reconstruction. Combining pinhole cameras with fisheye shoots or photographs of any kind of reflective, parametrisable body such as light probes eases this problem. We call the later camera setup an omni-camera, because it enables us to acquire as much information as possible from a given viewpoint. Omni-cameras make it possible to reconstruct the geometry of an entire room from just one view. Removing the pinhole camera constraint invalidates some key assumptions made in Facade. This paper shows how to work around the problems arising from this approach by adding scene specific knowledge as well as a genetic component to the solver. When using omni-cameras we can no longer take advantage of a simple texture projection to obtain the materials for the scene. Instead we propose a method for texture generation that is transparent to the camera setup used.