Towards high-resolution large-scale multi-view stereo

Hoang-Hiep Vu (1, 2) , Renaud Keriven (1, 2) , Patrick Labatut (1, 2) , Jean-Philippe Pons (1)

1 imagine [Marne-la-Vallée]
2 LIGM - Laboratoire d'Informatique Gaspard-Monge

Boosted by the Middlebury challenge, the precision of dense multi-view stereovision methods has increased drastically in the past few years. Yet, most methods, although they perform well on this benchmark, are still inapplicable to large-scale data sets taken under uncontrolled conditions. In this paper, we propose a multi-view stereo pipeline able to deal at the same time with very large scenes while still producing highly detailed reconstructions within very reasonable time. The keys to these benefits are twofold: (i) a minimum s-t cut based global optimization that transforms a dense point cloud into a visibility consistent mesh, followed by (ii) a mesh-based variational refinement that captures small details, smartly handling photo-consistency, regularization and adaptive resolution. Our method has been tested on numerous large-scale outdoor scenes. The accuracy of our reconstructions is also measured on the recent dense multi-view benchmark proposed by Strecha et al., showing our results to compare more than favorably with the current state-of-the-art.

Domains: Computer Vision and Pattern Recognition [cs.CV]

Hoang-Hiep Vu, Renaud Keriven, Patrick Labatut, Jean-Philippe Pons. Towards high-resolution large-scale multi-view stereo. CVPR, Jun 2009, Miami, United States. pp.1430-1437. ⟨hal-00834903⟩