Accéder directement au contenu Accéder directement à la navigation
Communication dans un congrès

Detect, Replace, Refine: Deep Structured Prediction for Pixel Wise Labeling

Spyros Gidaris 1, 2, 3 Nikos Komodakis 1, 2, 3
3 imagine [Marne-la-Vallée]
ligm - Laboratoire d'Informatique Gaspard-Monge, ENPC - École des Ponts ParisTech
Abstract : ixel wise image labeling is an interesting and challenging problem with great significance in the computer vision community. In order for a dense labeling algorithm to be able to achieve accurate and precise results, it has to consider the dependencies that exist in the joint space of both the input and the output variables. An implicit approach for modeling those dependencies is by training a deep neural network that, given as input an initial estimate of the output labels and the input image, it will be able to predict a new refined estimate for the labels. In this context, our work is concerned with what is the optimal architecture for performing the label improvement task. We argue that the prior approaches of either directly predicting new label estimates or predicting residual corrections w.r.t. the initial labels with feed-forward deep network architectures are sub-optimal. Instead, we propose a generic architecture that decomposes the label improvement task to three steps: 1) detecting the initial label estimates that are incorrect, 2) replacing the incorrect labels with new ones, and finally 3) refining the renewed labels by predicting residual corrections w.r.t. them. Furthermore, we explore and compare various other alternative architectures that consist of the aforementioned Detection, Replace, and Refine components. We extensively evaluate the examined architectures in the challenging task of dense disparity estimation (stereo matching) and we report both quantitative and qualitative results on three different datasets. Finally, our dense disparity estimation network that implements the proposed generic architecture, achieves state-of-the-art results in the KITTI 2015 test surpassing prior approaches by a significant margin.
Type de document :
Communication dans un congrès
Liste complète des métadonnées

https://hal-enpc.archives-ouvertes.fr/hal-01830015
Contributeur : Pascal Monasse <>
Soumis le : mercredi 4 juillet 2018 - 14:54:37
Dernière modification le : mercredi 26 février 2020 - 19:06:18

Lien texte intégral

Identifiants

Citation

Spyros Gidaris, Nikos Komodakis. Detect, Replace, Refine: Deep Structured Prediction for Pixel Wise Labeling. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Jul 2017, Honolulu, United States. ⟨10.1109/CVPR.2017.760⟩. ⟨hal-01830015⟩

Partager

Métriques

Consultations de la notice

209