AdaBins: Depth Estimation Using Adaptive Bins

Reference

AdaBins: Depth Estimation Using Adaptive Bins

Introduction

Official Repo

Code Snippet

Abstract

We address the problem of estimating a high quality dense depth map from a single RGB input image. We start out with a baseline encoder-decoder convolutional neural network architecture and pose the question of how the global processing of information can help improve overall depth estimation. To this end, we propose a transformer-based architecture block that divides the depth range into bins whose center value is estimated adaptively per image. The final depth values are estimated as linear combinations of the bin centers. We call our new building block AdaBins. Our results show a decisive improvement over the state-of-the-art on several popular depth datasets across all metrics.We also validate the effectiveness of the proposed block with an ablation study and provide the code and corresponding pre-trained weights of the new state-of-the-art model.

Our main contributions are the following:

• We propose an architecture building block that performs global processing of the scene’s information.We propose to divide the predicted depth range into bins where the bin widths change per image. The final depth estimation is a linear combination of the bin center values.
• We show a decisive improvement for supervised single image depth estimation across all metrics for the two most popular datasets, NYU and KITTI.
• We analyze our findings and investigate different modifications on the proposed AdaBins block and study their effect on the accuracy of the depth estimation.

Performance

NYU and KITTI

Citation

@article{10.1109/cvpr46437.2021.00400,
    author = {Bhat, S. A. and Alhashim, I. and Wonka, P.},
    title = {Adabins: depth estimation using adaptive bins},
    journal = {2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    year = {2021},
    doi = {10.1109/cvpr46437.2021.00400}
}