Inverse depth parametrization

In inverse depth parametrization, a point is identified by its inverse depth ${\displaystyle \rho ={\frac {1}{\left\Vert \mathbf {p} -\mathbf {c} _{0}\right\Vert }}}$ along the ray, with direction ${\displaystyle v=(\cos \phi \sin \theta ,-\sin \phi ,\cos \phi \cos \theta )}$, from which it was first observed.

In computer vision, the inverse depth parametrization is a parametrization used in methods for 3D reconstruction from multiple images such as simultaneous localization and mapping (SLAM). ^{[1] [2]} Given a point ${\displaystyle \mathbf {p} }$ in 3D space observed by a monocular pinhole camera from multiple views, the inverse depth parametrization of the point's position is a 6D vector that encodes the optical centre of the camera ${\displaystyle \mathbf {c} _{0}}$ when in first observed the point, and the position of the point along the ray passing through ${\displaystyle \mathbf {p} }$ and ${\displaystyle \mathbf {c} _{0}}$. ^[3]

Inverse depth parametrization generally improves numerical stability and allows to represent points with zero parallax. Moreover, the error associated to the observation of the point's position can be modelled with a Gaussian distribution when expressed in inverse depth. This is an important property required to apply methods, such as Kalman filters, that assume normality of the measurement error distribution. The major drawback is the larger memory consumption, since the dimensionality of the point's representation is doubled. ^[3]

Definition

Given 3D point ${\displaystyle \mathbf {p} =(x,y,z)}$ with world coordinates in a reference frame ${\displaystyle (e_{1},e_{2},e_{3})}$, observed from different views, the inverse depth parametrization ${\displaystyle \mathbf {y} }$ of ${\displaystyle \mathbf {p} }$ is given by:

${\displaystyle \mathbf {y} =(x_{0},y_{0},z_{0},\theta ,\phi ,\rho )}$

where the first five components encode the camera pose in the first observation of the point, being ${\displaystyle \mathbf {c_{0}} =(x_{0},y_{0},z_{0})}$ the optical centre, ${\displaystyle \phi }$ the azimuth, ${\displaystyle \theta }$ the elevation angle, and ${\displaystyle \rho ={\frac {1}{\left\Vert \mathbf {p} -\mathbf {c} _{0}\right\Vert }}}$ the inverse depth of ${\displaystyle p}$ at the first observation. ^[3]

References

1. Piniés et al. (2007)
2. Sunderhauf et al. (2007)
3. Civiera et al. (2008)

Bibliography

• Montiel, JM Martínez; Civera, Javier; Davison, Andrew J (2006). "Unified inverse depth parametrization for monocular SLAM". Robotics: Science and Systems.
• Civera, Javier; Davison, Andrew J; Montiel, JM Martínez (2008). "Inverse depth parametrization for monocular SLAM". IEEE Transactions on Robotics. IEEE. 24 (5): 932–945. doi:10.1109/TRO.2008.2003276. S2CID   345360.
• Piniés, Pedro; Lupton, Todd; Sukkarieh, Salah; Tardós, Juan D (2007). "Inertial aiding of inverse depth SLAM using a monocular camera". Proceedings 2007 IEEE International Conference on Robotics and Automation. IEEE: 2797–2802. doi:10.1109/ROBOT.2007.363895. ISBN   978-1-4244-0602-9. S2CID   10474338.
• Sunderhauf, Niko; Lange, Sven; Protzel, Peter (2007). "Using the unscented Kalman filter in mono-SLAM with inverse depth parametrization for autonomous airship control". 2007 IEEE International Workshop on Safety, Security and Rescue Robotics. IEEE: 1–6.