Trifocal tensor

Uses your system voice; voice and rate in settings.

Snapshot

≈ 4 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

In computer vision, the trifocal tensor (also tritensor) is a 3×3×3 array of numbers (i.e., a tensor) that incorporates all projective geometric relationships among three views. It relates the coordinates of corresponding points or lines in three views, being independent of the scene structure and depending only on the relative motion (i.e., pose) among the three views and their intrinsic calibration parameters. Hence, the trifocal tensor can be considered as the generalization of the fundamental matrix in three views. It is noted that despite the tensor being made up of 27 elements, only 18 of them are actually independent. There is also a so-called calibrated trifocal tensor, which relates the coordinates of points and lines in three views given their intrinsic parameters and encodes the relative pose of the cameras up to global scale, totalling 11 independent elements or degrees of freedom. The reduced degrees of freedom allow for fewer correspondences to fit the model, at the cost of increased nonlinearity.

In computer vision, the trifocal tensor (also tritensor) is a 3×3×3 array of numbers (i.e., a tensor) that incorporates all projective geometric relationships among three views. It relates the coordinates of corresponding points or lines in three views, being independent of the scene structure and depending only on the relative motion (i.e., pose) among the three views and their intrinsic calibration parameters. Hence, the trifocal tensor can be considered as the generalization of the fundamental matrix in three views. It is noted that despite the tensor being made up of 27 elements, only 18 of them are actually independent. There is also a so-called calibrated trifocal tensor, which relates the coordinates of points and lines in three views given their intrinsic parameters and encodes the relative pose of the cameras up to global scale, totalling 11 independent elements or degrees of freedom. The reduced degrees of freedom allow for fewer correspondences to fit the model, at the cost of increased nonlinearity. The tensor can also be seen as a collection of three rank-two 3 x 3 matrices {\mathbf T}_1, \; {\mathbf T}_2, \; {\mathbf T}_3 known as its correlation slices. Assuming that the projection matrices of three views are {\mathbf P}=[ {\mathbf I} \; | \; {\mathbf 0} ] , {\mathbf P}'=[ {\mathbf A} \; | \; {\mathbf a}_4 ] and {\mathbf P}=[{\mathbf B} \; | \; {\mathbf b}_4 ] , the correlation slices of the corresponding tensor can be expressed in closed form as {\mathbf T}_i={\mathbf a}_i {\mathbf b}_4^t - {\mathbf a}_4 {\mathbf b}_i^t, \; i=1 \ldots 3 , where {\mathbf a}_i, \; {\mathbf b}_i are respectively the i th columns of the camera matrices. In practice, however, the tensor is estimated from point and line matches across the three views. ({\mathbf l}^{\prime t} \left[{\mathbf T}_1, \; {\mathbf T}_2, \; {\mathbf T}_3 \right] {\mathbf l}) [{\mathbf l}]_{\times} = {\mathbf 0}^t {\mathbf l}^{\prime t} \left( \sum_i x_i {\mathbf T}_i \right) {\mathbf l} = 0 {\mathbf l}^{\prime t} \left( \sum_i x_i {\mathbf T}_i \right) [{\mathbf x}]_{\times} = {\mathbf 0}^t [{\mathbf x}']_{\times} \left( \sum_i x_i {\mathbf T}_i \right) {\mathbf l} = {\mathbf 0} [{\mathbf x}']_{\times} \left( \sum_i x_i {\mathbf T}_i \right) [{\mathbf x}]_{\times} = {\mathbf 0}_{3 \times 3} where [\cdot]_{\times} denotes the skew-symmetric cross product matrix.

Text derived from https://en.wikipedia.org/w/index.php?oldid=1286045535 under CC BY-SA 4.0; modifications have been made.

Sources cited in this revision

3 named source(s) extracted from the cited revision. A source with no author is shown by its publication; nothing is invented.