AIRCC's International Journal of Computer Science and Information Technology

Open Access Open Access  Restricted Access Subscription Access

Shortcomings And Flaws In The Mathematical Derivation Of The Fundamental Matrix Equation


Affiliations
1 College of Engineering and Computing, Al Ghurair University, Dubai, United Arab Emirates
 

In stereo vision, the epipolar geometry is the intrinsic projective geometry between the two views. The essential and fundamental matrices relate corresponding points in stereo images. The essential matrix describes the geometry when the used cameras are calibrated, and the fundamental matrix expresses the geometry when the cameras are uncalibrated. Since the nineties, researchers devoted a lot of effort to estimate the fundamental matrix. Although it is a landmark of computer vision, in the current work, three derivations of the essential and fundamental matrices have been revised. The Longuet-Higgins' derivation of the essential matrix where he draws a mapping between the position vectors of a 3D point; however, the one-to-one feature of that mapping is lost when he changed it to a relation between the image points. In the two other derivations, we demonstrate that the authors established a mapping between the image points through the misuse of mathematics.

Keywords

Fundamental Matrix, Essential Matrix, Stereo Vision, 3D Reconstruction.
User
Notifications
Font Size

  • Richard Hartley & Andrew Zisserman, (2004). Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, chapter 9.

  • Tayeb Basta, (ACSTY 2022) “Shortcomings of the Fundamental Matrix Equation to Reconstruct 3d Scenes”, 8th International Conference on Advances in Computer Science and Information Technology, pp. 77-86, Zurich, Switzerland.

  • Omid Poursaeed, Guandao Yang, Aditya Prakash, Qiuren Fang, Hanqing Jiang, Bharath Hariharan & Serge Belongie, (2018) “Deep fundamental matrix estimation without correspondences”, In Proceedings of the European conference on computer vision workshop, pp1–13.

  • Daniel Barath, (2018) “Five-Point Fundamental Matrix Estimation for Uncalibrated Cameras”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp235243.

  • Yi Zhou, Laurent Kneip & Hongdong Li, (2015) “A revisit of methods for determining the fundamental matrix with planes”, In 2015 International conference on digital image computing techniques and applications (DICTA), pp 1–7. IEEE. http//ieeexplore.ieee.org/document/7371221/.

  • Sushil Pratap Bharati, Feng Cen, Ajay Sharda & Guanghui Wang, (2018) “RES-Q Robust Outlier Detection Algorithm for Fundamental Matrix Estimation”, IEEE Access, 6, 48664–48674.

  • Nurollah Tatar & Hossein Arefi, (2019) “Stereo rectification of pushbroom satellite images by robustly estimating the fundamental matrix”, International Journal of Remote Sensing, 40(23), 88798898.

  • Andrew Zisserman & Stephen Maybank, (1993) “A Case Against Epipolar Geometry”, In 2nd Europe-U.S. Workshop on Invariance, pp69–88. Ponta Delgada, Azores.

  • Richard Hartley, (1997) “In Defense of the Eight-Point Algorithm”, IEEE Transaction on Pattern Recognition and Machine Intelligence, 19(6), 580–593.

  • Hugh Christopher Longuet-Higgins (1984) “The Reconstruction of a Scene from Two ProjectionsConfigurations that Defeat the 8-Point Algorithm”, In Proceedings of 1st Conf. Artificial Intelligence Applications, pp395-397.

  • Quang-Tuan Luong & Olivier Faugeras, (1993) “Determining the Fundamental Matrix with Planes Instability and New Algorithms”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 93, pp489-494. New York.

  • Thomas Marill, (1988) “A Counterexample to the Theory That Vision Recovers Three-Dimensional Scenes”, A. I. Working Paper, MIT Artificial Intelligence Laboratory, 319.

  • Berthold Horn, (1999) “Projective Geometry Considered Harmful”, Copyright © people.csail.mit.edu/bkph/articles/Harmful.pdf, last accessed 2021/6/15.

  • Tayeb Basta, (2009) “Mathematical flaws in the essential matrix theory”, In Proceedings of WSEAS International Conference, in Recent Advances in Computer Engineering, 9, pp215-220. Budapest, Hungary.

  • Tayeb Basta, (2010) “An Invalid Derivation of the Fundamental Matrix Based on the Equation of a Point Lying on a Line”, Workshop on Frontiers of Computer Vision FCV 2010, pp83 – 88. Hiroshima, Japan.

  • Tayeb Basta, (2012) “Does the Fundamental Matrix Define a One-to-One Relation between the Corresponding Image Points of a Scene?”,Journal of Image and Graphics, 1(3), 125-128.

  • Tayeb Basta, (2014) “Is the Fundamental Matrix Really Independent of the Scene Structure?”, International Journal of Signal Processing, Image Processing and Pattern Recognition, 7(5), 149-168.

  • Tayeb Basta, (2017) “The Eight-Point Algorithm is not in Need of Defense”, ARPN Journal of Engineering and Applied Sciences, 12(3), 753-760.

  • Joaquin Salvi, “Fundamental Matrix Estimation toolbox”, http//eia.udg.es/~qsalvi/recerca.html, last accessed 3/3/2016.

  • Tayeb Basta, (2019) “The Controversy Surrounding the Application of Projective Geometry to Stereo Vision”, In Proceedings of the 5th International Conference on Computer and Technology Applications, ICCTA, pp 15–19. Istanbul.

  • Tayeb Basta, (2020) “Experimental and Theoretical Scrutiny of the Geometric Derivation of the

  • Fundamental Matrix”, In Proceedings of the 3rd International Conference on Artificial Intelligence

  • and Pattern Recognition, pp25-29. Huaqiao University, Xiamen, China.

  • Hugh Christopher Longuet-Higgins, (1981) “A computer algorithm for reconstructing a scene from two projections”, Nature, 293, 133-135.

  • Ron Larson, (2016) Elementary Linear Algebra. 8th edn. Cengage Learning.

  • Aslam Kassimali, Braja M Das, and Sedat Sami, Mechanics for Engineers: Statics, J. ROSS PUBLISHING (MAR 2010), P. 170.

  • I. C. Jong, B. G. Rogers. Engineering Mechanics: Statics, Saunders College Publishing, 1991, p. 99.

  • Quang-Tuan Luong & Olivier Faugeras, (1996) “The Fundamental matrix theory, algorithms, and

  • stability analysis”, International Journal of Computer Vision, 17(1), 43-76.

  • Stan Birchfield, (1998) “An introduction to projective geometry (for computer vision)”, Stanforduniversityhttps//www.hhi.fraunhofer.de/fileadmin/Departments/VIT/IMC/Team/schreer/doc_pub/199

  • _Lecture_ProjGeometryIntro_Birchfield.pdf, last accessed 2021/04/12.

  • Jianguo Liu, Xuesong Li, Qin Qin & Hao Zhang, (2016) “Study of occlusion problem in stereo matching”, 17th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), pp195-199. Shanghai, China.


Abstract Views: 333

PDF Views: 150




  • Shortcomings And Flaws In The Mathematical Derivation Of The Fundamental Matrix Equation

Abstract Views: 333  |  PDF Views: 150

Authors

Tayeb Basta
College of Engineering and Computing, Al Ghurair University, Dubai, United Arab Emirates

Abstract


In stereo vision, the epipolar geometry is the intrinsic projective geometry between the two views. The essential and fundamental matrices relate corresponding points in stereo images. The essential matrix describes the geometry when the used cameras are calibrated, and the fundamental matrix expresses the geometry when the cameras are uncalibrated. Since the nineties, researchers devoted a lot of effort to estimate the fundamental matrix. Although it is a landmark of computer vision, in the current work, three derivations of the essential and fundamental matrices have been revised. The Longuet-Higgins' derivation of the essential matrix where he draws a mapping between the position vectors of a 3D point; however, the one-to-one feature of that mapping is lost when he changed it to a relation between the image points. In the two other derivations, we demonstrate that the authors established a mapping between the image points through the misuse of mathematics.

Keywords


Fundamental Matrix, Essential Matrix, Stereo Vision, 3D Reconstruction.

References