Journal Article

Region-wise landmarks-based feature extraction employing SIFT, SURF, and ORB feature descriptors to recognize Monozygotic twins from 2D/3D Facial Images

Nayak, Vinod, Prakasha K, Krishna, Jayakala, Aparna, Sanil, Gangothri, Prabhu, Srikanth

2025

Overview

Background In computer vision and image processing, face recognition is increasingly popular field of research that identifies similar faces in a picture and assigns a suitable label. It is one of the desired detection techniques employed in forensics for criminal identification. Methods This study explores face recognition system for monozygotic twins utilizing three widely recognized feature descriptor algorithms: Scale-Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), and Oriented Fast and Rotated BRIEF (ORB)—with region-specific facial landmarks. These landmarks were extracted from 468 points detected through the MediaPipe framework, which enables simultaneous recognition of multiple faces. Quantitative similarity metrics t served as inputs for four classification methods: Support Vector Machine (SVM), eXtreme Gradient Boost (XGBoost), Light Gradient Boost Machine (LGBM), and Nearest Centroid (NC). The effectiveness of these algorithms was tested and validated using challenging ND Twins and 3D TEC datasets, the most difficult data sets for 2D and 3D face recognition research at Notre Dame University. Results Testing with Notre Dame University’s challenging ND Twins and 3D TEC datasets revealed significant performance differences. Results demonstrated that 2D facial images achieved notably higher recognition accuracy than 3D images. The 2D images produced accuracy of 88% (SVM), 83% (LGBM), 83% (XGBoost), and 79% (NC). In contrast, the 3D TEC dataset yielded a lower accuracy r of 74%, 72%, 72%, and 70%, with the same classifiers. Conclusion The hybrid feature extraction approach proved most effective, with maximum accuracy rates reaching 88% for 2D facial images and 74% for 3D facial images. This work contributes significantly to forensic science by enhancing the reliability of facial recognition systems when confronted with indistinguishable facial characteristics of monozygotic twins.

• Publisher: Faculty of 1000 Ltd,F1000 Research Limited,F1000 Research Ltd
• Subject: Access control / Accuracy / Algorithms / Automated Facial Recognition - methods / Biometrics / Birth rate / Crime / Criminal investigations / Deoxyribonucleic acid / DNA / Drug trafficking / eng / Evidence / Face / Face - anatomy & histology / Facial images; 468 Landmarks; Local features; Key points; Feature Descriptor; Monozy-gotic twins; Machine Learning / Facial recognition technology / Forensic science / Genetic testing / Humans / Identification / Image processing / Image Processing, Computer-Assisted - methods / Imaging, Three-Dimensional - methods / Jewelry / Morphology / Murders & murder attempts / Pattern recognition / Sex crimes / Support Vector Machine / Twins / Twins, Monozygotic