TY  - JOUR
TI  - Multimodal feature extraction and fusion for determining RGP lens specification base-curve through Pentacam images
AU  - Ebrahimi, Leyla
AU  - Veisi, Hadi
AU  - Jafarzadehpour, Ebrahim
AU  - Hashemi, Sara
PY  - 2025
JO  - Exploration of Digital Health Technologies
VL  - 3
SP  - 101175
DO  - 10.37349/edht.2025.101175
UR  - https://www.explorationpub.com/Journals/edht/Article/101175
AB  - Aim: Patients diagnosed with irregular astigmatism often require specific methods of vision correction. Among these, the use of a rigid gas permeable (RGP) lens is considered one of the most effective treatment approaches. This study aims to propose a new automated method for accurate RGP lens base-curve detection. Methods: A multi-modal feature fusion approach was developed based on Pentacam images, incorporating image processing and machine learning techniques. Four types of features were extracted from the images and integrated through a serial feature fusion mechanism. The fused features were then evaluated using a multi-layered perceptron (MLP) network. Specifically, the features included: (1) middle-layer outputs of a convolutional autoencoder (CAE) applied to RGB map combinations; (2) ratios of colored areas in the front cornea map; (3) a feature vector from cornea front parameters; and (4) the radius of the reference sphere/ellipse in the front elevation map. Results: Evaluations were performed on a manually labeled dataset. The proposed method achieved a mean squared error (MSE) of 0.005 and a coefficient of determination of 0.79, demonstrating improved accuracy compared to existing techniques. Conclusions: The proposed multi-modal feature fusion technique provides a reliable and accurate solution for RGP lens base-curve detection. This approach reduces manual intervention in lens fitting and represents a significant step toward automated base-curve determination.
ER  -