Diabetic retinopathy detection and captioning based on lesion features using deep learning approach

Rizka Amalia, Alhadi Bustamam, Anggun Rama Yudantha, Andi Arus Victor

Research output: Contribution to journalArticlepeer-review


Diabetic Retinopathy (DR) can lead to vision loss if the patient does not get effective treatment based on the patient’s condition. Early detection is needed to know what an effective treatment for those patients is. For helping ophthalmologists, DR detection methods using computer-based were developed. Ophthalmologists can use the result of the method as a consideration in diagnosing the class of DR. One of the powerful methods is deep learning. The proposed method uses two deep learning architectures, namely Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN), for DR detection. CNN is used to detect DR lesion features, and RNN is used for captioning based on those lesion features. We used three pre-trained CNN models, including AlexNet, VGGNet and GoogleNet, and used Long Short-Term Memory (LSTM) as RNN models. In the image preprocessing, we applied contrast enhancement using Contrast Limited Adaptive Histogram Equalization (CLAHE) and compared the results with those without CLAHE. We have done the training and testing process with a different proportion of data. The experimental results show that our proposed method can detect the lesion features and generate caption with the highest average accuracy of 96.12% for GoogleNet and LSTM with CLAHE and the proportion 70% training data 30% testing data.

Original languageEnglish
Article number59
JournalCommunications in Mathematical Biology and Neuroscience
Publication statusPublished - 2021


  • Convolutional neural network (CNN)
  • Deep learning
  • Diabetic retinopathy
  • Long short-term memory (LSTM)


Dive into the research topics of 'Diabetic retinopathy detection and captioning based on lesion features using deep learning approach'. Together they form a unique fingerprint.

Cite this