An adaptive deep learning framework for dynamic image classification in the internet of things environment

Syed Muslim Jameel, Manzoor Ahmed Hashmani, Mobashar Rehman, Arif Budiman

Research output: Contribution to journalArticlepeer-review

17 Citations (Scopus)

Abstract

In the modern era of digitization, the analysis in the Internet of Things (IoT) environment demands a brisk amalgamation of domains such as high-dimension (images) data sensing technologies, robust internet connection (4 G or 5 G) and dynamic (adaptive) deep learning approaches. This is required for a broad range of indispensable intelligent applications, like intelligent healthcare systems. Dynamic image classification is one of the major areas of concern for researchers, which may take place during analysis under the IoT environment. Dynamic image classification is associated with several temporal data perturbations (such as novel class arrival and class evolution issue) which cause a massive classification deterioration in the deployed classification models and make them in-effective. Therefore, this study addresses such temporal inconsistencies (novel class arrival and class evolution issue) and proposes an adapted deep learning framework (ameliorated adaptive convolutional neural network (CNN) ensemble framework), which handles novel class arrival and class evaluation issue during dynamic image classification. The proposed framework is an improved version of previous adaptive CNN ensemble with an additional online training (OT) and online classifier update (OCU) modules. An OT module is a clustering-based approach which uses the Euclidean distance and silhouette method to determine the potential new classes, whereas, the OCU updates the weights of the existing instances of the ensemble with newly arrived samples. The proposed framework showed the desirable classification improvement under non-stationary scenarios for the benchmark (CIFAR10) and real (ISIC 2019: Skin disease) data streams. Also, the proposed framework outperformed against stateof- art shallow learning and deep learning models. The results have shown the effectiveness and proven the diversity of the proposed framework to adapt the new concept changes during dynamic image classification. In future work, the authors of this study aim to develop an IoT-enabled adaptive intelligent dermoscopy device (for dermatologists). Therefore, further improvements in classification accuracy (for real dataset) is the future concern of this study.

Original languageEnglish
Article number5811
Pages (from-to)1-25
Number of pages25
JournalSensors (Switzerland)
Volume20
Issue number20
DOIs
Publication statusPublished - 2 Oct 2020

Keywords

  • Adaptive deep learning algorithm
  • Concept drift
  • Dynamic image classification
  • High dimensional stream analysis
  • Internet of things (IoT)

Fingerprint

Dive into the research topics of 'An adaptive deep learning framework for dynamic image classification in the internet of things environment'. Together they form a unique fingerprint.

Cite this