On Disharmony in Batch Normalization and Dropout Methods for Early Categorization of Alzheimer’s Disease

Ahsan Bin Tufail, Inam Ullah, Ateeq Ur Rehman, Rehan Ali Khan, Muhammad Abbas Khan, Yong-Kui Ma, Nadar Hussain Khokhar, Muhammad Tariq Sadiq, Rahim Khan, Muhammad Shafiq, Elsayed Tag Eldin, Nivin A. Ghamry

Research output: Contribution to journalArticlepeer-review

Abstract

Alzheimer’s disease (AD) is a global health issue that predominantly affects older people. It affects one’s daily activities by modifying neural networks in the brain. AD is categorized by the death of neurons, the creation of amyloid plaques, and the development of neurofibrillary tangles. In clinical settings, an early diagnosis of AD is critical to limit the problems associated with it and can be accomplished using neuroimaging modalities, such as magnetic resonance imaging (MRI) and positron emission tomography (PET). Deep learning (DL) techniques are widely used in computer vision and related disciplines for various tasks such as classification, segmentation, detection, etc. CNN is a sort of DL architecture, which is normally useful to categorize and extract data in the spatial and frequency domains for image-based applications. Batch normalization and dropout are commonly deployed elements of modern CNN architectures. Due to the internal covariance shift between batch normalization and dropout, the models perform sub-optimally under diverse scenarios. This study looks at the influence of disharmony between batch normalization and dropout techniques on the early diagnosis of AD. We looked at three different scenarios: (1) no dropout but batch normalization, (2) a single dropout layer in the network right before the softmax layer, and (3) a convolutional layer between a dropout layer and a batch normalization layer. We investigated three binaries: mild cognitive impairment (MCI) vs. normal control (NC), AD vs. NC, AD vs. MCI, one multiclass AD vs. NC vs. MCI classification problem using PET modality, as well as one binary AD vs. NC classification problem using MRI modality. In comparison to using a large value of dropout, our findings suggest that using little or none at all leads to better-performing designs.
Original languageEnglish
Article number14695
Number of pages22
JournalSustainability
Volume14
Issue number22
DOIs
Publication statusPublished - 8 Nov 2022

Bibliographical note

Funding Information:
Data collection and sharing for this project was funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI).

Funding Information:
This research was supported by the Future University Researchers Supporting Project Number FUESP-2020/48 at Future University in Egypt, New Cairo 11845, Egypt.

Publisher Copyright:
© 2022 by the authors.

Keywords

  • neuroimaging
  • classification
  • augmentation
  • statistical comparison
  • batch normalization
  • dropout

Fingerprint

Dive into the research topics of 'On Disharmony in Batch Normalization and Dropout Methods for Early Categorization of Alzheimer’s Disease'. Together they form a unique fingerprint.

Cite this