Document-Level Text Classification Using Single-Layer Multisize Filters Convolutional Neural Network

Muhammad Pervez Akhter, Zheng Jiangbin, Irfan Raza Naqvi, Mohammed Abdelmajeed, Atif Mehmood, Muhammad Tariq Sadiq

Research output: Contribution to journalArticlepeer-review

Abstract

The rapid growth of electronic documents are causing problems like unstructured data that need more time and effort to search a relevant document. Text Document Classification (TDC) has a great significance in information processing and retrieval where unstructured documents are organized into pre-defined classes. Urdu is the most favorite research language in South Asian languages because of its complex morphology, unique features, and lack of linguistic resources like standard datasets. As compared to short text, like sentiment analysis, long text classification needs more time and effort because of large vocabulary, more noise, and redundant information. Machine Learning (ML) and Deep Learning (DL) models have been widely used in text processing. Despite the major limitations of ML models, like learn directed features, these are the favorite methods for Urdu TDC. To the best of our knowledge, it is the first study of Urdu TDC using DL model. In this paper, we design a large multi-purpose and multi-format dataset that contain more than ten thousand documents organize into six classes. We use Single-layer Multisize Filters Convolutional Neural Network (SMFCNN) for classification and compare its performance with sixteen ML baseline models on three imbalanced datasets of various sizes. Further, we analyze the effects of preprocessing methods on SMFCNN performance. SMFCNN outperformed the baseline classifiers and achieved 95.4%, 91.8%, and 93.3% scores of accuracy on medium, large and small size dataset respectively. The designed dataset would be publically and freely available in different formats for future research in Urdu text processing.

Original languageEnglish
Article number9016261
Pages (from-to)42689-42707
Number of pages19
JournalIEEE Access
Volume8
DOIs
Publication statusPublished - 27 Feb 2020

Bibliographical note

Funding Information:
This work was supported in part by the Research and Development Plan of Shaanxi Province under Grant 2017ZDXM-GY-094 and Grant 2015KTZDGY04-01, and in part by the National Natural Science Foundation of China under Grant 61972321.

Publisher Copyright:
© 2013 IEEE.

Keywords

  • Convolutional neural network
  • deep learning
  • machine learning
  • natural language processing
  • text document classification
  • Urdu text classification

Fingerprint

Dive into the research topics of 'Document-Level Text Classification Using Single-Layer Multisize Filters Convolutional Neural Network'. Together they form a unique fingerprint.

Cite this