Journal Article

An Arabic text categorization approach using term weighting and multiple reducts

Al-Radaideh, Qasem A., Al-Abrat, Mohammed A.

2019

Overview

Text categorization is the process of assigning a predefined category label to an unlabeled document based on its content. One of the challenges of automatic text categorization is the high dimensionality of data that may affect the performance of the categorization model. This paper proposed an approach for the categorization of Arabic text based on term weighting and the reduct concept of the rough set theory to reduce the number of terms used to generate the classification rules that form the classifier. The paper proposed a multiple minimal reduct extraction algorithm by improving the Quick reduct algorithm. The multiple reducts are used to generate the set of classification rules which represent the rough set classifier. To evaluate the proposed approach, an Arabic corpus of 2700 documents nine categories is used. In the experiment, we compared the results of the proposed approach when using multiple and single minimal reducts. The results showed that the proposed approach had achieved an accuracy of 94% when using multiple reducts, which outperformed the single reduct method which achieved an accuracy of 86%. The results of the experiments also showed that the proposed approach outperforms both the K -NN and J48 algorithms regarding classification accuracy using the dataset on hand.

• Publisher: Springer Berlin Heidelberg,Springer Nature B.V
• Subject: Algorithms / Approximation / Arabic language / Artificial Intelligence / Classification / Classifiers / Computational Intelligence / Control / Data mining / Documents / Engineering / Feature selection / Information retrieval / Mathematical Logic and Foundations / Mechatronics / Methodologies and Application / Robotics / Set theory / Text categorization / Weighting