Journal Article

A Plant Disease Recognition Method Based on Fusion of Images and Graph Structure Text

Zhao, Chunjiang, Zhou, Ji, Wu, Huarui, Teng, Guifa, Wang, Chunshan, Zhang, Yan, Li, Jiuxi

2022

Overview

The disease image recognition models based on deep learning have achieved relative success under limited and restricted conditions, but such models are generally subjected to the shortcoming of weak robustness. The model accuracy would decrease obviously when recognizing disease images with complex backgrounds under field conditions. Moreover, most of the models based on deep learning only involve characterization learning on visual information in the image form, while the expression of other modal information rather than the image form is often ignored. The present study targeted the main invasive diseases in tomato and cucumber as the research object. Firstly, in response to the problem of weak robustness, a feature decomposition and recombination method was proposed to allow the model to learn image features at different granularities so as to accurately recognize different test images. Secondly, by extracting the disease feature words from the disease text description information composed of continuous vectors and recombining them into the disease graph structure text, the graph convolutional neural network (GCN) was then applied for feature learning. Finally, a vegetable disease recognition model based on the fusion of images and graph structure text was constructed. The results show that the recognition accuracy, precision, sensitivity, and specificity of the proposed model were 97.62, 92.81, 98.54, and 93.57%, respectively. This study improved the model robustness to a certain extent, and provides ideas and references for the research on the fusion method of image information and graph structure information in disease recognition.

• Publisher: Frontiers Media SA,Frontiers Media S.A
• Subject: Accuracy / Agricultural production / Artificial neural networks / Crop diseases / Datasets / Deep learning / disease recognition / Feature decomposition / Feature extraction / fusion / graph convolutional neural network / Graph neural networks / Medical imaging / Neural networks / Plant diseases / Plant Science / Robustness / text recognition / Tomatoes / Visual discrimination learning