Journal Article

Citrus Tree Canopy Segmentation of Orchard Spraying Robot Based on RGB-D Image and the Improved DeepLabv3

Xue, Xiuyun, Li, Zhen, Lyu, Shilei, Luo, Qin, Bu, Maofeng, Song, Shuran

2023

Overview

The accurate and rapid acquisition of fruit tree canopy parameters is fundamental for achieving precision operations in orchard robotics, including accurate spraying and precise fertilization. In response to the issue of inaccurate citrus tree canopy segmentation in complex orchard backgrounds, this paper proposes an improved DeepLabv3+ model for fruit tree canopy segmentation, facilitating canopy parameter calculation. The model takes the RGB-D (Red, Green, Blue, Depth) image segmented canopy foreground as input, introducing Dilated Spatial Convolution in Atrous Spatial Pyramid Pooling to reduce computational load and integrating Convolutional Block Attention Module and Coordinate Attention for enhanced edge feature extraction. MobileNetV3-Small is utilized as the backbone network, making the model suitable for embedded platforms. A citrus tree canopy image dataset was collected from two orchards in distinct regions. Data from Orchard A was divided into training, validation, and test set A, while data from Orchard B was designated as test set B, collectively employed for model training and testing. The model achieves a detection speed of 32.69 FPS on Jetson Xavier NX, which is six times faster than the traditional DeepLabv3+. On test set A, the mIoU is 95.62%, and on test set B, the mIoU is 92.29%, showing a 1.12% improvement over the traditional DeepLabv3+. These results demonstrate the outstanding performance of the improved DeepLabv3+ model in segmenting fruit tree canopies under different conditions, thus enabling precise spraying by orchard spraying robots.

• Publisher: MDPI AG
• Subject: Accuracy / Agricultural production / agronomy / attention mechanism / Canopies / canopy / Citrus / Citrus fruits / citrus tree canopy / Citrus trees / Computer networks / Data collection / Deep learning / Feature extraction / Fertilization / Fruit trees / Fruits / Image acquisition / Image segmentation / improved DeepLabv3 / Light / Mathematical models / Methods / Model testing / orchard spraying robot / Orchards / Parameters / Pesticides / R&D / Research & development / RGB-D detector / Robotics / Robots / Semantics / Sensors / Spraying / Test sets / Training / Trees