Journal Article

Quality Grading of Oudemansiella raphanipes Using Three-Teacher Knowledge Distillation with Cascaded Structure for LightWeight Neural Networks

Peng, Yangyang, Hu, Haiying, Liu, Ming, Zhou, Hui, Chen, Haoxuan, Huang, Huamao

2025

Overview

Oudemansiella raphanipes is valued for its rich nutritional content and medicinal properties, but traditional manual grading methods are time-consuming and labor-intensive. To address this, deep learning techniques are employed to automate the grading process, and knowledge distillation (KD) is used to enhance the accuracy of a small-parameter model while maintaining a low resource occupation and fast response speed in resource-limited devices. This study employs a three-teacher KD framework and investigates three cascaded structures: the parallel model, the standard series model, and the series model with residual connections (residual-series model). The student model used is a lightweight ShuffleNet V2 0.5x, while the teacher models are VGG16, ResNet50, and Xception. Our experiments show that the cascaded structures result in improved performance indices, compared with the traditional ensemble model with equal weights; in particular, the residual-series model outperforms the other models, achieving a grading accuracy of 99.7% on the testing dataset with an average inference time of 5.51 ms. The findings of this study have the potential for broader application of KD in resource-limited environments for automated quality grading.

• Publisher: MDPI AG
• Subject: Accuracy / Agricultural production / Algorithms / Automation / Classification / Datasets / Deep learning / Distillation / Knowledge / knowledge distillation / Machine learning / Mechanization / multi-teacher model / Mushrooms / Neural networks / Oudemansiella raphanipes / Performance indices / quality grading / Teachers