Advanced Kiwifruit Soft Rot Detection with Deep Learning

In an article published in the journal Nature, researchers explored the accurate detection of kiwifruit soft rot using hyperspectral imaging (HSI) and deep learning. They introduced a dual-branch selective attention capsule network (DBSACaps) to improve classification accuracy.

Blocking process of kiwifruit image. First, the image was normalized to a uniform image size of 256x256, and then divided into blocks of 64x64 with a step size of 32. the blocks were labeled as soft rot, healthy and background based on the percentage of soft rot. The figure highlights canonical examples representing each of the three categories. Image Credit: https://www.nature.com/articles/s41598-024-61425-4
Blocking process of kiwifruit image. First, the image was normalized to a uniform image size of 256x256, and then divided into blocks of 64x64 with a step size of 32. the blocks were labeled as soft rot, healthy and background based on the percentage of soft rot. The figure highlights canonical examples representing each of the three categories. Image Credit: https://www.nature.com/articles/s41598-024-61425-4

By separately extracting spectral and spatial features and then fusing them with an attention mechanism, the proposed method achieved superior performance compared to existing methods, with an overall accuracy (OA) of 97.08% and 97.83% accuracy for soft rot, aiding in smart agriculture.

Background

Kiwifruit, renowned for its taste and nutritional value, faces significant postharvest losses due to diseases like soft rot. Early detection is vital but challenging, as initial symptoms are subtle and rapidly progress to fruit decay. HSI offers promise, capturing both spectral and image data to reveal hidden defects.

Previous studies utilized classical machine learning for disease detection, lacking efficient feature extraction and uniform classification criteria. Recent advancements in deep learning show promise, yet many methods overlook the unique properties of HSI. Current approaches often struggle to fully leverage spatial and spectral information, limiting classification accuracy.

This paper addressed these gaps by proposing DBSACaps tailored for kiwifruit soft rot detection. The network segregated feature extraction into spectral and spatial branches to mitigate interference and incorporated a selective attention module to enhance meaningful feature contribution. By employing capsule networks, the model gained robustness and achieved superior classification accuracy compared to conventional methods.

This work aimed to bridge the gap between existing methodologies and the unique challenges of kiwifruit disease detection using HSI. By harnessing the power of deep learning and optimizing network architecture for HSI, the proposed DBSACaps offered a promising solution for early and accurate soft rot detection, potentially revolutionizing postharvest treatment and storage practices in the kiwifruit industry.

Methods and Materials 

The researchers intended to detect soft rot in kiwifruits using HSI combined with a novel deep-learning approach. The dataset comprised 'Yunhai No.1' kiwifruits inoculated with Diaporthe eres to simulate soft rot under different conditions. Images were acquired daily using a portable hyperspectral imager, and a block segmentation method was employed for analysis. The dataset was augmented to enhance diversity, resulting in over 11,000 samples.

For feature extraction, a dual-branch approach was adopted, separating spectral and spatial features to prevent mutual interference. Spectral features were extracted using a three-dimensional (3D) convolutional neural network (CNN), while spatial features were obtained via a two-dimensional (2D) CNN. A selective attention module was introduced to fuse these features, assigning different weights based on their importance for classification.

Subsequently, a capsule network was employed for classification, leveraging the unique properties of capsules to capture spatial relationships between features. The proposed network architecture, termed DBSACaps, demonstrated robustness and efficiency in soft rot detection.

The experimental evaluation compared DBSACaps with several existing methods, showcasing its superior performance in terms of classification accuracy. The network was implemented using PyTorch and trained on a workstation equipped with an Intel Xeon central processing unit (CPU) and Nvidia GeForce graphics processing unit (GPU).

The study adhered to ethical guidelines regarding research involving plants and complied with relevant policies. Kiwifruits used in the study were sourced from the Chuyang orchard in Wuhan, Hubei Province, China, in accordance with regulations governing species conservation and trade.

Analyzing Kiwifruit Soft Rot Classification Results and Methodology Efficacy

The classification results of various networks on the test set were thoroughly analyzed. The proposed DBSACaps network exhibited superior performance, achieving an OA and average accuracy (AA) of 97.08% and 97.64%, respectively, surpassing other methods by notable margins. CapsuleNet and HS-CNN also demonstrated commendable performance, attributable to their robust feature extraction capabilities tailored to the dataset.

Comparative analysis revealed that the performance of dual-branch multi-attention mechanism network (DBMA), hybrid spectral convolutional neural network (HybridSN), LMFN, and spectral partitioning residual network (SPRN) varied, with LMFN showing relatively better results, possibly influenced by dataset characteristics. Interestingly, the inclusion of the spatial attention module (HPDM) in SPRN did not yield improved accuracy, contrary to expectations, possibly due to dataset differences.

Further investigations validated the effectiveness of the proposed dual-branch feature extraction. Networks exclusively utilizing spectral or spatial branches demonstrated lower accuracy compared to the DBSACaps network, indicating the significance of feature fusion in enhancing classification outcomes.

Experimentation with reconstruction networks provided insights into their role. While DBSACapsWithRec1 suffered from parameter overload, DBSACapsWithRec2, and DBSACapsWithRec3 demonstrated marginal improvements, albeit with reduced parameters. However, none surpassed the performance of DBSACaps, suggesting that reconstruction networks may not be necessary for this specific classification task.

Conclusion

In conclusion, the researchers pioneered the integration of HSI and deep learning for kiwifruit soft rot detection. The proposed DBSACaps model, featuring dual-branch classification with attention and capsule networks, outperformed existing methods, achieving 97.08% accuracy. Results underscored the efficacy of feature fusion and capsule networks for accurate classification.

Future work will focus on diversifying sample sources and optimizing spectral band selection for broader applicability. Despite challenges like data storage, this approach holds promise for revolutionizing fruit disease detection and advancing smart agriculture practices.

Journal reference:
Soham Nandi

Written by

Soham Nandi

Soham Nandi is a technical writer based in Memari, India. His academic background is in Computer Science Engineering, specializing in Artificial Intelligence and Machine learning. He has extensive experience in Data Analytics, Machine Learning, and Python. He has worked on group projects that required the implementation of Computer Vision, Image Classification, and App Development.

Citations

Please use one of the following formats to cite this article in your essay, paper or report:

  • APA

    Nandi, Soham. (2024, May 17). Advanced Kiwifruit Soft Rot Detection with Deep Learning. AZoAi. Retrieved on October 08, 2024 from https://www.azoai.com/news/20240517/Advanced-Kiwifruit-Soft-Rot-Detection-with-Deep-Learning.aspx.

  • MLA

    Nandi, Soham. "Advanced Kiwifruit Soft Rot Detection with Deep Learning". AZoAi. 08 October 2024. <https://www.azoai.com/news/20240517/Advanced-Kiwifruit-Soft-Rot-Detection-with-Deep-Learning.aspx>.

  • Chicago

    Nandi, Soham. "Advanced Kiwifruit Soft Rot Detection with Deep Learning". AZoAi. https://www.azoai.com/news/20240517/Advanced-Kiwifruit-Soft-Rot-Detection-with-Deep-Learning.aspx. (accessed October 08, 2024).

  • Harvard

    Nandi, Soham. 2024. Advanced Kiwifruit Soft Rot Detection with Deep Learning. AZoAi, viewed 08 October 2024, https://www.azoai.com/news/20240517/Advanced-Kiwifruit-Soft-Rot-Detection-with-Deep-Learning.aspx.

Comments

The opinions expressed here are the views of the writer and do not necessarily reflect the views and opinions of AZoAi.
Post a new comment
Post

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions.

You might also like...
Hybrid Deep Learning Optimizes Renewable Power Flow