International Journal of Applied Science and Engineering
Published by Chaoyang University of Technology

Megha Trivedi1, Abhishek Gupta2*

1 School of Electronics & Communication Engineering, Shri Mata Vaishno Devi University, Katra, Jammu and Kashmir, India
2 School of Computer Science & Engineering, Shri Mata Vaishno Devi University, Katra, Jammu and Kashmir, India


 

Download Citation: |
Download PDF


ABSTRACT


Plants are a source of food, medicines, fiber, fuel, etc. and are therefore crucial for our survival. Due to this, intensive care of plants should be done and it requires monitoring of their growth, size, yield, etc. However, manually monitoring such factors is often time-consuming and necessitates one to have in-depth knowledge of agriculture and plants. Thus, automatic systems for plant image analysis would be beneficial for practical and productive agriculture. Therefore, an automatic method is proposed for monitoring the growth of plants by first performing the segmentation of leaves in plant images and then calculating the segmented area. A deep learning-based architecture “U-Net” was used for the segmentation task. A benchmark dataset of 810 images was used to train and test the proposed deep learning network. The proposed model was trained within 3 hours and achieved a dice accuracy of 94.91% on the training set, 94.93% on the validation set, and 95.05% on the testing set. The proposed architecture was found very lightweight with fewer computations but achieved promising results as compared to other methods in the literature.


Keywords: Leaf segmentation, Deep learning, U-Net, Plant monitoring, Computer vision.


Share this article with your colleagues

 


REFERENCES


  1. Barbedo, J.G.A 2016. A novel algorithm for semi-automatic segmentation of plant leaf disease symptoms using digital image processing, Tropical plant pathology, 41, 210–224.

  2. Bell, J., Dee, H. 2016. Aberystwyth leaf evaluation dataset: A plant growth visible light image dataset of Arabidopsis thaliana. Zenodo.

  3. Chen, J., Pappas, T.N., Mojsilovic, A., Rogowitz, B. 2002. Adaptive image segmentation based on color and texture. In Proceedings. International Conference on Image Processing, 3, 777–780. IEEE.

  4. Cumulative distribution function. ScienceDirect. Available: https://www.sciencedirect.com/topics/mathematics/cumulative-distribution-function. [Accessed 8th August, 2020].

  5. Gabbiani, F., Cox, S. 2010. Mathematics for neuroscientists. Amsterdam: Elsevier/Academic Press.

  6. Gupta, A., Prakash, D. 2020. A fast and efficient color model for automatic monitoring of plants based on leaf images. Journal of Critical Reviews, 7, 2398–2404.

  7. Kingma, D.P., Ba, J. 2014. Adam: A method for stochastic optimization. arXiv:1412.6980.

  8. Kızrak, A. 2020. Deep learning for image segmentation: U-Net architecture. Heartbeat. Available: https://heartbeat.fritz.ai/deep-learning-for-image-segmentation-u-net-architecture-ff17f6e4c1cf. [Accessed 8th August, 2020].

  9. Kumar, J.P., Domnic, S. 2019. Image based leaf segmentation and counting in rosette plants. Information Processing in Agriculture, 6, 233–246.

  10. Kumar, N., Biswas, A., Jacobs, D.W., Kress, W.J., Lopez, I., Soares, J.V.B. 2012. Leafsnap: A computer vision system for automatic plant species identification. Presented at the in The 12th European Conference on Computer Vision (ECCV).

  11. MA, J., Fan, X., Yang, S.X., Zhang, X., Zhu, X. 2017. Contrast limited adaptive histogram equalization based fusion for underwater image enhancement. Preprints, 2017030086 (doi: 10.20944/preprints201703. 0086.v1).

  12. Magudeeswaran, V., Singh, J.F. 2017. Contrast limited fuzzy adaptive histogram equalization for enhancement of brain images. International Journal of Imaging Systems and Technology. 27, 98–103.

  13. Minervini, M., Abdelsamea, M.M., Tsaftaris, S.A. 2013. Image-based plant phenotyping with incremental learning and active contours. Ecological Informatics, 23, 35–48.

  14. Minervini, M., Fischbach, A., Scharr, H., Tsaftaris, S.A. 2015. Finely-grained annotated datasets for image-based plant phenotyping. Pattern Recognition Letters, 1–10.

  15. Minervini, M., Scharr, H., Fischbach, A., Tsaftaris, S.A. 2014. Annotated image datasets of rosette plants. Technical Report No. FZJ-2014-03837, Forschungszentrum Jülich, GmbH, Jülich, Germany.

  16. Nielsen, M. 2020. Neural networks and deep learning. [online] Neuralnetworksanddeeplearning.com. Available at: http://neuralnetworksanddeeplearning.com/chap3. html [Accessed 3 March 2020].

  17. Ozturk, S., Akdemir, B. 2017. Automatic leaf segmentation using grey wolf optimizer based neural network. Electronics, 1–6.

  18. Plant-phenotyping.org. 2020. Plant phenotyping datasets. [online] Available at: https://www.plant-phenotyping.org/datasets-home [Accessed 31 July 2020].

  19. Ronneberger, O., Fischer, P., Brox, T. 2015. U-Net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention, 234–241. Springer, Cham.

  20. Scharr, H., Minervini, M., French, A.P., Klukas, C., Kramer, D.M., Liu, X.M. et al. 2016. Leaf segmentation in plant phenotyping: a collation study. Machine Visions and Applications 27, 585–606.

  21. Scikit-image.org. 2020. Module: exposure — skimage v0.19.0.dev0 docs. [online] Available at: https://scikit-image.org/docs/dev/api/skimage.exposure [Accessed 8 August 2020].

  22. Sharma, S., Gupta, A. 2020. A review for the automatic methods of plant’s leaf image segmentation. International Journal of Intelligence and Sustainable Computing 1, 101–114.

  23. TensorFlow. 2020. tf.keras.activations.sigmoid  TensorFlow Core v2.4.1. [online] Available at: https://www.tensorflow.org/api_docs/python/tf/keras/activations/sigmoid [Accessed 9 August 2020].

  24. Yin, X., Liu, X., Chen, J., Kramer, D.M. 2018. Joint multi-leaf segmentation, Alignment, and Tracking for Fluorescence Plant Videos. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40, 1411–1423.


ARTICLE INFORMATION


Received: 2020-11-02

Accepted: 2020-12-02
Available Online: 2021-06-01


Cite this article:

Trivedi, M., Gupta, A. 2021. Automatic monitoring of the growth of plants using deep learning-based leaf segmentation, International Journal of Applied Science and Engineering, 18, 2020281. https://doi.org/10.6703/IJASE.202106_18(2).003

  Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.