William Eric Manongga 1, Rung-Ching Chen 1*, Xiaoyi Jiang 2

1 Department of Information Management, Chaoyang University of Technology, Taichung City 413310, Taiwan
2 Faculty of Mathematics and Computer Science, University of Münster Schlosspl. 2, 48149 Münster, Germany

 

Download Citation: |
Download PDF


ABSTRACT

Detecting road marking signs is a pivotal aspect of advanced driver-assisted systems (ADAS) and autonomous driving, providing crucial input for decision-making. However, the accuracy of road sign marking detection can be significantly affected by environmental factors, particularly in low-light conditions such as during night-time or within tunnels. In our research, we utilized two variants of YOLOv7, standard YOLOv7 and YOLOv7-tiny, combined with contrast enhancement techniques to enhance the detection of road marking signs, specifically focusing on low-light scenarios. Contrast-limited adaptive histogram equalization (CLAHE) and linear image fusion are employed and tested to detect road marking signs at night. The Taiwan road marking sign dataset at night (TRMSDN) is used in this research. Our evaluation results, comparing standard YOLOv7 and YOLOv7-tiny, revealed that leveraging contrast enhancement techniques can improve detection performance in low-light conditions. Our proposed method, which combines linearly fused images shows superior performance with 0.735 precision, 0.874 recall, 0.843 [email protected], and 0.798 F1-score for standard YOLOv7. YOLOv7-tiny achieves 0.782 precision, 0.843 recall, 0.850 [email protected], and 0.811 F1-score. Additionally, our experiment showcased that YOLOv7-tiny performs comparably to the standard YOLOv7 in detecting road marking signs, making it a viable option for deployment in edge devices. The limitation of the study is the usage of a constant weight during linear fusion and the limited number of images and classes in the dataset. Further research will try to address the limitation by investigating an adaptive weight value and increasing the number of data in the dataset.


Keywords: CLAHE, Contrast enhancement, Object detection, Road sign marking, YOLOv7.


Share this article with your colleagues

 


REFERENCES

  1. Abdusalomov, A.B., Mukhiddinov, M., Whangbo, T.K. 2023. Brain tumor detection based on deep learning approaches and magnetic resonance imaging. Cancers, 15(16), 4172.

  2. Aşantoğrol, F., Çiftçi, B.T. 2023. Analytical comparison of maxillary sinus segmentation performance in panoramic radiographs utilizing various yolo versions. European Journal of Therapeutics, 29(4), 748–758.

  3. Babu, V.S., Ram, N.V. 2022. Deep Residual CNN with Contrast limited adaptive histogram equalization for weed detection in soybean crops. Traitement Du Signal, 39(2), 717–722.

  4. Benradi, H., Chater, A., Lasfar, A. 2022. Detection of COVID-19 from chest radiology using histogram equalization combined with a CNN convolutional network. ITM Web of Conferences, 46, 05001.

  5. Cai, L., Liang, J., Xu, X., Duan, J., Yang, Z. 2023. Banana Pseudostem Visual detection method based on improved YOLOV7 detection algorithm. Agronomy, 13(4), 999.

  6. Chen, R.-C., Dewi, C., Zhuang, Y.-C., Chen, J.-K. 2023. Contrast limited adaptive histogram equalization for recognizing road marking at night based on yolo models. IEEE Access, 11, 92926–92942.

  7. Chen, R.-C., Saravanarajan, V. S., Hung, H.-T. 2021. Monitoring the behaviours of pet cat based on YOLO model and raspberry Pi. International Journal of Applied Science and Engineering, 18(5), 1–12.

  8. Dewi, C., Chen, R.-C., Zhuang, Y.-C., Christanto, H. J. 2022. Yolov5 series algorithm for road marking sign identification. Big Data Cognitive Computing, 6(4),149.

  9. Dewi, C., Chen, R.-C., Zhuang, Y.-C., Manongga, W. E. 2023. Contrast stretching for automatic road marking detection at night with YOLOv5. In 2023 12th International Conference on Awareness Science and Technology (iCAST), 100–105.

  10. Ding, D., Yoo, J., Jung, J., Jin, S., Kwon, S. 2015. Efficient Road-sign detection based on machine learning. Bulletin of Networking, Computing, Systems, and Software, 4(1), 15–17.

  11. Ding, X., Zhang, X., Ma, N., Han, J., Ding, G., Sun, J. 2021. RepVgg: Making VGG-style convnets great again. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 13728–13737.

  12. Foucher, P., Sebsadji, Y., Tarel, J.-P., Charbonnier, P., Nicolle, P. 2011. Detection and recognition of urban road markings using images. In 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC), 1747–1752.

  13. Gonzales, R.C., Woods, R.E. 2018. Digital image processing, fourth edition. Pearson Education, Inc.

  14. Greenhalgh, J., Mirmehdi, M. 2015. Detection and recognition of painted road surface markings. In ICPRAM 2015 - 4th International Conference on Pattern Recognition Applications and Methods, Proceedings (Vol. 1),130–138.

  15. Gupta, A., Choudhary, A. 2018. A framework for camera-based real-time lane and road surface marking detection and recognition. IEEE Transactions on Intelligent Vehicles, 3(4), 476–485.

  16. Hoang, T.M., Nam, S.H., Park, K.R. 2019. Enhanced detection and recognition of road markings based on adaptive region of interest and deep learning. IEEE Access, 7, 109817–109832.

  17. Hsieh, C.H., Chen, B.C., Lin, C.M., Zhao, Q. 2010. Detail aware contrast enhancement with linear image fusion. In 2010 2nd International Symposium on Aware Computing, ISAC 2010 - Symposium Guide, 1–5.

  18. Kaya, Ö., Çodur, M.Y., Mustafaraj, E. 2023. Automatic detection of pedestrian crosswalk with faster R-CNN and YOLOv7. Buildings, 13(4), 1070.

  19. Lee, S., Kim, J., Yoon, J.S., Shin, S., Bailo, O., Kim, N., Kweon, I.S. 2017. VPGNet: Vanishing point guided network for lane and road marking detection and recognition. In Proceedings of the IEEE International Conference on Computer Vision, 1965–1973.

  20. Li, S., Wang, S., Wang, P. 2023. A small object detection algorithm for traffic signs based on improved YOLOv7. Sensors, 23(16), 7145.

  21. Manongga, W.E., Hsieh, C.H., Chen, R.C., Cheng, C.H. 2023. Optimal contrast enhancement with linear image fusion and patch-based contrast quality index. In 2023 International Conference on Consumer Electronics - Taiwan, ICCE-Taiwan 2023 - Proceedings, 787–788.

  22. Nneji, G.U., Cai, J., Deng, J., Monday, H.N., James, E.C., Ukwuoma, C.C. 2022. Multi-channel based image processing scheme for pneumonia identification. Diagnostics, 12(2), 325.

  23. Pathak, S.P., Patil, S.A. 2023. Evaluation of effect of pre-processing techniques in solar panel fault detection. IEEE Access, 11, 72848–72860.

  24. Pizer, S.M., Amburn, E.P., Austin, J.D., Cromartie, R., Geselowitz, A., Greer, T., Zuiderveld, K. 1987. Adaptive histogram equalization and its variations. Computer Vision, Graphics, and Image Processing, 39(3), 355–368.

  25. Ramamoorthy, M., Qamar, S., Manikandan, R., Jhanjhi, N.Z., Masud, M., Alzain, M.A. 2022. Earlier detection of brain tumor by pre-processing based on histogram equalization with neural network. Healthcare (Switzerland), 10(7), 1218.

  26. Sari, F., Ulas, A.B. 2022. Deep learning application in detecting glass defects with color space conversion and adaptive histogram equalization. Traitement Du Signal, 39(2), 731–736.

  27. Srinivasan, S., Raju, A.B.K., Mathivanan, S.K., Jayagopal, P., Babu, J.C., Sahu, A.K. 2023. Local-Ternary-pattern-based associated histogram equalization technique for cervical cancer detection. Diagnostics, 13(3), 548.

  28. Sun, K. X., Cong, C. 2022. Research on chest abnormality detection based on improved YOLOv7 algorithm. In Proceedings - 2022 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2022, pp. 3884–3886.

  29. Tang, F., Yang, F., Tian, X. 2023. Long-distance person detection based on YOLOv7. Electronics, 12(6), 1502.

  30. Tian, J., Yuan, J., Liu, H. 2020. Road marking detection based on MASK R-CNN instance segmentation model. In Proceedings - 2020 International Conference on Computer Vision, Image and Deep Learning (CVIDL), 246–249.

  31. Wang, C.Y., Bochkovskiy, A., Liao, H.Y. M. 2023. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors, 7464–7475.

  32. Wu, D., Jiang, S., Zhao, E., Liu, Y., Zhu, H., Wang, W., Wang, R. 2022. Detection of Camellia oleifera fruit in complex scenes by using YOLOv7 and data augmentation. Applied Sciences, 12(22), 11318.

  33. Zamani, A.S., Anand, L., Rane, K.P., Prabhu, P., Buttar, A.M., Pallathadka, H., Raghuvanshi, A., Dugbakie, B.N. 2022. Performance of machine learning and image processing in plant leaf disease detection. Journal of Food Quality, 2022, 1598796.


ARTICLE INFORMATION

Received: 2023-12-21
Revised: 2024-02-20
Accepted: 2024-03-19


Cite this article:

Manongga, W.E., Chen, R.C., Jiang, X.Y. 2024. Enhancing road marking sign detection in low-light conditions with YOLOv7 and contrast enhancement techniques. International Journal of Applied Science and Engineering, 21, 2023515. https://doi.org/10.6703/IJASE.202406_21(3).001

  Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.

Other people also read ...