International Journal of

Automation and Smart Technology

Asha Bharathi S1* and Ravi Kumar M S1

 

1 KVG College of Engineering, Sullia, Karnataka, India

Download Citation: |
Download PDF


ABSTRACT

Crack detection has always been a dominant requirement for steel industries to ensure quality production and seamless infrastructure maintenance. However, application complexities and defect morphological differences make existing approaches confined. Steel-strip surface often undergoes scratch, crack and fatigue conditions during production. Manual crack detection schemes are no longer effective in current day complex environment. Amongst major steel strip crack detection approaches vision based techniques have been found potential. Filamentous crack which is caused due to fatigue or strain is fine-grained and thin and hence highly difficult to be detected by classical morphology and static threshold based schemes. In the present work steel strip surface crack(filamentous) detection system is developed which employs Varying-Morphological Segmentation (VMS) also called Neuron-Model Segmentation (NMS) in conjunction with local directive filtering and active contour propagation. The proposed method can be stated as an augmented variational framework that employs multi-directional filters for local crack-region identification followed by automated multi-directional region growing and iterative contour evolution which performs level set energy minimization to achieve accurate crack detection even under topological non-linearity and varying illumination conditions .Simulation results with standard benchmark data has confirmed that the proposed method exhibits satisfactory performance for steel strip surface cracks.


Keywords: Active Contour Propagation; Automatic Steel Strip Crack Detection; Level Set Concept; Neuron-Model Segmentation; Region Growing.


Share this article with your colleagues

 


REFERENCES

  1.  [1] Y. Liu, Y. Hsu, Y. Sun, S. sai, C. Ho, and C. Chen, "A Computer Vision System for Automatic Steel Surface Inspection," in proceeding of 2010 5th IEEE Conference on Industrial Electronics and Applications, Taichung, June 15-17, 2010, pp. 1667-1670. https://doi.org/10.1109/ICIEA.2010.5515197

  2. [2] C. K. Okolo and T. Meydan, "Axial magnetic field sensing for pulsed magnetic flux leakage hairline crack detection and quantification," 2017 IEEE SENSORS, vol. 2017, pp. 1-3, 2017. https://doi.org/10.1109/ICSENS.2017.8233983

  3. [3] K. Tsukada, Y. Majima, Y. Nakamura, T. Yasugi, K. Sakai, N. Song, and T. Kiwa, "Detection of Inner Cracks in Thick Steel Plates Using Unsaturated AC Magnetic Flux Leakage Testing With a Magnetic Resistance Gradiometer," in proceeding of 2017 IEEE International Magnetics Conference (INTERMAG), Dublin, April 24-28, 2017. https://doi.org/10.1109/INTMAG.2017.8007857

  4. [4] K. Slobodnik and P. Karban, "Subsurface cracks evaluation using pulsed eddy current and cross correlation," in proceeding of 2018 ELEKTRO, Mikulov, May 21-23, 2018, pp. 1-4. https://doi.org/10.1109/ELEKTRO.2018.8398347

  5. [5] M. Sharifzadeh, S. Alirezaee, R. Amirfattahi, and S. Sadri, "Detection of Steel Defect Using the Image Processing Algorithms," in proceeding of 2008 IEEE International Multitopic Conference, Karachi, Dec 23-24, 2008, pp. 125-127. https://doi.org/10.1109/INMIC.2008.4777721

  6. [6] N. Neogi, D. K. Mohanta, and P. K. Dutta, "Review of vision-based steel surface inspection systems," J. Comput. High. Educ, vol. 2014, no. 1, 2014. https://doi.org/10.1186/1687-5281-2014-50

  7. [7] J. H. Guo, X. D. Meng, and M. D. Xiong, "Study on defection segmentation for steel surface image based on image edge detection and fisher discriminant," Journal of Physics Conference Series, vol. 48, no. 1, pp. 364-368, 2006. https://doi.org/10.1088/1742-6596/48/1/068

  8. [8] B. Suvdaa, J. Ahn, and J. Ko, "Steel Surface defects detection and classification using SIFT and voting strategy," Int. J. Softw. Eng. its Appl, vol. 6, no. 2, pp. 161-166, 2012. https://www.researchgate.net/publication/293134660_Steel_surface_defects_detection_and_classification_using_SIFT_and_voting_strategy

  9. [9] T. Maenpaa, "Surface Quality Assessment with Advanced Texture Analysis Techniques," in proceeding of International Surface Inspection Summit, Luxembourg, Jan, 2006, pp. 1-7. https://www.researchgate.net/publication/228748242_Surface_quality_assessment_with_advanced_texture_analysis_techniques

  10. [10] J. M. Blackledge, and D. A. Dubovitskiy, "A surface inspection machine vision system that includes fractal texture analysis," Int. Soc. Adv. Sci. Technol. J. Intell. Syst, vol. 3, no. 2, pp. 76-89, 2008. https://doi.org/10.21427/D7QS5J

  11. [11] Y. Shui-shan, H. E. Yong-hui, W. Zhen-long, and Z. Wan-sheng, "A Method of Steel Strip Image Segmentation Based on Local Gray Information," in proceeding of 2008 IEEE International Conference on Industrial Technology, Chengdu, April 21-24, 2008, pp. 1-4. https://doi.org/10.1109/ICIT.2008.4608646

  12. [12] W. C. Li, C. H. Lu, J. C. Zhang, "A local annular contrast based real time inspection algorithm for steel bar surface defects," Applied Surface Science, vol. 258, no. 16, pp. 6080-6086, 2012. https://doi.org/10.1016/j.apsusc.2012.03.007

  13. [13] D. K. H. Singhka, N. Neogi, and D. Mohanta, "Surface defect classification of steel strip based on machine vision," in proceeding of International Conference on Computing and Communication Technologies, Hyderabad, Dec 11-13, 2014, pp. 1-5. https://doi.org/10.1109/ICCCT2.2014.7066698

  14. [14] M. Hao, C. Lu, G. Wang, and W. Wang, "An Improved Neuron Segmentation Model for Crack Detection -Image Segmentation Model," Cybernetics and Information Technologies, vol. 17, no. 2, pp. 119-133, 2017. https://doi.org/10.1515/cait-2017-0021

  15. [15] S. Mukherjee, B. Condron and S. T. Acton, "Tubularity Flow Field-A Technique for Automatic Neuron Segmentation," IEEE Trans. Image Process, vol. 24, no. 1, pp. 374-389, 2015. https://doi.org/10.1109/TIP.2014.2378052

  16. [16] Y. Jeon, J. P. Yun, D. Choi, and S. W. Kim, "Defect Detection Algorithm for Corner Cracks in Steel Billet using Discrete Wavelet Transform," in proceeding of ICROS-SICE International Joint Conference, Fukuoka, Aug 18-21, 2009, pp. 2769-2773. https://ieeexplore.ieee.org/document/5333909

  17. [17] W. Xiu-yong, X. Ke,and X Jin-wu, "Application of Undecimated Wavelet Transform to Surface Defect Detection of Hot Rolled Steel Plates," in proceeding of IEEE Congress on Image and Signal Processing, Sanya, May 27-30, 2008, pp. 528-532. https://doi.org/10.1109/CISP.2008.278

  18. [18] T. Yamaguchi and S. Hashimoto, "Fast Crack Detection Method for Large-Size Concrete Surface Images Using Percolation-Based Image Processing," Machine Vision and Applications, vol. 21, no. 5, pp. 797-809, 2010. https://doi.org/10.1007/s00138-009-0189-8

  19. [19] M. König, A. Rashidi, S. G. Paal, I. Brilakis, C. Koch, and Z. Zhu, "Achievements and Challenges in Machine Vision-Based Inspection of Large Concrete Structures," Advances in Structural Engineering, vol. 17, no. 3, pp. 303-318, 2014. https://doi.org/10.1260/1369-4332.17.3.303

  20. [20] X. Xie, "A review of recent advances in surface defect detection using texture analysis techniques," ELCVIA Electronic Letters on Computer Vision and Image Analysis, vol. 7, no. 3, pp. 1-22, 2008. https://doi.org/10.5565/rev/elcvia.268

  21. [21] S. K. Sinha and P. W. Fieguth, "Automated Detection of Cracks in Buried Concrete Pipe Images," Automation in Construction, vol. 15, no. 1, pp. 58-72, 2006. https://doi.org/10.1016/j.autcon.2005.02.006

  22. [22] S. K. Sinha and P. W. Fieguth, "Morphological Segmentation and Classification of Underground Pipe Images," Machine Vision and Applications, vol. 17, no. 1, pp. 21-31, 2006. https://doi.org/10.1007/s00138-005-0012-0

  23. [23] J. Masci, U. Meier, D. Ciresan, J. Schmidhuber, and G. Fricout, "Steel Defect Classification with Max-Pooling Convolutional Neural Networks," in proceeding of The 2012 International Joint Conference on Neural Networks (IJCNN), Brisbane, June 10-15, 2012, pp. 1-6. https://doi.org/10.1109/IJCNN.2012.6252468

  24. [24] K.Agarwal, R.Shivpuri, Y.Zhu, T.Chang, and H.Huang, "Process knowledge based multi-class support vector classification (PK-MSVM) approach for surface defects in hot rolling," ELSEVIER, Expert Systems with Applications, vol. 38, no. 6, pp. 7251-7262, 2011. https://doi.org/10.1016/j.eswa.2010.12.026

  25. [25] L. Weiwei, Y. Yunhui, L Jun, Z. Yao, and S .Hongwei, "Automated On-Line Fast Detection for Surface Defect of Steel Strip Based on Multivariate Discriminant Function," in proceeding of 2008 Second International Symposium on Intelligent Information Technology Application, Shanghai, Dec 20-22, 2008, pp. 493-497. https://doi.org/10.1109/IITA.2008.67

  26. [26] A. Cord, F. Bach, and D. Jeulin, "Texture classification by statistical learning from morphological image processing: application to metallic surfaces," J. Microsc, vol. 239, no. 2, pp. 159-166, 2010. https://doi.org/10.1111/j.1365-2818.2010.03365.x

  27. [27] B. Suvdaa, J. Ahn, and J. Ko, "Surface defects detection and classification using SIFT and voting strategy," International Journal of Software Engineering and Its Applications, vol. 6, no. 2, pp. 161-166, 2012. https://www.researchgate.net/publication/293134660_Steel_surface_defects_detection_and_classification_using_SIFT_and_voting_strategy

  28. [28] Y. Fujita and Y. Hamamoto, "A Robust Automatic Crack Detection Method from Noisy Concrete Surfaces," Machine Vision & Applications, vol. 22, no. 2, pp. 245-254, 2011. https://doi.org/10.1007/s00138-009-0244-5

  29. [29] I. Abdel-Qader, O. Abudayyeh, and M. E. Kelly, "Analysis of Edge-Detection Techniques for Crack Identification in Bridges," Journal of Computing in Civil Engineering, vol. 17, no. 4, pp. 255-263, 2014. https://doi.org/10.1061/(ASCE)0887-3801(2003)17:4(255)

  30. [30] S. Chambon, K. S. Niel, D. Fofi, P. Subirats, and J. Dumoulin, "Introduction of a Wavelet Transform Based on 2D Matched Filter in a Markov Random Field for Fine Structure Extraction," Image Processing Machine Vision Applications II, vol. 7251, p. 72510A, 2009. https://doi.org/10.1117/12.805437

  31. [31] H. Jia, Y. L. Murphey, J. Shi, and T. S. Chang, "An Intelligent Real-time Vision System for Surface Defect Detection," in proceeding of IEEE 17th International Conference on Pattern Recognition,2004, Cambridge, Aug 26-26, 2004, pp. 2-5. https://doi.org/10.1109/ICPR.2004.1334512

  32. [32] P. Prasanna, K. Dana, N. Gucunski, and B. Basily, "Computer-Vision Based Crack Detection and Analysis," Sensors & Smart Structures Technologies for Civil Mechanical & Aerospace Systems, vol. 8345, pp. 834542, 2012. https://doi.org/10.1117/12.915384

  33. [33] Q. Li, Q. Zou, D. Zhang, and Q. Mao, "F* Seed-Growing Approach for Crack-Line Detection from Pavement Images," Image & Vision Computing, vol. 29, no. 12, pp. 861-872, 2011. https://doi.org/10.1016/j.imavis.2011.10.003

  34. [34] C. Gunkel, A. Stepper, A. C. Müller, and C. H. Müller, "Micro Crack Detection with Dijkstra's Shortest Path Algorithm," Machine Vision & Applications, vol. 23, no. 3, pp. 589-601, 2012. https://doi.org/10.1007/s00138-011-0324-1

  35. [35] V. Kaul, A. Yezzi, and Y. J. Tsai, "Detecting Curves with Unknown Endpoints and Arbitrary Topology Using Minimal Paths,"IEEE Transactions on Software Engineering, vol.36, no. 3, pp. 1952-1965, 2012. https://doi.org/10.1109/TPAMI.2011.267

  36. [36] Y. Tsai, V. Kaul, and A. Yezzi, "Automating the Crack Map Detection Process for Machine Operated Crack Sealer," Automation in Construction, vol. 31, no.3, pp. 10-18, 2013. https://doi.org/10.1016/j.autcon.2012.11.033

  37. [37] G. Zhao, T. Wang, and J. Ye , "Surface Shape Recognition Method for Crack Detection," Journal of Electronic Imaging, vol. 23, no. 3, pp. 6-8, 2014. https://doi.org/10.1117/1.JEI.23.3.033013

  38. [38] Y. Wang, B. Gao, W. l. Woo, G. Tian, X. Maldague, L. Zheng, Z. Guo, Y. Zhu, "Thermal Pattern Contrast Diagnostic of Micro Cracks with Induction Thermography for Aircraft Braking Components," IEEE Transactions on Industrial Informatics, vol. 14, no. 12, pp. 5563-5574, 2018. https://doi.org/10.1109/TII.2018.2802046

  39. [39] G. Kim, S. Choi, J. Bae, and J. Kim, "Inner defect detection for a thin steel strip," in proceeding of International Conference on Control, Automation and Systems, Seoul, Oct 14-17, 2008, pp. 1957-1960. https://doi.org/10.1109/ICCAS.2008.4694418

  40. [40] L. Wang, K. Xu, and P. Zhou, "Online Detection Technique of 3D Defects for Steel Strips Based on Photometric Stereo," in proceeding of 8th International Conference on Measuring Technology and Mechatronics Automation (ICMTMA), Macau, March 11-12, 2016, pp. 428-432. https://doi.org/10.1109/ICMTMA.2016.10

  41. [41] S. Wang, X. Liu, T. Yang, and X. Wu, "Panoramic Crack Detection for Steel Beam Based on Structured Random Forests," IEEE Access, vol. 6, pp. 16432-16444, 2018. https://doi.org/10.1109/ACCESS.2018.2812141

  42. [42] A. Bouchalkha, M. S. Hamad, K. Al-Beloushi, M. Al-Qayedi, and K. Al-Hammadi, "Design of an oil pipe inner surface inspection system," in proceeding of IEEE GCC Conference and Exhibition (GCC), Dubai, Feb 19-22, 2011, pp. 29-32. https://doi.org/10.1109/IEEEGCC.2011.5752533

  43. [43] M. Demant, T. Welschehold, M. Oswald, S. Bartsch, T. Brox, S. Schoenfelder, and S. Rein, "Microcracks in Silicon Wafers I: Inline Detection and Implications of Crack Morphology on Wafer Strength," IEEE Journal of Photovoltaics, vol. 6, no. 1, pp. 126-135, 2016. https://doi.org/10.1109/JPHOTOV.2015.2494692

  44. [44] C. Y. Hsu, B. S. Ho, L. W. Kang, M. F. Weng, and C. Y. Lin, "Fast vision-based surface inspection of defects for steel billets," in proceeding of IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), Seoul, Oct 26-28, 2016, pp. 1-2. https://doi.org/10.1109/ICCE-Asia.2016.7804804

  45. [45] P. Huynh, R. Ross, A. Martchenko, and J. Devlin, "Dou-edge evaluation algorithm for automatic thin crack detection in pipelines," in proceeding of IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuala Lumpur, Oct 19-21, 2015, pp. 191-196. https://doi.org/10.1109/ICSIPA.2015.7412188

  46. [46] P. Wang and H. Huang, "Comparison analysis on present image-based crack detection methods in concrete structures," in proceeding of 3rd International Congress on Image and Signal Processing, Yantai, Oct 16-18, 2010, vol.5, pp. 2530-2533. https://doi.org/10.1109/CISP.2010.5647496

  47. [47] M. A. Negley and D. C. Jiles, "Imaging surface conditions of ferromagnetic steel using Barkhausen technique," IEEE Transactions on Magnetics, vol. 30, no. 6, pp. 4509-4511, 1994. https://doi.org/10.1109/20.334132

  48. [48] R. Marik and L. Bohac, "Linear watershed algorithm for 1D real signals," in proceeding of 4th International Conference on Systems and Informatics (ICSAI), Hangzhou, Nov 11-13, 2017, pp. 1103-1108. https://doi.org/10.1109/ICSAI.2017.8248450

  49. [49] A. Elyounsi, H. Tlijani and M. S. Bouhlel, "Combining top-hat, thresholding and watershed transformation for 3D Inverse Synthetic Aperture Radar Images segmentation," in proceeding of 7th International Conference on Sciences of Electronics, Technologies of Information and Telecommunications (SETIT), Hammamet, Dec 18-20, 2016, pp. 466-471. https://doi.org/10.1109/SETIT.2016.7939915

  50. [50] K. Wang and J. C. Trinder, "Applied Watershed Segmentation Algorithm for Water Body Extraction in Airborne SAR Image," in proceeding of 10th European Conference on Synthetic Aperture Radar, Berlin, June 3-5, 2014, pp. 1-4. https://ieeexplore.ieee.org/document/6856864

  51. [51] Q. Gu, J. Chen, T. Aoyama, and I. Ishii, "An efficient watershed algorithm for pre-processed binary image," in proceeding of IEEE International Conference on Information and Automation (ICIA), Ningbo, Aug 1-3, 2016, pp. 1781-1786. https://doi.org/10.1109/ICInfA.2016.7832106

  52. [52] V. Machairas, E. Decencière, and T. Walter, "Waterpixels: Superpixels based on the watershed transformation," in proceeding of IEEE International Conference on Image Processing (ICIP), Paris, Oct 27-30, 2014, pp. 4343-4347. https://doi.org/10.1109/ICIP.2014.7025882

  53. [53] L. Yuan, Q. Yu, C. Shen, W. Hu, and Y. Zhitong, "New watershed segmentation algorithm based on hybrid gradient and self-adaptive marker extraction," in proceeding of 2nd IEEE International Conference on Computer and Communications (ICCC), Chengdu, Oct 14-17, 2016, pp. 624-628. https://doi.org/10.1109/CompComm.2016.7924776

  54. [54] Q. Chen, "Hierarchical segmentation for color images," in proceeding of 8th International Congress on Image and Signal Processing (CISP), Shenyang, Oct 14-16, 2015, pp. 934-938. https://doi.org/10.1109/CISP.2015.7408012

  55. [55] F. C. Chen and M. R. Jahanshahi, "NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion," IEEE Transactions on Industrial Electronics, vol. 65, no. 5, pp. 4392-4400, 2018. https://doi.org/10.1109/TIE.2017.2764844

  56. [56] A. Landstrom and M. J. Thurley, "Morphology-Based Crack Detection for Steel Slabs," IEEE Journal of Selected Topics in Signal Processing, vol. 6, no. 7, pp. 866-875, 2012. https://doi.org/10.1109/JSTSP.2012.2212416

  57. [57] X. Liu, Y. Ai, and S. Scherer, "Robust image-based crack detection in concrete structure using multi-scale enhancement and visual features," in proceeding of IEEE International Conference on Image Processing (ICIP), Beijing, Sept 17-20, 2017, pp. 2304-2308. https://doi.org/10.1109/ICIP.2017.8296693

  58. [58] Y. Noh, D. Koo, Y. Kang, D. Park, and D. Lee, "Automatic crack detection on concrete images using segmentation via fuzzy C-means clustering," in proceeding of International Conference on Applied System Innovation (ICASI), Sapporo, May 13-17, 2017, pp. 877-880. https://doi.org/10.1109/ICASI.2017.7988574

  59. [59] M. Jacob and M. Unser, "Design of Steerable Filters for Feature Detection Using Canny-Like Criteria," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 8, pp. 1007-1019, 2004. https://doi.org/10.1109/TPAMI.2004.44

  60. [60] O. Stanley and J. A. Sethian ,"Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Halmiton-Jacobi Formulations," Journal of Computational Physics, vol. 79, no. 1, pp. 12-49, 1988. https://doi.org/10.1016/0021-9991(88)90002-2

  61. [61] H. K. Zhao, T. Chan, B. Merriman, and S. Osher, "A Variational Level Set Approach to Multiphase Motion," Journal of Computational Physics, vol. 127, no. 1, pp. 179-195,1996. https://doi.org/10.1006/jcph.1996.0167

  62. [62] R. L. Graham and F. F. Yao, "Finding the convex hull of a simple polygon," Journal of Algorithms, vol. 4, no. 4, pp. 324-331, 1983. https://doi.org/10.1016/0196-6774(83)90013-5

  63. [63] B. Li and S. T. Acton, "Active contour external force using vector field convolution for image segmentation," IEEE Trans. Image Processing, vol. 16, no. 8, pp. 2096-2106, 2007. https://doi.org/10.1109/TIP.2007.899601

  64. [64] N. Otsu, "A threshold selection method from gray-level histograms," IEEE Transactions on Systems Man and Cybernetics, vol. 9, no. 1, pp. 62-66, 1979. https://doi.org/10.1109/TSMC.1979.4310076

  65. [65] http://faculty.neu.edu.cn/yunhyan/NEU_surface_defect_database.html


ARTICLE INFORMATION

Received: 2019-04-05

Accepted: 2019-07-13
Available Online: 2020-06-01


Cite this article:

Bharathi. S.A. and Ravi Kumar. M.S (2020) Highly Robust and Automated Vision based Filamentous Steel Strip CrackHighly Robust and Automated Vision based Filamentous Steel Strip CrackDetection System. Int. j. autom. smart technol. https://doi.org/10.5875/ausmt.v10i1.2149

  Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Other people also read...

 

1.5
2022CiteScore
 
 
22nd percentile
Powered by  Scopus
 
 

AUSMT - Most Read Articles

AUSMT - Most popular articles