Automatic license plate recognition system based on morphological operations and vertical histogram image processing

Document Type : Original Article

Authors

1 Department of Electrical Engineering, Faculty of Engineering, Yasouj University, Yasouj, Iran

2 Department of Communications and Electronic Engineering,, Faculty of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran

Abstract

Nowadays, the automatic license plate recognition system has become increasingly important due to its diverse range of applications. Generally, this system consists of four basic stages, including capturing an image of the vehicle, finding the location of the plate or extracting the plate from the image, separating characters from the plate, and recognizing the characters. In this paper, a set of morphological operations and vertical histogram image processing is presented to improve the accuracy of license plate recognition. In fact, the set of morphological operations is used to determine candidate plate locations, while vertical histogram image processing is used to eliminate false candidate locations. The results of simulations on color and infrared image databases demonstrate that the proposed algorithm is competitive with other methods.

Keywords


[1] Ashtari A. H., Nordin Md. J., and Fathy M., “An Iranian license plate recognition system based on color features,” IEEE Transactions on intelligent transportation systems, 15(4): 1690-1705, 2014.
[2] Yousif B. B., Ata M. M., Fawzy N., and Obaya M., “Toward an optimized neutrosophic K-means with genetic algorithm for automatic vehicle license plate recognition (ONKM-AVLPR),” IEEE Access, 8: 49285–49312, 2020.
[3] Zheng D., Zhao Y., and Wang J., “An efficient method of license plate location,” Pattern Recognition Letters, 26(15): 2431-2438, 2005.
[4] Duan T. D., Tran D., Tran V. P., and Hoang N. V., “Building an automatic vehicle license plate recognition system,” In international conference in computer science - RIVF, Cantho, Vietnam, pp. 59-63. 2005.
[5] مهدوی‌نسب ه.، معمارزاده م. ص.، معلم پ.، «تشخیص اتوماتیک پلاک خودرو فارسی به کمک روش‌های پردازش تصویر و شبکه‌های عصبی»، نشریه پژوهش در فناوری برق، جلد 1، شماره 3، ص.41-48، 1388.
[6] ذوقی م.، اسماعیلی م.، «تشخیص پویای پلاک خودرو مبتنی بر مورفولوژی برای تصاویر رنگی و مادون قرمز»، مجله محاسبات نرم، جلد 6، شماره 1، ص.88-99، 1396.
[7] Ullah I. and Lee H. J., “An approach of locating Korean vehicle license plate based on mathematical morphology and geometrical features,” In 2016 International Conference on Computational Science and Computational Intelligence (CSCI), pp. 836-840, 2016.
[8] Kocer, H. E. and Cevik K. K., “Artificial neural networks-based vehicle license plate recognition,” Procedia Computer Science, 3: 1033-1037, 2011.
[9] Liang G., Shivakumara P., Lu Y., and Tan C. L., “A new wavelet-Laplacian method for arbitrarily-oriented character segmentation in video text lines,” In 2015 13th International Conference on Document Analysis and Recognition (ICDAR), pp. 926-930, 2015.
[10] Kim D., Song T., Lee Y., and Ko H., “Effective character segmentation for license plate recognition under illumination changing environment,” In 2016 IEEE International Conference on Consumer Electronics (ICCE), pp. 532-533, 2016.
[11] Radchenko A., Zarovsky R., and Kazymyr V., “Method of segmentation and recognition of Ukrainian license plates,” In 2017 IEEE International Young Scientists Forum on Applied Physics and Engineering (YSF), pp. 62-65, 2017.
[12] Mohades-Kasaei S. H. and Mohades-Kasaei S. M., “Extraction and recognition of the vehicle license plate for passing under outside environment,” In 2011 European Intelligence and Security Informatics Conference, pp. 234-237, 2011.
[13] Dong M., Dongliang H., Luo C., Liu D., and Zeng W., “A CNN-Based Approach for Automatic License Plate Recognition in the Wild,” In British Machine Vision Conference (BMVC), 2017.
[14] Bulan O., Kozitsky V., Ramesh P., and Shreve M., “Segmentation-and annotation-free license plate recognition with deep localization and failure identification,” IEEE Transactions on Intelligent Transportation Systems, 18(9): 2351-2363, 2017.
[15] Islam R., Sharif K. F., and Biswas S., “Automatic vehicle number plate recognition using structured elements,” In 2015 IEEE Conference on Systems, Process and Control (ICSPC), pp. 44-48, 2015.
[16] Kakani B. V., Gandhi D., and Jani S., “Improved OCR based automatic vehicle number plate recognition using features trained neural network,” In 2017 8th international conference on computing, communication and networking technologies (ICCCNT), pp. 1-6, 2017.
[17] رخشانی‌اول س.، راشدی ع.، نظام‌آبادی‌پور ح.، «بازشناسی پلاک خودرو با استفاده از یادگیری ژرف»، مجله ماشین‌بینایی و پردازش تصویر، جلد 6، شماره 1، ص.31-46، 1398.
[18] Taghibeyglou B., Karimzadeh R., Bagheri F., Bayani A., and Azarnoush H., “New Platform for Automatic Iranian License Plate Detection and Recognition using Deep Learning Techniques,” In 6th Iranian Congress on Electrical and computer engineering with an applied perspective on new energies, Tehran, Iran, 2019.
[19] Rashtehroudi A. R., Shahbahrami A., and Akoushideh A., “Iranian license plate recognition using deep learning,” In 2020 International Conference on Machine Vision and Image Processing (MVIP), pp. 1-5, IEEE, 2020.
[20] Slimani I., Zaarane A., Al Okaishi W., Atouf I., and Hamdoun A., “An automated license plate detection and recognition system based on wavelet decomposition and CNN,” Array, 8: 100040, 2020.
[21] Zherzdev S. and Gruzdev A., “Lprnet: License plate recognition via deep neural networks,” arXiv preprint arXiv: 1806.10447, 2018.
[22] Shi X., Zhao W., and Shen Y., “Automatic license plate recognition system based on color image processing,” In International Conference on Computational Science and Its Applications, Springer, Berlin, Heidelberg, pp. 1159-1168, 2005.
[23] Pechiammal B. and Renjith J. A., “An efficient approach for automatic license plate recognition system,” In 2017 Third International Conference on Science Technology Engineering and Management (ICONSTEM), IEEE, pp. 121-129, 2017.
[24] Henry C., Ahn S. Y., and Lee S. W., “Multinational license plate recognition using generalized character sequence detection,” IEEE Access, 8: 35185-35199, 2020.
[25] Chen R. C., “Automatic License Plate Recognition via sliding-window darknet-YOLO deep learning,” Image and Vision Computing, 87: 47-56, 2019.
[26] Shashirangana J., Padmasiri H., Meedeniya D., and Perera C., “Automated license plate recognition: a survey on methods and techniques,” IEEE Access, 9: 11203-11225, 2020.
[27] Srikanth P. and Kumar A., “Automatic vehicle number plate detection and recognition systems: Survey and implementation,” In Autonomous and Connected Heavy Vehicle Technology, Academic Press, pp. 125-139, 2022.
[28] Mahmood Z., Khan K., Khan U., Adil S. H., Ali S. S. A., and Shahzad M., “Towards automatic license plate detection,” Sensors, 22(3): 1245, 2022.
[29] Suthipong D. and Vateekul P., “Enhancing accuracy of multi-label classification by applying one-vs-one support vector machine,” In 2016 13th International Joint Conference on Computer Science and Software Engineering (JCSSE), pp. 1-6, IEEE, 2016.
[30] رزاق‌زاده ش.، نوروزی‌کیوی پ.، پناهی ب.، «الگوریتم ترکیبی مبتنی بر معماری گوسیپ با استفاده از SVM برای زمانبندی وظایف در رایانش ابری»، مجله محاسبات نرم، جلد 9، شماره 2، ص.84-93، 1399.
[31] بیگدلی م.، «طبقه‌بندی عیوب ترانسفورماتور با استفاده از تحلیل پاسخ فرکانسی بر پایه تکنیک همبستگی متقابل و ماشین بردار پشتیبان»، مجله محاسبات نرم، جلد 9، شماره 1، ص.2-13،1399.
[32] Ashourian M., Daneshmandpoura N., Tehrania O. S., and Moallemb P., “Real time implementation of a license plate location recognition system based on adaptive morphology,” International Journal of Engineering, 26(11): 1347-1356, 2013.
[33] رمضانخانی ف. ، یزدیان‌دهکردی م.، «آشکار‌سازی پلاک خودروهای ایرانی مبتنی بر طبقه‌بندی‌کننده سلسله‌مراتبی»، پردازش علائم و داده‌ها، دوره 18، شماره 3، ص.77-90، 1400.