Deep Learning-Based Automated Approach for Classifying Bacterial Images
(1) * Ahmed Jaber Abougarair Mail (University of Tripoli, Libya)
(2) Abdulhamid A. Oun Mail (University of Tripoli, Libya)
(3) Salah I. Sawan Mail (University of Tripoli, Libya)
(4) Alfian Ma’arif Mail (Universitas Ahmad Dahlan, Indonesia)
*corresponding author

Abstract


Identifying and classifying bacterial species from microscopic images is crucial for medical applications like prevention, diagnosis, and treatment. However, because of their diversity and variability in appearance, manually classifying bacteria is difficult and time-consuming. This work suggests employing deep learning architecture to automatically categorize bacterial species in order to overcome these difficulties and raise the accuracy of bacterial species recognition. We have evaluated our suggested approach using the Digital Images of Bacteria Species (DIBaS), a publicly accessible resource of photographs of tiny bacteria.  This work uses a dataset that differs in terms of bacterial morphology, staining methods, and imaging circumstances. This paper aims to enhance the accuracy and reduce the computational requirements for Convolutional Neural Networks (CNN) based classification of bacterial species using GoogLeNet and AlexNet to train the models. This paper focuses on employing transfer learning to retrain pre-trained CNN models using a dataset consisting of 2000 images encompassing 12 distinct bacteria species known to be harmful to human health.  The concept of transfer learning was utilized to expedite the network's training process and enhance its categorization performance.  The results are promising, with the method achieving an accuracy of 98.7% precision, recall of 99.50%, and an F1-score of 99.45%   with classifier speed. Furthermore, the proposed bacteria classification approach demonstrated strong performance, irrespective of the size of the training data used.  This paper contributes by automating bacterial classification to facilitate faster and more accurate identification of bacterial species, which facilitates the treatment of infections and related diseases, in addition to monitoring public health, and promoting the wise use of antimicrobial drugs. To improve outcomes in the future, researchers can also integrate deep learning techniques with other machine learning methods.

Keywords


AlexNet; Bacteria; CNN; DIBaS; GoogleNet; Transfer Learning

   

DOI

https://doi.org/10.31763/ijrcs.v4i2.1423 		      

Article metrics

10.31763/ijrcs.v4i2.1423 Abstract views : 782 | PDF views : 264

   

Cite

How to cite item
   

Full Text

Download

References


[1] S. Trattner, H. Greenspan, G. Tepper and S. Abboud, “Automatic identification of bacterial types using statistical imaging methods,†IEEE Transactions on Medical Imaging, vol. 23, no. 7, pp. 807-820, 2004, https://doi.org/10.1109/TMI.2004.827481.

[2] Y. Yuliza, R. Muwardi, M. Rhozaly, L. Lenni, M. Yunita, G. E. Yehezkiel, “Fast Human Recognition System on Real-Time Camera,†Jurnal Ilmiah Teknik Elektro Komputer dan Informatika, vol. 9, no. 4, pp. 895-903, 2023, http://dx.doi.org/10.26555/jiteki.v9i4.27009.

[3] A. Plichta, “Methods of classification of the genera and species of bacteria using decision tree,†Journal of Telecommunications and Information Technology, no. 4, pp. 74-82, 2019, https://doi.org/10.26636/jtit.2019.137419.

[4] S. Visitsattaponge, M. Bunkum, C. Pintavirooj and M. P. Paing, “A Deep Learning Model for Bacterial Classification Using Big Transfer (BiT),†IEEE Access, vol. 12, pp. 15609-15621, 2024, https://doi.org/10.1109/ACCESS.2024.3358671.

[5] S. Poomrittigul, W. Chomkwah, T. Tanpatanan, S. Sakorntanant and T. Treebupachatsakul, “A Comparison of Deep Learning CNN Architecture Models for Classifying Bacteria,†2022 37th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), pp. 290-293, 2022, https://doi.org/10.1109/ITC-CSCC55581.2022.9894986.

[6] Z. Wang et al., “Deep neural networks offer morphologic classification and diagnosis of bacterial vaginosis,†Journal of Clinical Microbiology, vol. 59, no. 2, pp. 1-13, 2021, https://doi.org/10.1128/jcm.02236-20.

[7] D. -T. Mai and K. Ishibashi, “Bacteria Shape Classification using Small-Scale Depthwise Separable CNNs,†2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), pp. 2940-2943, 2021, https://doi.org/10.1109/EMBC46164.2021.9630658.

[8] S. A. Akbar, K. H. Ghazali, H. Hasan, Z. Mohamed and W. S. Aji, “An Enhanced Classification of Bacteria Pathogen on Microscopy Images Using Deep Learning,†2021 4th International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), pp. 119-123, 2021, https://doi.org/10.1109/ISRITI54043.2021.9702809.

[9] C. Garcia-Perez, K. Ito, J. Geijo, R. Feldbauer, N. Schreiber, and W. Z. Castell, “Efficient detection of longitudinal bacteria fission using transfer learning in deep neural networks,†Frontiers Microbiology, vol. 12, p. 645972, 2021, https://doi.org/10.3389/fmicb.2021.645972.

[10] H. Sajedi, F. panah, and A. Pashaei, “Image-processing based taxonomy analysis of bacterial micromorphology using machine-learning models,†Multimedia Tools and Applications, vol. 79, pp. 32711–32730, 2020, https://doi.org/10.1007/s11042-020-09284-9.

[11] T. Shaily and S. Kala, “Bacterial Image Classification Using Convolutional Neural Networks,†2020 IEEE 17th India Council International Conference (INDICON), pp. 1-6, 2020, https://doi.org/10.1109/INDICON49873.2020.9342356.

[12] A. Ferrari, S. Lombardi, and A. Signoroni, “Bacterial colony counting with convolutional neural networks in digital microbiology imaging,†Pattern Recognition, vol. 61, pp. 629–640, 2017, https://doi.org/10.1016/j.patcog.2016.07.016.

[13] B. D. Satoto, M. I. Utoyo, R. Rulaningtyas, and E. B. Koendhori, “Classification of features shape of Gram-negative bacterial using an extreme learning machine,†IOP Conference Series: Earth and Environmental Science, vol. 524, no. 1, p. 012005, 2020, https://doi.org/10.1088/1755-1315/524/1/012005.

[14] I. Apostolopoulos and T. Bessiana, “COVID-19: Automatic detection from X-ray images utilizing transfer learning with convolutional neural networks,†Physical and Engineering Sciences in Medicine, vol. 43, pp. 635–640, 2020, https://doi.org/10.1007/s13246-020-00865-4.

[15] S. Patel, “Bacterial colony classification using atrous convolution with transfer learning,†Annals of the Romanian Society for Cell Biology, vol. 25, no. 4, pp. 1428-1441, 2021, http://annalsofrscb.ro/index.php/journal/article/view/2650.

[16] M. Talo, “An automated deep learning approach for bacterial image classification,†arXiv preprint arXiv, 2019, https://arxiv.org/abs/1912.08765.

[17] N. E. M. Khalifa, M. H. N. Taha, A. E. Hassanien, S. Elghamrawy, “Detection of coronavirus (COVID-19) associated pneumonia based on generative adversarial networks and a fine-tuned deep transfer learning model using chest X-ray dataset,†Proceedings of the 8th International Conference on Advanced Intelligent Systems and Informatics 2022, pp. 234-247, 2020, https://doi.org/10.1007/978-3-031-20601-6_22.

[18] S. Kotwal, P. Rani, T. Arif, J. Manhas, “Machine Learning and Deep Learning Based Hybrid Feature Extraction and Classification Model Using Digital Microscopic Bacterial Images,†SN Computer Science, vol. 4, no. 5, p. 687, 2023, https://doi.org/10.1007/s42979-023-02138-9.

[19] C. Chen , A. Abdullah, S. H. Kok, D. T. K. Tien, “Review of Industry Workpiece Classification and Defect Detection using Deep Learning,†International Journal of Advanced Computer Science and Applications, vol. 13, no. 4, pp. 329-340, 2022, https://dx.doi.org/10.14569/IJACSA.2022.0130439.

[20] S. A. Nagro et al., “Automatic Identification of Single Bacterial Colonies Using Deep and Transfer Learning,†IEEE Access, vol. 10, pp. 120181-120190, 2022, https://doi.org/10.1109/ACCESS.2022.3221958.

[21] M. F. Wahid, M. J. Hasan, M. S. Alom and S. Mahbub, “Performance Analysis of Machine Learning Techniques for Microscopic Bacteria Image Classification,†2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), pp. 1-4, 2019, https://doi.org/10.1109/ICCCNT45670.2019.8944597.

[22] Y. Brima, M. Atemkeng and S. Djiokap, J. Ebiele, F. Tchakounte, “Transfer learning for the detection and diagnosis of types of pneumonia including pneumonia induced by COVID-19 from chest X-ray images,†Diagnostics, vol. 11, no. 8, p. 1480, 2021, https://doi.org/10.3390/diagnostics11081480.

[23] H. Wang et al., “Early detection and classification of live bacteria using time-lapse coherent imaging and deep learning,†Light: Science & Applications, vol. 9, no. 1, p. 118, 2020, https://doi.org/10.1038/s41377-020-00358-9.

[24] A. Casado-García et al., “MotilityJ: An open-source tool for the classification and segmentation of bacteria on motility images,†Computers in Biology and Medicine, vol. 136, p. 104673, 2021, https://doi.org/10.1016/j.compbiomed.2021.104673.

[25] R. G. García, S. J. Rodríguez, B. B. Martínez, C. H. Gracidas, and R. M. Torres, “Efficient deep learning architectures for fast identification of bacterial strains in resource-constrained devices,†Multimedia Tools and Applications, vol. 81, no. 28, pp. 39915-39944, 2022, https://doi.org/10.1007/s11042-022-13022-8.

[26] K. Kristensen, L. M. Ward, M. L. Mogensen, and S. L. Cichosz, “Using image processing and automated classification models to classify microscopic gram stain images,†Computer Methods and Programs in Biomedicine Update, vol. 3, p. 100091, 2023, https://doi.org/10.1016/j.cmpbup.2022.100091.

[27] J. P. Chaudhari, H. Mewada, A. V. Patel, and K. Mahant, “Automated bacteria genera classification using histogram-oriented optimized capsule network,†Engineering Science and Technology, an International Journal, vol. 46, p. 101500, 2023, https://doi.org/10.1016/j.jestch.2023.101500.

[28] I. Naz, J. H. Shah, M. H. U. Rehman, M. Rafiq and G. S. Choi, “Quantum Mechanism-Based Convolution Model for the Classification of Pathogenic Bacteria,†IEEE Access, vol. 11, pp. 137747-137757, 2023, https://doi.org/10.1109/ACCESS.2023.3339127.

[29] H. P. Desai, A. P. Parameshwaran, R. Sunderramanand and M. Weeks, “Comparative Study Using Neural Networks for 16S Ribosomal Gene Classification,†Journal of Computational Biology, vol. 27, no. 2, pp. 248-258, 2020, https://doi.org/10.1089/cmb.2019.0436.

[30] D. Sutaji and H. Rosyid, “Convolutional Neural Network (CNN) Models for Crop Diseases Classification,†Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control, vol. 7, no. 2, pp.187-196, 2022, https://doi.org/10.22219/kinetik.v7i2.1443.

[31] H. Eldem, E. Ulker and O. Y. Iskl, “Alexnet architecture variations with transfer learning for classification of wound images,†Engineering Science and Technology, an International Journal, vol. 45, p. 101490, 2023, https://doi.org/10.1016/j.jestch.2023.101490.

[32] S. Lu, Z. Lu, Y.-D. Zhang, “Pathological brain detection based on AlexNet and transfer learning,†Journal of Computational Science, vol. 30, pp. 41-47, 2019, https://doi.org/10.1016/j.jocs.2018.11.008.

[33] H. Chen et al., “AlexNet convolutional neural network for disease detection and classification of tomato leaf,†Electronics, vol. 11, no. 6, p. 951, 2022, https://doi.org/10.3390/electronics11060951.

[34] V. S. Kanimozhi, M. Balasubramani, R. Anuradha, “Hierarchal Bayes model with AlexNet for characterization of M-FISH chromosome images,†Medical & Biological Engineering & Computing, vol. 59, no. 7, pp. 1529-1544, 2021, https://doi.org/10.1007/s11517-021-02384-0.

[35] H. Eldem, E. Ülker and O. Işkl, “Effects of Training Parameters of AlexNet Architecture on Wound Image Classification,†Traitement du Signal, vol. 40, no. 2, pp. 811-817, 2023, https://doi.org/10.18280/ts.400243.

[36] R. Anand and T. Shanthi, M. S. Nithish, S. Lakshman, “Face Recognition and Classification Using GoogleNET Architecture,†International Conference on Soft Computing for Problem Solving, pp. 261-269, 2020, https://doi.org/10.1007/978-981-15-0035-0_20.

[37] V. Sunanthini et al., “Comparison of CNN Algorithms for Feature Extraction on Fundus Images to Detect Glaucoma,†Journal of Healthcare Engineering, vol. 2022, 2022, https://doi.org/10.1155/2022/7873300.

[38] G. Xu et al., "A Deep Transfer Convolutional Neural Network Framework for EEG Signal Classification," in IEEE Access, vol. 7, pp. 112767-112776, 2019, https://doi.org/10.1109/ACCESS.2019.2930958.

[39] L. Yang, â€GoogLeNet based on residual network and attention mechanism identification of rice leaf diseases,†Computers and Electronics in Agriculture, vol. 204, p. 107543, 2023, https://doi.org/10.1016/j.compag.2022.107543.

[40] T. Treebupachatsakul and S. Poomrittigul, “Bacteria Classification using Image Processing and Deep learning,†2019 34th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC), pp. 1-3, 2019, https://doi.org/10.1109/ITC-CSCC.2019.8793320.

[41] S. J. Pan and Q. Yang, “A Survey on Transfer Learning,†IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345-1359, 2010, https://doi.org/10.1109/TKDE.2009.191.

[42] A. J. Abougarair, “Neural Networks Identification and Control of Mobile Robot Using Adaptive Neuro Fuzzy Inference System,†ICEMIS'20: Proceedings of the 6th International Conference on Engineering & MIS 2020, pp. 1-9, 2020, https://doi.org/10.1145/3410352.3410734.

[43] N. D. Kathamuthu et al., “A deep transfer learning-based convolution neural network model for COVID-19 detection using computed tomography scan images for medical applications,†Advanced Engineering Software, vol. 175, p. 103317, 2023, https://doi.org/10.1016/j.advengsoft.2022.103317.

[44] A. J. Abougarair, M. J. Abujarir, H. T. Tilamon, “Artificial pancreas control using optimized fuzzy logic based genetic algorithm,†International Robotics & Automation Journal, vol. 9, no. 2, pp. 89-97, 2023, https://doi.org/10.15406/iratj.2023.09.00270.

[45] A. J. Abougarair et al., “Blood Cells Cancer Detection Based on Deep Learning,†Journal of Advances in Artificial Intelligence, vol. 2, no. 1, pp. 108-121, 2024, https://doi.org/10.18178/JAAI.2024.2.1.108-121.

[46] M. Hacibeyoglu, M. H. Ibrahim, “Human Gender Prediction on Facial Mobil Images using Convolutional Neural Networks,†International Journal of Intelligent Systems and Applications in Engineering, vol. 6, no. 3, pp. 203-208, 2018, https://doi.org/10.18201/ijisae.2018644778.

[47] A. A. Almisreb, N. M. Tahir, S. Turaev, M. A. Saleh, S. A. M. A. Junid, “Arabic Handwriting Classification using Deep Transfer Learning Techniques,†Pertanika Journal Science Technol, vol. 30, no. 1, p. 641, 2022, https://doi.org/10.47836/pjst.30.1.35.

[48] A. S. Emhemmed, A. J. Abougarair, O. Salih and S. S. Alsamlqi, “Simulation Analysis and Control of Wireless Power Transfer for Implantable Medical Devices,†2022 IEEE 21st international Ccnference on Sciences and Techniques of Automatic Control and Computer Engineering (STA), pp. 18-23, 2022, https://doi.org/10.1109/STA56120.2022.10019046.

[49] B. Zieliński, A. Plichta, K. Misztal, P. Spurek, M. Brzychczy-Włoch, D. Ochońska, “Deep learning approach to bacterial colony classification,†PLoS ONE, vol. 12, no. 9, p. e0184554, 2017, https://doi.org/10.1371/journal.pone.0184554.

[50] Y. Guo, Z. Pang, J. Du, F. Jiang and Q. Hu, “An Improved AlexNet for Power Edge Transmission Line Anomaly Detection,†IEEE Access, vol. 8, pp. 97830-97838, 2020, https://doi.org/10.1109/ACCESS.2020.2995910.

[51] A. J. Abougarair, M. K. I. Aburakhis, M. M. Edardar, “Adaptive Neural Networks Based Robust Output Feedback Controllers for Nonlinear Systems,†International Journal of Robotics and Control Systems, vol. 2, no. 1, pp. 37-56, 2022, https://doi.org/10.31763/ijrcs.v2i1.523.

[52] E. Hossain, I. Khan, F. Un-Noor, S. S. Sikander and M. S. H. Sunny, “Application of Big Data and Machine Learning in Smart Grid, and Associated Security Concerns: A Review,†IEEE Access, vol. 7, pp. 13960-13988, 2019, https://doi.org/10.1109/ACCESS.2019.2894819.

[53] A. J. Abougarair, “Adaptive Neural Networks Based Optimal Control for Stabilizing Nonlinear System,†2023 IEEE 3rd International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA), pp. 141-148, 2023, https://doi.org/10.1109/MI-STA57575.2023.10169340.

[54] S. E. Elwefati, A. J. Abougarair and M. M. Bakush, “Control of Epidemic Disease Based Optimization Technique,†2021 IEEE 1st International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering MI-STA, pp. 52-57, 2021, https://doi.org/10.1109/MI-STA52233.2021.9464453.

[55] A. J. Abougarair, S. E. Elwefati, “Identification and Control of Epidemic Disease Based Neural Networks and Optimization Technique,†International Journal of Robotics and Control System, vol 3, no. 4, pp. 780-803, 2023, https://doi.org/10.31763/ijrcs.v3i4.1151.

[56] A. J. Abougarair, M. Edardar, “Adaptive Neural Networks Based Robust Output Feedback Control for linearized System,†WSEAS Transactions on Computer Research, vol. 9, pp. 125-136, 2021, https://doi.org/10.37394/232018.2021.9.15.

[57] Z. Wang, C. Tang, X. Sima and L. Zhang, “Research on Application of Deep Learning Algorithm in Image Classification,†2021 IEEE Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC), pp. 1122-1125, 2021, https://doi.org/10.1109/IPEC51340.2021.9421185.

[58] A. Abbas, M. M. Abdelsamea and M. M. Gaber, “4S-DT: Self-Supervised Super Sample Decomposition for Transfer Learning With Application to COVID-19 Detection,†IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 7, pp. 2798-2808, 2021, https://doi.org/10.1109/TNNLS.2021.3082015.

[59] A. J. Abougarair, M. Ellafi, A. Ma'Arif and O. Salih, “Analysis of Mobile Accelerometer Sensor Movement Using Machine Learning Algorithm,†2023 IEEE 3rd International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering (MI-STA), pp. 46-51, 2023, https://doi.org/10.1109/MI-STA57575.2023.10169214.

[60] A. J. Abougarair, N. A. A. Shashoa, M. K. Aburakhis, “Performance of Anti-Lock Braking Systems Based on Adaptive and Intelligent Control Methodologies,†Indonesian Journal of Electrical Engineering and Informatics, vol. 10, no. 3, pp. 626-643, 2022, https://doi.org/10.52549/ijeei.v10i3.3794.

[61] M. B. Rozenwald, A. A. Galitsyna, G. V. Sapunov, E. E. Khrameeva, M. S. Gelfand, “A machine learning framework for the prediction of chromatin folding in Drosophila using epigenetic features,†Peer Journal Computer Science, vol. 6, p. e307, 2020, https://doi.org/10.7717/peerj-cs.307.

[62] L. Alzubaidi et al., “Review of deep learning: concepts, CNN architectures, challenges, applications,†Journal of Big Data, vol. 8, pp.1-74, 2021, https://doi.org/10.1186/s40537-021-00444-8.

[63] F. Zhuang et al., “A Comprehensive Survey on Transfer Learning,†Proceedings of the IEEE, vol. 109, no. 1, pp. 43-76, 2021, https://doi.org/10.1109/JPROC.2020.3004555.

[64] L. Muflikhah, F. A. Bachtiar, D. E. Ratnawati, R. Darmawan, “Improving Performance for Diabetic Nephropathy Detection Using Adaptive Synthetic Sampling Data in Ensemble Method of Machine Learning Algorithms,†Jurnal Ilmiah Teknik Elektro Komputer dan Informatika, vol. 10, no. 1, pp. 123-137, 2024, https://doi.org/10.26555/jiteki.v10i1.28107.

[65] K. Koirunnisa A. M. Siregar, S. Faisal, “Optimized Machine Learning Performance with Feature Selection for Breast Cancer Disease Classification,†Jurnal Ilmiah Teknik Elektro Komputer dan Informatika, vol. 9, no. 4, pp. 1131-1143, 2023, http://dx.doi.org/10.26555/jiteki.v9i4.27527.

[66] A. J. Abougarair, M. K. Aburakhis, M. O. Zaroug, “Design and implementation of smart voice assistant and recognizing academic words,†International Robotics & Automation Journal, vol. 8, no. 1, pp. 27-32, 2022, https://doi.org/10.15406/iratj.2022.08.00240.

[67] A. J. Abougarair, W. Arebi, “Smart Glove for Sign Language Translation,†International Robotics & Automation Journal, vol. 8, no. 3, pp. 109-117, 2022, https://doi.org/10.15406/iratj.2022.08.00253.

[68] H. Isyanto, A. Arifin and M. Suryanegara, “Fast and Accurate Voice Biometrics with Deep Learning Algorithm of CNN Depth wise Separable Convolution Model and Fusion of DWT-MFCC Methods,†Jurnal Ilmiah Teknik Elektro Komputer dan Informatika, vol. 8, no. 3, pp. 431-446, 2022, http://dx.doi.org/10.26555/jiteki.v8i3.24515.

[69] E. Wulczyn et al., “Deep learning-based survival prediction for multiple cancer types using histopathology images,†PLoS One, vol. 15, no. 6, p. e0233678, 2020, https://doi.org/10.1371/journal.pone.0233678.

[70] A. J. Abougarair, H. M. Gnan, A. Oun and S. O. Elwarshfani, “Implementation of a Brain-Computer Interface for Robotic Arm Control,†2021 IEEE 1st International Maghreb Meeting of the Conference on Sciences and Techniques of Automatic Control and Computer Engineering MI-STA, pp. 58-63, 2021, https://doi.org/10.1109/MI-STA52233.2021.9464359.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Ahmed Jaber Abougarair

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 

About the JournalJournal PoliciesAuthor Information

International Journal of Robotics and Control Systems
e-ISSN: 2775-2658
Website: https://pubs2.ascee.org/index.php/IJRCS
Email: ijrcs@ascee.org
Organized by: Association for Scientific Computing Electronics and Engineering (ASCEE), Peneliti Teknologi Teknik Indonesia, Department of Electrical Engineering, Universitas Ahmad Dahlan and Kuliah Teknik Elektro
Published by: Association for Scientific Computing Electronics and Engineering (ASCEE)
Office: Jalan Janti, Karangjambe 130B, Banguntapan, Bantul, Daerah Istimewa Yogyakarta, Indonesia