An Intelligent Color Image Recognition and Mobile Control System for Robotic Arm
(1) * Albert Wen Long Yao Mail (National Kaohsiung University of Science and Technology, Kaohsiung, Taiwan)
(2) H. C. Chen Mail (National Kaohsiung University of Science and Technology, Graduate Student, Kaohsiung City, Taiwan)
*corresponding author

Abstract


The aim of this study is to develop intelligent color recognition, mobile control, and monitoring system for a pick-and-place robotic arm for manufacturing systems. The demand for smart manufacturing factories with real-time control of fabricating processes and traceability of production information is increasing urgently. Generally speaking, a smart manufacturing facility is usually composed of sensing, computing, control, and communication technologies together. In this study, the three-tier architecture of the Internet of things (IoT) was adopted as a guideline to design mobile devices to control and monitor a color image recognition and alarm monitoring system by using Raspberry Pi and a web page database. The practical results and contributions of this study are as follows:  With integrating the techniques of advanced B&R PLC, mobile devices and APP, color image recognition, Raspberry Pi microcomputer, and MySQL database technologies together, (1) the mobile control and monitoring system is able to supervise a real-time manufacturing plant anywhere and anytime with mobile devices easily; (2) the color identification system can identify and classify different color work-piece precisely, and the identification results are recorded for remote database platform; (3) the collected data are analyzed and displayed on mobile devices through the web database for field operators and engineers promptly.  It provides a very successful practical paradigm to promote conventional factories to meet industry 4.0.

Keywords


Color Image Recognition; web database; mobile control system

   

DOI

https://doi.org/10.31763/ijrcs.v2i1.557 		      

Article metrics

10.31763/ijrcs.v2i1.557 Abstract views : 1990 | PDF views : 797

   

Cite

How to cite item
   

Full Text

Download

References


[1] C. Yen, Y. Liu, C. Lin, C. Kao, W. Wang, and Y. Hsu, “Advanced manufacturing solution to industry 4.0 trend through sensing network and Cloud Computing technologies,†2014 IEEE International Conference on Automation Science and Engineering (CASE), 2014, pp. 1150-1152, https://10.1109/CoASE.2014.6899471.

[2] J-R Jiang, “An improved cyber-physical systems architecture for Industry 4.0 smart factories,†Advances in Mechanical Engineering, vol. 10, no. 6, June 2018, https://doi.org/10.1177/1687814018784192

[3] G. Kourtis, E. Kavakli, and R. Sakellariou, “A Rule-Based Approach Founded on Description Logics for Industry 4.0 Smart Factories,†IEEE Transactions on Industrial Informatics, vol. 15, no. 9, pp. 4888-4899, Sept. 2019, https://doi.org/10.1109/TII.2019.2916622.

[4] J. Lee, B. Bagheri and H. A. Kao, “A cyber-physical systems architecture for industry 4.0-based manufacturing systems,†Manufacturing Letters, 2015, vol. 3, pp. 18-23, https://doi.org/10.1016/j.mfglet.2014.12.001.

[5] A. Galletta, L. Carnevale, A. Celesti, M. Fazio, and M. Villari, “A Cloud-Based System for Improving Retention Marketing Loyalty Programs in Industry 4.0: A Study on Big Data Storage Implications,†IEEE Access, vol. 6, pp. 5485-5492, 2018, https://doi.org/10.1109/ACCESS.2017.2776400.

[6] G. Aceto, V. Persico, and A. Pescapé, “A Survey on Information and Communication Technologies for Industry 4.0: State-of-the-Art, Taxonomies, Perspectives, and Challenges,†IEEE Communications Surveys & Tutorials, vol. 21, no. 4, pp. 3467-3501, 2019, https://doi.org/10.1109/COMST.2019.2938259.

[7] Z. Wang, “An Industry 4.0 approach to develop auto parameter configuration of a bottling process in a small to medium scale industry using PLC and SCADA,†Procedia Manufacturing, 2019, vol. 35, pp. 725-730, https://doi.org/10.1016/j.isatra.2018.04.010.

[8] R. Langmann and M. Stiller, “The PLC as a Smart Service in Industry 4.0 Production Systems,†Appl. Sci., vol. 9, no. 18, p. 3815, 2019 https://doi.org/10.3390/app9183815.

[9] J. Mellado and F. Núñez, “Design of an IoT-PLC: A containerized programmable logical controller for the industry 4.0,†Journal of Industrial Information Integration, p. 100250, Aug. 2021, https://doi.org/10.1016/j.jii.2021.100250.

[10] P. S. Bhase, G. M. Kolmare, and A. S. Deshpande, “Design & development of energy monitoring solution,†2016 International Conference on Computing, Communication and Automation (ICCCA), 2016, pp. 1222-1227, https://doi.org/10.1109/CCAA.2016.7813928.

[11] E. Kadiyala, S. Meda, R. Basani, and S. Muthulakshmi, “Global industrial process monitoring through IoT using Raspberry Pi,†2017 International Conference on Nextgen Electronic Technologies: Silicon to Software (ICNETS2), 2017, pp. 260-262, https://doi.org/10.1109/ICNETS2.2017.8067944.

[12] J. Nikhila, “Web based Environmental Monitoring System using Raspberry Pi,†2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC), 2017, pp. 1074-1080, https://doi.org/10.1109/CTCEEC.2017.8454964.

[13] P. Siagian and K. Shinoda, “Web based monitoring and control of robotic arm using Raspberry Pi,†2015 International Conference on Science in Information Technology (ICSITech), 2015, pp. 192-196, https://doi.org/10.1109/ICSITech.2015.7407802.

[14] M. Vanitha, M. Selvalakshmi and R. Selvarasu, “Monitoring and controlling of mobile robot via internet through raspberry Pi board,†2016 Second International Conference on Science Technology Engineering and Management (ICONSTEM), 2016, pp. 462-466, https://doi.org/10.1109/ICONSTEM.2016.7560864.

[15] M. S. S. Rukmini and D. Bala Gayathri Devi, “Remote control of appliances based on Raspberry Pi,†2016 Second International Conference on Cognitive Computing and Information Processing (CCIP), 2016, pp. 1-4, https://doi.org/10.1109/CCIP.2016.7802863.

[16] J. -D. Lee, W. -C. Li, J. -H. Shen and C. -W. Chuang, “Multi-robotic arms automated production line,†2018 4th International Conference on Control, Automation and Robotics (ICCAR), 2018, pp. 26-30, https://doi.org/10.1109/ICCAR.2018.8384639.

[17] N. Nadgauda and S. A. Muthukumaraswamy, “Design and Development of Industrial Automated System using PLC-SCADA,†2019 IEEE 10th GCC Conference & Exhibition (GCC), 2019, pp. 1-6, https://doi.org/10.1109/GCC45510.2019.1570521239.

[18] S. Mohod and A. Raut, “PLC SCADA Based Fault Detection System for Steam Boiler In Remote Plant,†2019 2nd International Conference on Intelligent Computing, Instrumentation and Control Technologies (ICICICT), 2019, pp. 1007-1010, https://doi.org/10.1109/ICICICT46008.2019.8993359.

[19] R. F. Al Hinai and A. F. A. Farh, “Building Color Sensor Based on Image Processing Technology for Automatic Color Object Sorting Using PLC System,†2019 International Conference on Digitization (ICD), 2019, pp. 222-226, https://doi.org/10.1109/ICD47981.2019.9105879.

[20] R. V. Soans, G. R. Pradyumna and Y. Fukumizu, “Object Sorting using Image Processing,†2018 3rd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT), 2018, pp. 814-818, https://doi.org/10.1109/RTEICT42901.2018.9012110.

[21] R. V. Soans, Ranjith, A. Hegde, C. Singh, and A. Kumar, “Object tracking robot using adaptive color thresholding,†2017 2nd International Conference on Communication and Electronics Systems (ICCES), 2017, pp. 790-793, https://doi.org/10.1109/CESYS.2017.8321192.

[22] V. Pereira, V. A. Fernandes, and J. Sequeira, “Low cost object sorting robotic arm using Raspberry Pi,†2014 IEEE Global Humanitarian Technology Conference - South Asia Satellite (GHTC-SAS), 2014, pp. 1-6, https://doi.org/10.1109/GHTC-SAS.2014.6967550.

[23] Huu-Quoc Nguyen, Ton Thi Kim Loan, Bui Dinh Mao and Eui-Nam Huh, “Low cost real-time system monitoring using Raspberry Pi,†2015 Seventh International Conference on Ubiquitous and Future Networks, 2015, pp. 857-859, https://doi.org/10.1109/ICUFN.2015.7182665.

[24] S. N. Kulkarni and S. Kumar Singh, “Object Sorting Automated System using Raspberry Pi,†2018 3rd International Conference on Communication and Electronics Systems (ICCES), 2018, pp. 217-220, https://doi.org/10.1109/CESYS.2018.8724056.

[25] F. López, F. J. Torres, V. A. Ramírez, D. A. Núñez, R. Corona and A. R. López, “Raspberry Pi for Implementation of Web Technology in an Automation Process,†2019 IEEE International Autumn Meeting on Power, Electronics and Computing (ROPEC), 2019, pp. 1-6, https://doi.org/10.1109/ROPEC48299.2019.9057040.

[26] H. R. and M. H. Safwat Hussain, “Surveillance Robot Using Raspberry Pi and IoT,†2018 International Conference on Design Innovations for 3Cs Compute Communicate Control (ICDI3C), 2018, pp. 46-51, https://doi.org/10.1109/ICDI3C.2018.00018.

[27] M. R. Mishi, R. Bibi, and T. Ahsan, “Multiple motion control system of robotic car based on IoT to produce cloud service,†2017 International Conference on Electrical, Computer and Communication Engineering (ECCE), 2017, pp. 748-751, https://doi.org/10.1109/ECACE.2017.7913002.

[28] M. A. Benmahdjoub, A. Mezouar, L. Boumediene and Y. Saidi, “Control and Monitoring of Electrical Embarked Network with Cloud Technology using Raspberry Pi,†2018 International Conference on Electrical Sciences and Technologies in Maghreb (CISTEM), 2018, pp. 1-6, https://doi.org/10.1109/CISTEM.2018.8613586.

[29] C. Kaymak and A. Ucar, “Implementation of Object Detection and Recognition Algorithms on a Robotic Arm Platform Using Raspberry Pi,†2018 International Conference on Artificial Intelligence and Data Processing (IDAP), 2018, pp. 1-8, https://doi.org/10.1109/IDAP.2018.8620916.

[30] B. V. Santhosh Krishna, J. Oviya, S. Gowri, and M. Varshini, “Cloud robotics in industry using Raspberry Pi,†2016 Second International Conference on Science Technology Engineering and Management (ICONSTEM), 2016, pp. 543-547, https://doi.org/10.1109/ICONSTEM.2016.7560952.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2021 Albert Wen Long Yao, H. C. Chen

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 

About the JournalJournal PoliciesAuthor Information

International Journal of Robotics and Control Systems
e-ISSN: 2775-2658
Website: https://pubs2.ascee.org/index.php/IJRCS
Email: ijrcs@ascee.org
Organized by: Association for Scientific Computing Electronics and Engineering (ASCEE), Peneliti Teknologi Teknik Indonesia, Department of Electrical Engineering, Universitas Ahmad Dahlan and Kuliah Teknik Elektro
Published by: Association for Scientific Computing Electronics and Engineering (ASCEE)
Office: Jalan Janti, Karangjambe 130B, Banguntapan, Bantul, Daerah Istimewa Yogyakarta, Indonesia