Published July 15, 2025 | Version v1
Journal article Open

SMART FATIGUE DETECTION AND HEALTH MONITORING SYSTEM FOR ASSEMBLY LINE WORKERS USING IOT AND COMPUTER VISION TECHNOLOGIES

Authors/Creators

  • 1. ROR icon Polytechnic University of Timişoara

Contributors

Description

: Ensuring the safety and health of assembly line workers is critical to increasing productivity and preventing accidents. This research presents a real-time monitoring system that combines computer vision (AI), wearable Internet of Things (IoT) devices, and cloud-based technologies to detect worker fatigue and health risks. The system calculates eye aspect ratio (EAR) and mouth aspect ratio (MAR) to identify fatigue symptoms such as eye closure and yawning, while wearable IoT devices monitor physiological parameters such as heart rate (HR) and blood oxygen saturation (SpO₂) to detect potential health issues. Alerts are automatically triggered based on pre-defined thresholds, allowing for immediate intervention. All data is processed in real-time with input from wearables and computer vision, and transmitted to a cloud platform for analysis, reporting and storage. This integration of AI-powered computer vision, wearable IoT and cloud connectivity ensures continuous monitoring and provides actionable insights to supervisors, improving workplace safety and operational efficiency. The results of the study demonstrate the effectiveness of this innovative system in identifying fatigue and health issues, reducing accidents and promoting a safer working environment. By using the latest technology, the proposed solution addresses the urgent need for advanced safety measures in demanding work environments.

Files

04 Dina D. Algeria.pdf

Files (1.4 MB)

Name Size Download all
md5:ce05a5c0484b68a14ca2a1606ca3d1ea
1.4 MB Preview Download

Additional details

Software

Repository URL
https://www.ajme.ro
Development Status
Active

References

  • Abdous, M. A., Delorme, X., Battini, D., & Berger-Douce, S. (2023). Multi-objective collaborative assembly line design problem with the optimization of ergonomics and economics. International Journal of Production Research, 61(22), 7830-7845. Adane, M. M., Gelaye, K. A., Beyera, G. K., Sharma, H. R., & Yalew, W. W. (2013). Occupational injuries among building construction workers in Gondar City, Ethiopia. Occup Med Health Aff, 1(125), 2. Adão Martins, N. R., Annaheim, S., Spengler, C. M., & Rossi, R. M. (2021). Fatigue monitoring through wearables: A state-of-the-art review. Frontiers in physiology, 12, 790292. Ahmad, F., Liu, M., & Beyette, F. R. (2024, March). Fatigue Analysis in Assembly Line Workers Using Brain Computer Interface. In SoutheastCon 2024 (pp. 1229-1234). IEEE. Bagassi, S., De Crescenzio, F., Piastra, S., Persiani, C. A., Ellejmi, M., Groskreutz, A. R., & Higuera, J. (2020). Human-in-the-loop evaluation of an augmented reality-based interface for the airport control tower. Computers in Industry, 123, 103291. Berlin, C., Bergman, M. W., Chafi, M. B., Falck, A. C., & Örtengren, R. (2021, May). A systemic overview of factors affecting the cognitive performance of industrial manual assembly workers. In Congress of the International Ergonomics Association (pp. 371-381). Cham: Springer International Publishing. Bottani, E., Longo, F., Nicoletti, L., Padovano, A., Tancredi, G. P. C., Tebaldi, L., ... & Vignali, G. (2021). Wearable and interactive mixed reality solutions for fault diagnosis and assistance in manufacturing systems: Implementation and testing in an aseptic bottling line. Computers in Industry, 128, 103429. Caldwell, J. A., Caldwell, J. L., Thompson, L. A., & Lieberman, H. R. (2019). Fatigue and its management in the workplace. Neuroscience & Biobehavioral Reviews, 96, 272-289. Caruso, C. C., & Waters, T. R. (2008). A review of work schedule issues and musculoskeletal disorders with an emphasis on the healthcare sector. Industrial health, 46(6), 523-534. han, M. (2011). Fatigue: The most critical accident risk in oil and gas construction. Construction Management and Economics, 29(4), 341-353. Chen, Y. J., & Ho, W. H. (2023, July). Worksite injury prevention through automatic mental fatigue detection. In 2023 International Conference on Consumer Electronics-Taiwan (ICCE-Taiwan) (pp. 101-102). IEEE. Chua, E. C. P., Tan, W. Q., Yeo, S. C., Lau, P., Lee, I., Mien, I. H., ... & Gooley, J. J. (2012). Heart rate variability can be used to estimate sleepiness-related decrements in psychomotor vigilance during total sleep deprivation. Sleep, 35(3), 325-334. Collins, S. (2009). Commentary Occupational Factors, Fatigue, and cardiovascular disease. Cardiopulmonary physical therapy journal, 20(2), 28-31. Dhruba, A. R., Alam, K. N., Khan, M. S., Bourouis, S., & Khan, M. M. (2021). [Retracted] Development of an IoT‐Based Sleep Apnea Monitoring System for Healthcare Applications. Computational and Mathematical Methods in Medicine, 2021(1), 7152576. Fordal, J. M., Schjølberg, P., Helgetun, H., Skjermo, T. Ø., Wang, Y., & Wang, C. (2023). Application of sensor data based predictive maintenance and artificial neural networks to enable Industry 4.0. Advances in Manufacturing, 11(2), 248-263. Friederich, J., Francis, D. P., Lazarova-Molnar, S., & Mohamed, N. (2022). A framework for data-driven digital twins of smart manufacturing systems. Computers in Industry, 136, 103586. Fu, J., Ma, L., Tsao, L., & Zhang, Z. (2019). Continuous measurement of muscle fatigue using wearable sensors during light manual operations. In Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Human Body and Motion: 10th International Conference, DHM 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26–31, 2019, Proceedings, Part I 21 (pp. 266-277). Springer International Publishing. Google. (2024). MediaPipe: Face Mesh. Retrieved from https://ai.google.dev/edge/mediapipe/solutions/vision/face_landmarker?hl=fr. Accessed on: March 28, 2024. Henelius, A., Sallinen, M., Huotilainen, M., Müller, K., Virkkala, J., & Puolamäki, K. (2014). Heart rate variability for evaluating vigilant attention in partial chronic sleep restriction. Sleep, 37(7), 1257-1267. Hidalgo-Muñoz, A. R., Mouratille, D., Matton, N., Causse, M., Rouillard, Y., & El-Yagoubi, R. (2018). Cardiovascular correlates of emotional state, cognitive workload and time-on-task effect during a realistic flight simulation. International Journal of Psychophysiology, 128, 62-69. Ibrahim, M. S., Kamat, S. R., Shamsuddin, S., & Fukumi, M. (2022). Mathematical Regression Analysis of Oxygen Saturation for Driving Fatigue using Box-Behnken Design. International Journal of Emerging Technology and Advanced Engineering, 12(9), 23-29. Jeklin, A. T., Perrotta, A. S., Davies, H. W., Bredin, S. S., Paul, D. A., & Warburton, D. E. (2021). The association between heart rate variability, reaction time, and indicators of workplace fatigue in wildland firefighters. International archives of occupational and environmental health, 94, 823-831. Kaida, K., ÅKERSTEDT, T., Kecklund, G., Nilsson, J. P., & Axelsson, J. (2007). Use of subjective and physiological indicators of sleepiness to predict performance during a vigilance task. Industrial health, 45(4), 520-526. Kamišalić, A., Fister Jr, I., Turkanović, M., & Karakatič, S. (2018). Sensors and functionalities of non-invasive wrist-wearable devices: A review. Sensors, 18(6), 1714. Kim, J. W., Jeong, B. Y., & Park, M. H. (2022). A Study on the factors influencing overall fatigue and musculoskeletal pains in automobile manufacturing production workers. Applied Sciences, 12(7), 3528. Kim, J., Lee, K., & Jeon, J. (2024). Systematic literature review of wearable devices and data analytics for construction safety and health. Expert Systems with Applications, 125038. Kulkarni, S. S., Harale, A. D., & Thakur, A. V. (2017, September). Image processing for driver's safety and vehicle control using raspberry Pi and webcam. In 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI) (pp. 1288-1291). IEEE. Lambay, A., Liu, Y., Morgan, P. L., & Ji, Z. (2024). Machine learning assisted human fatigue detection, monitoring, and recovery. Digital Engineering, 100004. Leberruyer, N., Bruch, J., Ahlskog, M., & Afshar, S. (2023). Toward Zero Defect Manufacturing with the support of Artificial Intelligence—Insights from an industrial application. Computers in Industry, 147, 103877. Lerman, S. E., Eskin, E., Flower, D. J., George, E. C., Gerson, B., Hartenbaum, N., ... & Moore-Ede, M. (2012). Fatigue risk management in the workplace. Journal of occupational and environmental medicine, 54(2), 231-258. Mao, Z., Zhang, J., Fang, K., Huang, D., & Sun, Y. (2023). Balancing U-type assembly lines with human–robot collaboration. Computers & Operations Research, 159, 106359. Melamed, S., Kushnir, T., & Shirom, A. (1992). Burnout and risk factors for cardiovascular diseases. Behavioral medicine, 18(2), 53-60. Melamed, S., Shirom, A., Toker, S., Berliner, S., & Shapira, I. (2006). Burnout and risk of cardiovascular disease: evidence, possible causal paths, and promising research directions. Psychological bulletin, 132(3), 327. Moshawrab, M., Adda, M., Bouzouane, A., Ibrahim, H., & Raad, A. (2022). Smart wearables for the detection of occupational physical fatigue: A literature review. Sensors, 22(19), 7472. Mousavi, S. A., & Selmic, R. (2023). Wearable smart rings for multi-finger gesture recognition using supervised learning. IEEE Transactions on Instrumentation and Measurement. Papoutsakis, K., Papadopoulos, G., Maniadakis, M., Papadopoulos, T., Lourakis, M., Pateraki, M., & Varlamis, I. (2022). Detection of physical strain and fatigue in industrial environments using visual and non-visual low-cost sensors. Technologies, 10(2), 42. Paredes-Astudillo, Y. A., Moreno, D., Vargas, A. M., Angel, M. A., Perez, S., Jimenez, J. F., ... & Trentesaux, D. (2020, September). Human fatigue aware cyber-physical Production system. In 2020 IEEE International Conference on Human-Machine Systems (ICHMS) (pp. 1-6). IEEE. Pilati, F., Sbaragli, A., Tomelleri, F., Picariello, E., Picariello, F., Tudosa, I., & Nardello, M. (2023, June). Operator 5.0: Enhancing the Physical Resilience of Workers in Assembly Lines. In 2023 IEEE International Workshop on Metrology for Industry 4.0 & IoT (MetroInd4. 0&IoT) (pp. 177-182). IEEE. Samanta, D., Shivamurthaiah, M., Kumar, P., Umesh, D., & Siddalingappa, K. (2020). Wireless sensor networks model for monitoring system based on iot. Solid State Technology, 63(5), 1102-1106. Sarkar, S., Vinay, S., Raj, R., Maiti, J., & Mitra, P. (2019). Application of optimized machine learning techniques for prediction of occupational accidents. Computers & Operations Research, 106, 210-224. Shukla, G. P., Panday, P., & Pant, S. C. (2025). Workplace Wearable Technologies and Their Usage in Worker Productivity, Safety, and Health. In Technological Enhancements for Improving Employee Performance, Safety, and Well-Being (pp. 131-144). IGI Global. Tadesse, S., & Israel, D. (2016). Occupational injuries among building construction workers in Addis Ababa, Ethiopia. Journal of Occupational Medicine and Toxicology, 11, 1-6. UZUN, Y., & DUNDAR, O. (2021). Raspberry Pi and Models. Programmable Smart Microcontroller Cards, 34. Van der Hulst, M. (2003). Long workhours and health. Scandinavian journal of work, environment & health, 171-188. Verna, E., Puttero, S., Genta, G., & Galetto, M. (2024). Toward a concept of digital twin for monitoring assembly and disassembly processes. Quality Engineering, 36(3), 453-470. Wang, B., & Wang, Y. (2021). Big data in safety management: an overview. Safety science, 143, 105414. Yi, Y., Zhang, H., Zhang, W., Yuan, Y., & Li, C. (2023). Fatigue working detection based on facial multifeature fusion. IEEE Sensors Journal, 23(6), 5956-5961.