Published July 15, 2026 | Version v1.0.0

Source Code for "Driver Distraction Detection using a Perspective-Integrated Multi-Task and Multi-Expert Learning Framework"

  • 1. ROR icon Erciyes University

Description

Driver distraction is a leading cause of traffic accidents worldwide, making reliable driver monitoring essential for intelligent transportation systems. However, most deep learning-based approaches rely on a single camera perspective, which reduces robustness under occlusion, a limited field of view, and varying illumination. This study proposes PIMENet, a Perspective-Integrated Multi-Expert Network that formulates multi-perspective driver distraction detection as a perspective-aware expert-routing problem.  Instead of applying late fusion to independently trained classifiers, PIMENet introduces a Perspective-Aware Multi-Gate Mixture-of-Experts (PA-MMoE) module that organizes experts according to semantic visual perspectives. The framework defines unimodal experts for body, face, and hand perspectives, as well as pairwise experts for body-face, body-hand, and face-hand interactions. Task-conditioned attention gates dynamically route each perspective-specific task through the most relevant experts, while impartial multi-task learning promotes balanced optimization across tasks. In addition, a parameter-efficient ConvFormer encoder, developed by replacing the final stage of ConvNeXt with PoolFormer blocks, reduces model complexity while improving classification performance. Under a strict driver-independent evaluation protocol, PIMENet achieves 97.01% accuracy on the 10-class 3PDD dataset and up to 89.90% accuracy on the more challenging 22-class 100-Driver dataset, demonstrating highly competitive performance in multi-perspective driver distraction detection. Deployment profiling on an NVIDIA Jetson Xavier platform further indicates that the proposed framework is feasible for decision-level in-vehicle monitoring. These findings suggest that PIMENet can support more reliable driver monitoring systems and contribute to safer intelligent transportation applications.

Files

CHANGELOG.md

Files (209.7 kB)

Name Size
md5:85e20d9d736fbf7f8544be7e073dd426
358 Bytes Download
md5:3e558aa7739b97d4c3c0a2334dd00a4f
38 Bytes Download
md5:023823fff246f0d7862d39ffad43eea4
6.7 kB Download
md5:9038f20a7f327f22bd3382c35451ed06
2.1 kB Download
md5:3895505b425c0c74838deb5738cf0f09
1.0 kB Preview Download
md5:b54a1d744c395c3d60be15c0a51c95cc
515 Bytes Preview Download
md5:58617eeee307dcd09b3a6d61322b9676
215 Bytes Preview Download
md5:fa65f3b668e0432d88fdea60fe687201
13.4 kB Download
md5:58c18683832d91bf60240267403f472e
19.8 kB Download
md5:a3369bce6057a1b01732815679e6a180
9.0 kB Download
md5:7dc3a85ad6be307d1642f1b4364b9a0e
9.7 kB Download
md5:393427a9a626cc949fa144342eb99646
16.3 kB Download
md5:b38958dbe619e922e725d08625207bc0
4.3 kB Download
md5:d70a91b039f124f0e8c697f5d25e5e90
2.2 kB Download
md5:ed64923301e9b458694c291c9abccac8
2.2 kB Download
md5:29931a83d52e91567445db065f243686
5.6 kB Download
md5:26ea393caa372650e9410d5bdf5ebee8
3.7 kB Download
md5:7ceecbbb57a5c3ea1941ac3cc3a8bbb2
7.5 kB Download
md5:0eed3860fa23a4495edb327db84f2b81
1.1 kB Download
md5:f775e172a7eb20d1a4a0d3694c23e4fd
5.3 kB Download
md5:55e3e7891b0cb2ce2287fd48bbf8244b
2.7 kB Download
md5:5142d102e493cf353ab3b6bad7ed54b1
5.1 kB Download
md5:878b09896ef1e120125c72b754b6ab5c
7.9 kB Download
md5:4db202dd4508e1b05e2cb0d2af7ea5ef
585 Bytes Download
md5:3d083c96b0f9e95b5e95da738d01d6d2
6.9 kB Download
md5:c9af23262a6b03e9ca21049a5a4d77b4
3.7 kB Download
md5:a48699191f05873e24860141a94d0117
2.6 kB Download
md5:976af39821b7c16d30c73530315a5bdc
8.4 kB Preview Download
md5:cc6848b892c240d94cea44fb0b7a413a
4.9 kB Preview Download
md5:6d68f774a6cde91cf2e2d2e1f51dc74a
93 Bytes Preview Download
md5:d8dd59bca032410aa706566d1383ed1b
2.6 kB Download
md5:3b12ee2304cf7347b52cfcf671f0be99
5.5 kB Download
md5:f6185ed5106bef863b92519e7aa24603
18.8 kB Download
md5:dd91849db110922b398cddf553bf9725
10.5 kB Download
md5:0253b54b6cd0fb4f88fc179ea1d7d8ee
8.9 kB Download
md5:9a9cd25e75da4039f7e6c858927522f2
9.7 kB Download

Additional details

Related works

Is identical to
Software: 10.24433/CO.9751386.v1 (DOI)
Is supplemented by
Journal article: 10.1038/s41598-026-68138-w (DOI)

Funding

Scientific and Technological Research Council of Turkey
124E762
Erciyes University
FDK-2023-13350

Software

Repository URL
https://github.com/azizoglu/pimenet-driver-distraction
Programming language
Python
Development Status
Active