Source Code for "Driver Distraction Detection using a Perspective-Integrated Multi-Task and Multi-Expert Learning Framework"
Authors/Creators
Description
Driver distraction is a leading cause of traffic accidents worldwide, making reliable driver monitoring essential for intelligent transportation systems. However, most deep learning-based approaches rely on a single camera perspective, which reduces robustness under occlusion, a limited field of view, and varying illumination. This study proposes PIMENet, a Perspective-Integrated Multi-Expert Network that formulates multi-perspective driver distraction detection as a perspective-aware expert-routing problem. Instead of applying late fusion to independently trained classifiers, PIMENet introduces a Perspective-Aware Multi-Gate Mixture-of-Experts (PA-MMoE) module that organizes experts according to semantic visual perspectives. The framework defines unimodal experts for body, face, and hand perspectives, as well as pairwise experts for body-face, body-hand, and face-hand interactions. Task-conditioned attention gates dynamically route each perspective-specific task through the most relevant experts, while impartial multi-task learning promotes balanced optimization across tasks. In addition, a parameter-efficient ConvFormer encoder, developed by replacing the final stage of ConvNeXt with PoolFormer blocks, reduces model complexity while improving classification performance. Under a strict driver-independent evaluation protocol, PIMENet achieves 97.01% accuracy on the 10-class 3PDD dataset and up to 89.90% accuracy on the more challenging 22-class 100-Driver dataset, demonstrating highly competitive performance in multi-perspective driver distraction detection. Deployment profiling on an NVIDIA Jetson Xavier platform further indicates that the proposed framework is feasible for decision-level in-vehicle monitoring. These findings suggest that PIMENet can support more reliable driver monitoring systems and contribute to safer intelligent transportation applications.
Files
CHANGELOG.md
Files
(209.7 kB)
| Name | Size | |
|---|---|---|
|
md5:85e20d9d736fbf7f8544be7e073dd426
|
358 Bytes | Download |
|
md5:3e558aa7739b97d4c3c0a2334dd00a4f
|
38 Bytes | Download |
|
md5:023823fff246f0d7862d39ffad43eea4
|
6.7 kB | Download |
|
md5:9038f20a7f327f22bd3382c35451ed06
|
2.1 kB | Download |
|
md5:3895505b425c0c74838deb5738cf0f09
|
1.0 kB | Preview Download |
|
md5:b54a1d744c395c3d60be15c0a51c95cc
|
515 Bytes | Preview Download |
|
md5:58617eeee307dcd09b3a6d61322b9676
|
215 Bytes | Preview Download |
|
md5:fa65f3b668e0432d88fdea60fe687201
|
13.4 kB | Download |
|
md5:58c18683832d91bf60240267403f472e
|
19.8 kB | Download |
|
md5:a3369bce6057a1b01732815679e6a180
|
9.0 kB | Download |
|
md5:7dc3a85ad6be307d1642f1b4364b9a0e
|
9.7 kB | Download |
|
md5:393427a9a626cc949fa144342eb99646
|
16.3 kB | Download |
|
md5:b38958dbe619e922e725d08625207bc0
|
4.3 kB | Download |
|
md5:d70a91b039f124f0e8c697f5d25e5e90
|
2.2 kB | Download |
|
md5:ed64923301e9b458694c291c9abccac8
|
2.2 kB | Download |
|
md5:29931a83d52e91567445db065f243686
|
5.6 kB | Download |
|
md5:26ea393caa372650e9410d5bdf5ebee8
|
3.7 kB | Download |
|
md5:7ceecbbb57a5c3ea1941ac3cc3a8bbb2
|
7.5 kB | Download |
|
md5:0eed3860fa23a4495edb327db84f2b81
|
1.1 kB | Download |
|
md5:f775e172a7eb20d1a4a0d3694c23e4fd
|
5.3 kB | Download |
|
md5:55e3e7891b0cb2ce2287fd48bbf8244b
|
2.7 kB | Download |
|
md5:5142d102e493cf353ab3b6bad7ed54b1
|
5.1 kB | Download |
|
md5:878b09896ef1e120125c72b754b6ab5c
|
7.9 kB | Download |
|
md5:4db202dd4508e1b05e2cb0d2af7ea5ef
|
585 Bytes | Download |
|
md5:3d083c96b0f9e95b5e95da738d01d6d2
|
6.9 kB | Download |
|
md5:c9af23262a6b03e9ca21049a5a4d77b4
|
3.7 kB | Download |
|
md5:a48699191f05873e24860141a94d0117
|
2.6 kB | Download |
|
md5:976af39821b7c16d30c73530315a5bdc
|
8.4 kB | Preview Download |
|
md5:cc6848b892c240d94cea44fb0b7a413a
|
4.9 kB | Preview Download |
|
md5:6d68f774a6cde91cf2e2d2e1f51dc74a
|
93 Bytes | Preview Download |
|
md5:d8dd59bca032410aa706566d1383ed1b
|
2.6 kB | Download |
|
md5:3b12ee2304cf7347b52cfcf671f0be99
|
5.5 kB | Download |
|
md5:f6185ed5106bef863b92519e7aa24603
|
18.8 kB | Download |
|
md5:dd91849db110922b398cddf553bf9725
|
10.5 kB | Download |
|
md5:0253b54b6cd0fb4f88fc179ea1d7d8ee
|
8.9 kB | Download |
|
md5:9a9cd25e75da4039f7e6c858927522f2
|
9.7 kB | Download |
Additional details
Related works
- Is identical to
- Software: 10.24433/CO.9751386.v1 (DOI)
- Is supplemented by
- Journal article: 10.1038/s41598-026-68138-w (DOI)
Funding
- Scientific and Technological Research Council of Turkey
- 124E762
- Erciyes University
- FDK-2023-13350
Software
- Repository URL
- https://github.com/azizoglu/pimenet-driver-distraction
- Programming language
- Python
- Development Status
- Active