OpenPack: Public multi-modal dataset for packaging work recognition in logistics domain

OpenPack is an open access logistics-dataset for human activity recognition, which contains human movement and package information from 10 subjects in four scenarios. Human movement information is subdivided into three types of data, acceleration, physiological, and depth-sensing. The package information includes the size and number of items included in each packaging job. 

In the "Humanware laboratory" at IST Osaka University, with the supervision of industrial engineers, an experiment to mimic logistic center labor was designed. Workers with previous packaging experience performed a set of packaging tasks according to an instruction manual from a real-life logistics center. During the different scenarios, subjects were recorded while performing packing operations using Lidar, Kinect, and Realsense depth sensors while also wearing 4 IMU devices and 2 Empatica E4 wearable sensors. Besides sensor data, this dataset contains timestamp information collected from the handy terminal used to register product, packet, and address label codes as well as package details that can be useful to relate operations to specific packages.

The 4 different scenarios include; sequential packing, mixed items collection, pre-ordered items, and time-sensitive stressors. Each of the subjects performed 20 packing jobs in a total of 5 work sessions for a total of 100 packing jobs. Approximately 50 hours of packaging operations have been labeled into 10 global operation classes and 16 sub-action classes for this dataset. Action classes are not unique to each operation but may only appear in one or two operations. 

Tutorial Dataset -> Preprocessed Dataset (IMU with Operation Labels)

In this repository (Full Dataset), the data and label files are contained in separate files, we have received many comments that it was difficult to combine them. Therefore, for tutorial purposes, we have created a number of CSV files containing the four IMU's sensor data and the operation labels. These files are now included in this version as "preprocessed-IMU-with-operation-labels.zip". 

NOTE: Please be aware some operation labels have been slightly changed from those on version (v0.3.2) to correct annotation errors.

Work is continuously being done to update and improve this dataset. When downloading and using this dataset please verify that the version is up to date with the latest release. The latest release [1.0.0] was uploaded on 14/07/2022. You can find information on how to use this dataset at: https://open-pack.github.io/ 

We hosted an activity recognition competition using this dataset (OpenPack v0.3.x) awarded at a PerCom 2023 Workshop! The task was very simple: Recognize 10 work operations from the OpenPack dataset. You can refer to this website for coding materials relevant to this dataset. https://open-pack.github.io/challenge2022