OpenPack: Public multi-modal dataset for packaging work recognition in logistics domain

OpenPack is an open access logistics-dataset for human activity recognition, which contains human movement and package information from 10 experienced subjects in two scenarios. The package information includes the size and number of items included in each packaging job. Human movement information is subdivided into three types of data, acceleration, physiological, and depth-sensing.

In the "Humanware laboratory" at IST Osaka University, with the supervision of industrial engineers, an experiment to mimic logistic center labor was designed. Workers with previous packaging experience performed a set of packaging tasks according to an instruction manual from a real-life logistics center. During the two experiments, subjects were recorded while performing packing operations using Lidar, Kinect, and Realsense depth sensors while also wearing 4 IMU devices and 2 Empatica E4 wearable sensors. Besides sensor data, this dataset contains timestamp information collected from the handy terminal used to register product, packet, and address label codes.

Each of the subjects performed 20 packing jobs in 5 separate sessions for a total of 100 packing jobs. Approximately 50 hours of packaging operations have been labeled into 10 global operation classes and 16 action classes for this dataset. Action classes are not unique to each operation but may only appear in one or two operations. 

We are hosting an activity recognition competition, using this dataset (OpenPack v0.3.x) at a PerCom 2023 Workshop! The task is very simple: Recognize 10 work operations from the OpenPack dataset. Please visit our website and check the details. https://open-pack.github.io/challenge2022

Tutorial Dataset (Updated: 2023-03-29)

In this repository (Full Dataset), the data and label files are contained in separate files, we have received many comments that it was difficult to combine them. Therefore, for tutorial purposes, we have created a number of CSV files containing the four IMU's sensor data and the operation labels. Before downloading the "Full Dataset", please check the contents of the data in this CSV file.

Please access Google Drive from the following URL and download the files. Please be aware some operation labels have been slightly changed from those on version (v0.3.1) to correct annotation errors. We plan to integrate the data distribution location into zenodo for the next release.

Tutorial (ATR & Operation Label)

• Google Drive - Sample - Tutorial CSV.

Work is continuously being done to update and improve this dataset. When downloading and using this dataset please verify that the version is up to date with the latest release. The latest release [0.3.1] was uploaded on 17/10/2022. You can find information on how to use this dataset at https://github.com/open-pack/openpack-toolkit.