Published February 28, 2022 | Version v1
Dataset Open

VRU Trajectory Dataset

  • 1. University of Applied Sciences Aschaffenburg
  • 2. University of Kassel
  • 3. University of Passau

Description

VRUT_Dataset_complete.tar.gz :

The VRU Trajectory Dataset consists of 1068 pedestrian and 464 cyclist trajectories recorded at an urban intersection using cameras and LiDARs. A detailed description of the intersection can be found in [1]. The pedestrian trajectories were recorded by using a wide angle stereo camera system to track the pedestrians' head position and generating the 3D position by triangulation. The cyclists trajectories were recorded by using LiDARs to track the center of gravity of the cyclists. The cameras operate at 50 Hz, the LiDARs at 12.5 Hz. The dataset partly results from the projects DeCoInt² [2] funded by the "German Reasearch Foundation" (DFG) and AFUSS funded by the "Bundesministerium für Bildung und Forschung" (BMBF). Additionally, our work is supported by "Zentrum Digitalisierung Bayern".

Dataset Format:

The complete dataset consists of 1532 files in csv format, where every file contains one VRU trajectory. A csv file consists of 4 columns:

  • ID: Measurement IDs
  • timestamp: Timestamp in seconds
  • x: position in x-direction in meter
  • y: position in y-direction in meter
     

extended_cyclist_dataset.7z :

To create the Extended Cyclist Trajectory Dataset, we changed the camera lenses to capture a wider filed of view enclosing the bike lane. The dataset currently consists of 1 746 cyclist trajectories including motion primitive labels. The motion primitve labels include the classes wait, which starts at the last visbible movement of the bicycle wheel and ends the first visible bicycle wheel, starting movement, which is the frame of the first visible movement of the cyclist before the end of wait, tr/tl (turn left, turn right), which start at the first and end at the last visible turning movement of the cyclist, and hand signal left/right, which start at the first and end at the last visible frame of the hand signal.

Dataset Format

The dataset consists of 1746 files in json format, where every file contains one cyclist trajectory.

A json file is structured as follows:

{"vru_type": "bike",
  "trajectory2: [{"Timestamp": [LIST OF UTC TIMESTAMPS],
                           "x": [LIST OF X POSISTIONS],
                           "y": [LIST OF Y POSISTIONS],
                           "z": [LIST OF Z POSISTIONS],
                           "x_smoothed": [LIST OF SMOOTHED X POSISTIONS],
                           "y_smoothed": [LIST OF SMOOTHED Y POSISTIONS],
                           "z_smoothed": [LIST OF SMOOTHED Z POSISTIONS]}],
  "motion_primitives": {"mp_labels":
          [{"mp_label": LABEL NAME,
             "start_time": START UTC TIMESTAMP,
             "end_time": END UTC TIMESTAMP, ...}, ...]}}

cyclist_starting_dataset.zip:

The complete dataset is stored in csv format. It contains the sensor data and the corresponding label. The sensor data csv file consists of 19 columns:

The data is split into meta data and payload data. The meta data contains the fields identifying
an experiment, i.e., ExperimentID, SceneID, VRUID. Additionally, the Timestamp field is used to identify the corresponding sensor readings.

  • ExperimentID: meta data, identifies each different experiment
  • SceneID: meta data
  • VRUID: meta data, identifier for test subject
  • Timestamp: meta data, Timestamp, starting at 0 for each separate experiment

An experiment always contains one VRU but it may consist of several scenes, i.e., starting movements. In the following the fields containing the sensor values are described.

  • Accelerometer_x: Acceleration force along the x axis (including gravity), in m/s²
  • Accelerometer_y: Acceleration force along the y axis (including gravity), in m/s²
  • Accelerometer_z: Acceleration force along the z axis (including gravity), in m/s²
  • Linear_Accelerometer_x: Acceleration force along the x axis (excluding gravity), in m/s²
  • Linear_Accelerometer_y: Acceleration force along the y axis (excluding gravity), in m/s²
  • Linear_Accelerometer_z: Acceleration force along the z axis (excluding gravity), in m/s²
  • Gyroscope_x: Rate of rotation around the x axis, in rad/s
  • Gyroscope_y: Rate of rotation around the y axis, in rad/s
  • Gyroscope_z: Rate of rotation around the z axis, in rad/s
  • Rotation_w: Scalar component of the rotation vector
  • Rotation_x: Rotation vector component along the x axis, unitless
  • Rotation_y: Rotation vector component along the y axis, unitless
  • Rotation_z: Rotation vector component along the z axis, unitless
  • target: indicates the label. Nothing = no label, 0 = waiting, 1 = starting_movement, 2 = starting

 

This work results from the project DeCoInt 2, supported by the German Research Foundation (DFG) within the priority program SPP 1835: "Kooperativ interagierende Automobile", grant numbers DO 1186/1-2, FU 1005/1-2, and SI 674/11-2. Additionally, the work is supported by "Zentrum Digitalisierung Bayern".

References

[1] M. Goldhammer, E. Strigel, D. Meissner, U. Brunsmann, K. Doll and K. Dietmayer, "Cooperative multi sensor network for traffic safety applications at intersections," 2012 15th International IEEE Conference on Intelligent Transportation Systems, Anchorage, AK, 2012, pp. 1178-1183. doi: 10.1109/ITSC.2012.6338672
[2] M. Bieshaar, G. Reitberger, S. Zernetsch, B. Sick, E. Fuchs and K. Doll, "Detecting Intentions of Vulnerable Road Users Based on Collective Intelligence", AAET – Automatisiertes und vernetztes Fahren, Braunschweig, pp. 67-87, Available: https://www.its-mobility.de/download/AAET/Dokumentation/AAET_2017_Tagungsband_Download.pdf
[3] M. Bieshaar, S. Zernetsch, A. Hubert, B. Sick, and K. Doll. Cooperative starting movement detection of cyclists using convolutional neural networks and a boosted stacking ensemble. CoRR, abs/1803.03487, 2018.

Files

cyclist_starting_dataset.zip

Files (73.3 MB)

Name Size Download all
md5:f128528da0bde30ae61d7cbd6c5e2a55
19.7 MB Preview Download
md5:2e260aad17dafb108c3d2bc4b709601c
49.2 MB Download
md5:9ed4734e7af7e3616ddf6bf62e45394f
4.5 MB Download