Published January 21, 2017 | Version v1
Dataset Open

Multitask Human Navigation in VR with Motion Tracking

  • 1. Center for Perceptual Systems, The University of Texas at Austin
  • 2. Department of Computer Science, The University of Texas at Austin
  • 3. Computer Science and Engineering, University of Michigan, Ann Arbor

Description

Data from human subjects in virtual reality performing some combination of collecting targets, avoiding obstacles, and following a path. Raw data has been parsed into 300 ms samples for use in machine learning algorithms. The data includes object positions in the virtual environment, human position tracking, and task instructions. 

 

Notes

Each .mat file is the data from a single subject. The general pRes (for "parsed results") structure has length 32, one for each of 32 trials. Each trial entry has n samples, where n is the number of 300ms slices the trial is parsed into. Within each trial: * trialNum = number of current trial (practice trials and calibration rooms are omitted) * taskNum: task instructions. 1= follow path only, 2 = avoid obstacles & follow path, 3 = collect targets & follow path, 4 = targets, obstacles, & path altogether * taskName = written form of taskNum * frameNum = frame within movie * agentX = current X coord of agent * agentY = current Y coord of agent (vertical height) * agentZ = current Z coord of agent * agentAngle = current agent's orientation (yaw in room coords) * agentMoveDist = amount that subject moved in this action * agentMoveAngle = angle that subject moved in this angle (relative to agentAngle) * targ = struct for targets, include targets positions at each frame, note that once the agent encounter the object, the object will disappear (successful collection) * path = struct for path segments, way points poisitions * obst = struct for obstacles, include obstacle positions at each frame, note that once the agent encounter the object, the object will disappear The structs for the 3 object types have the following, where m is the number of objects of that type in that trial * distList = Distances for each of the objects for each of n samples (n x m) * angleList = Angles for each of the objects for each of n samples (n x m). Angles are relative to the angle of the subject. * posX, posY, posZ = X, Y, and Z positions for each of the m objects in the n sampled frames. If you want to parse the data using Python, an example is at: https://github.com/corgiTrax/Sparse-Reinforcement-Learning/blob/master/human/data/parse.py

Files

Files (197.8 MB)

Name Size Download all
md5:b9fab1174ff9d1dca9fe39fc23e1e2dc
7.0 MB Download
md5:805c371acccc20441b99a1a987583b1d
9.0 MB Download
md5:82b0f03428c76b2c6fb928fefae5b985
8.5 MB Download
md5:193ad4c12ac1e2f3ab44d634d35c2c6e
6.8 MB Download
md5:19de84ab098431bcb45bd384c60498ef
6.9 MB Download
md5:008030449885db519ae436f38d8a73e9
6.6 MB Download
md5:8b04af5c3c204cef1faf6474600559fc
7.8 MB Download
md5:99a58a9821d3c104b4383297ab96b20e
7.4 MB Download
md5:91a7fef63e96a0dda3bbf062b920bb39
8.1 MB Download
md5:92531fa0538bb9a319c9c859590e1579
7.7 MB Download
md5:6ca6785ff2f55ab804af085bf5e74075
6.8 MB Download
md5:e65244b6a382b9f82fcff9b078d06a7c
7.3 MB Download
md5:8aca8644c63c50eefb0958b326fd80e2
8.8 MB Download
md5:d149c0bd60fdf61ae18f985651110b64
6.9 MB Download
md5:4d7b6c1745bb9bfb82b32444e3555740
6.9 MB Download
md5:9abed4db7bb8ece4919beae5039a1a9f
10.2 MB Download
md5:4e5938715c384486d6061da4fbd09ac3
7.0 MB Download
md5:049c82925bffff61b2f48fb832a640fd
8.5 MB Download
md5:195498db9e3053d8dd30c906d70a5dbb
6.7 MB Download
md5:9a2f12880f6d0e04c1507a24e1f71954
6.6 MB Download
md5:e8d74db835ccdf9ce307d696935a373e
7.6 MB Download
md5:d6fac1f32c8d37e2d043f7332d5634cd
7.3 MB Download
md5:414d541d0625c726dacaad75e5311dcf
11.7 MB Download
md5:14d502b0aa8d5c511b8cc67c056c8827
11.4 MB Download
md5:09fa08062d5b6f84588a84caf3a2e7d3
8.1 MB Download