Published September 12, 2022 | Version v1
Poster Open

TS-Rep:Self-supervised time series representation learning for robot sensor data

  • 1. University of Lincoln
  • 2. Toshiba Research


 In this work, we present TS-Rep, a self-supervised method that learns representations from multi-modal varying-length time series sensor data from real robots. TS-Rep is based on a simple yet effective technique for triplet learning, where we randomly split the time series into two segments to form anchor and positive while selecting random subseries from the other time series in the mini-batch to construct negatives. We additionally use the nearest neighbour in the representation space to increase the diversity in the positives. For evaluation, we perform a clusterability analysis on representations of three heterogeneous robotics datasets. Then learned representations are applied for anomaly detection, and our method consistently performs well. A classifier trained on TS-Rep learned representations outperforms unsupervised methods and performs close to the fully-supervised methods for terrain classification. Furthermore, we show that TS-Rep is, on average, the fastest method to train among the baselines.



Files (2.7 MB)

Name Size Download all
2.7 MB Preview Download

Additional details


BACCHUS – MoBile Robotic PlAtforms for ACtive InspeCtion and Harvesting in AgricUltural AreaS 871704
European Commission