Journal article Open Access

Speed Invariant Time Surface for Learning to Detect Corner Points with Event-Based Cameras

Jacques Manderscheid; Amos Sironi; Davide Migliore; Nicolas Bourdis; Vincent Lepetit

Dublin Core Export

<?xml version='1.0' encoding='utf-8'?>
<oai_dc:dc xmlns:dc="" xmlns:oai_dc="" xmlns:xsi="" xsi:schemaLocation="">
  <dc:creator>Jacques Manderscheid</dc:creator>
  <dc:creator>Amos Sironi</dc:creator>
  <dc:creator>Davide Migliore</dc:creator>
  <dc:creator>Nicolas Bourdis</dc:creator>
  <dc:creator>Vincent Lepetit</dc:creator>
  <dc:description>We propose a learning approach to corner detection for event-based cameras that is stable even under fast and abrupt motions. Event-based cameras offer high temporal resolution, power efficiency, and high dynamic range. However, the properties of event-based data are very different compared to standard intensity images, and simple extensions of corner detection methods designed for these images do not perform well on event-based data. We first introduce an efficient way to compute a time surface that is invariant to the speed of the objects. We then show that we can train a Random Forest to recognize events generated by a moving corner from our time surface. Random Forests are also extremely efficient, and therefore a good choice to deal with the high capture frequency of event-based cameras—our implementation processes up to 1.6Mev/s on a single CPU. Thanks to our time surface formulation and this learning approach, our method is significantly more robust to abrupt changes of direction of the corners compared to previous ones. Our method also naturally assigns a confidence score for the corners, which can be useful for postprocessing. Moreover, we introduce a highresolution dataset suitable for quantitative evaluation and comparison of corner detection methods for event-based cameras. We call our approach SILC, for Speed Invariant Learned Corners, and compare it to the state-of-the-art with extensive experiments, showing better performance.</dc:description>
  <dc:subject>Speed Invariant Learned Corners</dc:subject>
  <dc:subject>Computer Vision Pattern Recognition</dc:subject>
  <dc:subject>Event-based cameras</dc:subject>
  <dc:title>Speed Invariant Time Surface for Learning to Detect Corner Points with Event-Based Cameras</dc:title>
All versions This version
Views 128128
Downloads 9494
Data volume 207.5 MB207.5 MB
Unique views 122122
Unique downloads 8989


Cite as