Monday, April 01, 2019

Event-based Face Detection

Neuromorphic Vision paper claims that event-based sensors can detect faces with much lower power: "High Speed Event-based Face Detection and Tracking in the Blink of an Eye" by Gregor Lenz, Sio-Hoi Ieng, and Ryad Benosman.

"We present the first purely event-based method for face detection using the high temporal resolution of an event-based camera. We will rely on a new feature that has never been used for such a task that relies on detecting eye blinks. Eye blinks are a unique natural dynamic signature of human faces that is captured well by event-based sensors that rely on relative changes of luminance. Although an eye blink can be captured with conventional cameras, we will show that the dynamics of eye blinks combined with the fact that two eyes act simultaneously allows to derive a robust methodology for face detection at a low computational cost. We show that eye blinks have a unique temporal signature over time that can be easily detected by correlating the acquired local activity with a generic temporal model of eye blinks that has been generated from a wide population of users. We show that once the face is reliably detected it is possible to apply a probabilistic framework to track the spatial position of a face for each incoming event while updating the position of trackers. Results are shown for several indoor and outdoor experiments. We will also release an annotated data set that can be used for future work on the topic."

2 comments:

  1. Incredible how bad it is.

    ReplyDelete
  2. What do you mean by bad? Bad resolution? Bad image? Bad latency? Bad what? Remember that this kind of sensors are not made for humans, the output does not need to be nice-looking. They are made for algorithms, as long as the algos work better (faster, lower power, lower latency, etc.) then it is "good".

    ReplyDelete

All comments are moderated to avoid spam and personal attacks.