Low-power always-on camera has gesture recognition

12th August 2016
Posted By : Enaie Azambuja
Low-power always-on camera has gesture recognition

Smart devices that wake up with voice commands have gained popularity in recent years, and now researchers at Georgia Institute of Technology have taken it one step farther: an always-on camera. Designed with a combination of low-power hardware and energy efficient image processing software, the always-on camera is capable of watching for specific types of movement without draining batteries or running up electricity bills.

“Right now cameras are very hard to run on passive power just because they burn so much power themselves,” said Justin Romberg, a professor in Georgia Tech’s School of Electrical and Computer Engineering.

“This combination of efficient signal processing and a novel hardware design lowers the power requirement and means that some of these other options to power it might be open.”

The research, which was highlighted at the International Symposium on Low Power Electronics and Design Aug. 8-10, was sponsored by Intel Corp. and the National Science Foundation.

While reducing the frame rate of a camera plays a role in lowering power demands, to achieve the power savings needed for this project, the researchers programmed the camera to track motion in a more generalised way that still preserved crucial details about what was being tracked.

That requires much less power to process than tracking individual pixels throughout the entire field of view.

“What this camera is actually looking at is not pixel values, but pixels added together in all different ways and a dramatically smaller number of measurements than if you had it in a standard mode,” Romberg said.

The always-on camera was primarily designed as a way to wake up devices. But its ability to recognise specific gestures expands the possibilities – such as a camera that wakes up with a specific pattern or movement almost like a secret handshake.

“We wanted to devise a camera that was capturing images all of the time, and then once you have a particular gesture – like you write a Z in the air – it’s going to wake up,” said Arijit Raychowdhury, an associate professor in the School of Electrical and Computer Engineering.

“To make that work without affecting the battery life, we wanted it to be so low power that you can power it with harvested ambient energy, such as with a photovoltaic cell.”

Programming a camera to recognise specific gestures and wake up only when needed is also a way of conserving total system energy, Raychowdhury said.

"Simple motion detection is a well-studied area of research, and there are commercial products that support motion detection,” he said. “But the problem is that a camera that can just detect motion – and not specific patterns in motion or gestures – is going to wake up more often, even when it doesn’t need to.”

Such a low-power camera could be useful in a range of applications, especially for camera systems in remote locations where efficiency is crucial.

“If you have a camera in the field, you want them to use as little energy as possible and only record events when necessary,” Romberg said.

Other applications include specialised surveillance, robotics and consumer electronics with hands-free operation, and the researchers are already working on adding wireless functionality to transmit images and data with an antenna.


You must be logged in to comment

Write a comment

No comments




Sign up to view our publications

Sign up

Sign up to view our downloads

Sign up

Startups Magazine Launch Party: Financing a Startup
24th July 2018
United Kingdom WeWork Waterhouse Square, London
European Microwave Week 2018
23rd September 2018
Spain Ifema Feria De Madrid
IoT Solutions World Congress 2018
16th October 2018
Spain Barcelona
Engineering Design Show 2018
17th October 2018
United Kingdom Ricoh Arena, Coventry
Maintec 2018
6th November 2018
United Kingdom NEC, Birmingham