FingerTrak Wearable 3D Hand-Sensing Wristband Could Revolutionize Activity Tracking

In a potential breakthrough in wearable sensing technology, researchers from Cornell and the Uni...

Photo credit: Assist. Prof. Cheng Zhang, Cornell University

In a potential breakthrough in wearable sensing technology, researchers from Cornell and the University of Wisconsin, Madison, have designed a wrist-mounted device that uses thermal sensors to accurately predict hand positions.

Read more: Scientists From NTU Singapore Develop AI System For High Precision Recognition of Hand Gestures

The bracelet is called FingerTrak and it incorporates four miniature, low-resolution thermal cameras. The system uses machine learning to sense and translate into 3D the many positions of the human hand, including 20 finger joint positions. It has the potential for a variety of uses including automated sign-language translation, virtual reality, human-robot interaction and other areas, the researchers said.

“This was a major discovery by our team – that by looking at your wrist contours, the technology could reconstruct in 3D, with keen accuracy, where your fingers are,” said Cheng Zhang, assistant professor of information science and director of Cornell’s new SciFi Lab, where FingerTrak was developed. “It’s the first system to reconstruct your full hand posture based on the contours of the wrist.”

Yin Li, assistant professor of biostatistics and medical informatics at the University of Wisconsin, Madison School of Medicine and Public Health, contributed to the software behind FingerTrak.

The team said the system will need a bit more refining to make it useful in various fields. It could allow VR game players to track their own hand movements or it could make for remote-controlled robots that directly mimic a human operator’s motions.

FingerTrak could also have an impact on health care applications, specifically in monitoring disorders that affect fine-motor skills, Li said.

“How we move our hands and fingers often tells about our health condition,” Li said. "A device like this might be used to better understand how the elderly use their hands in daily life, helping to detect early signs of diseases like Parkinson’s and Alzheimer’s.”

Read more: With Tap Strap 2 You Can Control Any Bluetooth-Enabled Device with Gesture

The research was published in Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies.

Sam Draper
September 2, 2020

Innovation of the Month

Do you want to discover more, visit the website
Visit Website

Other news

Smart Glove Market Is Expected To Grow On A Large Scale During Forecast Period 2019-2026

The smart glove market is expected to grow on a large scale during forecast...

The Future of Blood Pressure Monitoring Tech Might Be Wearable Devices

According to the CDC, nearly half of adults in the United States (108 million, or 45%) have...

Large U.S. Study Suggests Apple Watch Can Detect Irregular Heartbeat

Apple Watch can detect an alarming irregular heartbeat.

XREAL Launches Air 2 Series AR Glasses

XREAL launched its latest innovative AR glasses – the XREAL Air 2 Pro.
Discover more