Sonar Technology Tracks Body Movements in 3D

PoseSonic is the latest sonar-equipped wearable from Cornell University’s SciFi lab.

Image credits: Saif Mahmud (Cornell University)

A variation of sonar technology – in miniature form, developed by Cornell University researchers – is proving a game-changer in wearable body-sensing technology.

PoseSonic consists of off-the-shelf eyeglasses outfitted with micro sonar that can track the wearer’s upper body movements in 3D through a combination of inaudible sound waves and artificial intelligence (AI). With further development, researchers believe it could enhance augmented reality (AR) and virtual reality (VR) and track detailed physical and behavioral data for personal health, reports EurekaAlert.

“We’re the first research group using inaudible acoustics and AI to track body poses through a wearable device,” said Cheng Zhang, assistant professor of information science. “By integrating cutting-edge AI into low-power, low-cost, and privacy-conscious acoustic sensing systems, we use less instrumentation on the body, which is more practical, and battery performance is significantly better for everyday use.”

PoseSonic has two pairs of tiny microphones and speakers – each about the diameter of a pencil – attached to the hinges of eyeglasses. The speakers emit inaudible sound waves that bounce off the upper body and back up to the microphones, generating an echo profile image. This image is then fed into PoseSonic’s machine-learning algorithm, which estimates the body pose with near-perfect accuracy. And unlike other data-driven, wearable pose-tracking systems, PoseSonic functions well without an initial training session with the user, the researchers said.

Read more: Wearable Utilizes Temperature for Wellness Applications

The system can estimate body movements made at nine body joints, including the shoulders, elbows, wrists, hips, and nose, which is useful to estimate head positioning, researchers mentioned.

The technology is a major step up from existing wearable devices that often require a mini video camera, which isn’t always practical. Current wearables with video cameras also require significant battery power, the researchers said. Acoustic sensing requires minimal power – 10 times less than a wearable camera. Because of this, the technology makes for a much smaller and unobtrusive wearable.

Further, there’s much less privacy risk with sonar. “A wearable video camera poses privacy risks for anyone in the wearer’s vicinity,” said Saif Mahmud, a doctoral student in the field of information science. “Our solution: Let’s put a little inaudible acoustic field around us that can track our body’s movement while also respecting other people’s privacy.”

This research is supported by the National Science Foundation.

January 4, 2024

Innovation of the Month

Do you want to discover more, visit the website
Visit Website

Other news

Apple Watch’s AFib Tool Gets FDA Approval

Apple Watch’s Atrial Fibrillation (AFib) detection feature.

Facedrive Contributing to VMware’s Open-Source Protocol to Stop the Spread of COVID-19

Facedrive Health, the developer of TraceSCAN, is contributing to Herald – an open-source project...

Microfiber, Nanofiber-Based Wearables Can Track Your Heart Rate, Blood Pressure, and More

In the near future, microfiber- and nanofiber-based technology may be used to monitor your blood...

Pixee Medical Successfully Finishes its First Total Knee Replacement Surgery Guided Only by the Vuzix M400 AR Glasses

Vuzix announced that Pixee Medical, a France-based medical company, in collaboration with Dr...
Discover more