Skip to content

News Center | Georgia Institute of Technology Georgia Institute of Technology

Search

Search form

  • Facebook
  • Twitter
  • YouTube
  • LinkedIn
  • News Home
  • Campus Map
  • Directory
  • Offices

News Center

Menu
Close
  • Calendar
  • Categories
    • Business and Economic Development
    • Campus and Community
    • Earth and Environment
    • Health and Medicine
    • Science and Technology
    • Society and Culture
    • Feature Stories
  • Media Contacts
  • Experts
    • Find an Expert
    • Featured Expert
  • Daily Digest
  • The Whistle
    • Home
    • Classifieds
    • Archives
  • Social Media
  • Subscribe
  • You are here:
  • GT Home
  • Georgia Tech NewsCenter
  • Home
  • Wearable Ring, Wristband Allow Users to Control Smart Tech With Hand Gestures

Health and Medicine Science and Technology

Wearable Ring, Wristband Allow Users to Control Smart Tech With Hand Gestures

By David Mitchell | May 11, 2018 • Atlanta, GA

The FingerPoint system can recognize hand poses using the 12 bones of the fingers and digits ‘1’ through ‘10’ in American Sign Language (ASL).

New technology created by a team of Georgia Tech researchers could make controlling text or other mobile applications as simple as “1-2-3.”

Using acoustic chirps emitted from a ring and received by a wristband, like a smartwatch, the system is able to recognize 22 different micro finger gestures that could be programmed to various commands — including a T9 keyboard interface, a set of numbers, or application commands like playing or stopping music.

A video demonstration of the technology shows how, at a high rate of accuracy, the system can recognize hand poses using the 12 bones of the fingers and digits ‘1’ through ‘10’ in American Sign Language (ASL).

“Some interaction is not socially appropriate,” said Cheng Zhang, the Ph.D. student in the School of Interactive Computing who led the effort. “A wearable is always on you, so you should have the ability to interact through that wearable at any time in an appropriate and discreet fashion. When we’re talking, I can still make some quick reply that doesn’t interrupt our interaction.”

Since one of the goals was to enter digits using only one hand, the team decided to use ASL, which already has well defined hand postures for each digit. In this manner, the user might select options from a numbered list, call a phone number, or do simple calculations.

The system is called FingerPing. Unlike other technology that requires the use of a glove or a more obtrusive wearable, this technique is limited to just a thumb ring and a watch. The ring produces acoustic chirps that travel through the hand and are picked up by receivers on the watch. There are specific patterns in which sound waves travel through structures, including the hand, that can be altered by the manner in which the hand is posed. Utilizing those poses, the wearer can achieve up to 22 pre-programmed commands.

The gestures are small and non-invasive, as simple as tapping the tip of a finger or posing your hand in classic “1,” “2,” and “3” gestures.

“The receiver recognizes these tiny differences,” Zhang said. “The injected sound from the thumb will travel at different paths inside the body with different hand postures. For instance, when your hand is open there is only one direct path from the thumb to the wrist. Any time you do a gesture where you close a loop, the sound will take a different path and that will form a unique signature.”

Zhang said that the research is a proof of concept for a technique that could be expanded and improved upon in the future.

The research was presented last month at the 2018 ACM Conference on Human Factors in Computing Systems (CHI). The paper is titled FingerPing: Recognizing Fine-grained Hand Poses Using Active Acoustic On-body Sensing (Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Ruichen Meng, Sumeet Jain, Yizeng Han, Xinyu Li, Kenneth Cunefare, Thomas Ploetz, Thad Starner, Omer Inan, Gregory Abowd).

Researchers on this team, including Zhang, have worked on similar unique gesture techniques in the past. Zhang graduated from Georgia Tech in May and will join the Information Science Department at Cornell University as a tenure-track assistant professor.

Additional Photos

  • FingerPing 1
     

    FingerPing 1

    Download Image

Related Links

  • Using a Ring to Draw and Write
  • Controlling Smartwatch with Breaths and Swipes

Contact Information

David Mitchell

Communications Officer

david.mitchell@cc.gatech.edu

Categories

Health and Medicine Science and Technology

News Categories

  • Business and Economic Development
  • Campus and Community
  • Earth and Environment
  • Health and Medicine
  • Science and Technology
  • Society and Culture

Expert Voices

James Dahlman

James Dahlman is an assistant professor in the Wallace H. Coulter Department of Biomedical Engineering.

Gene therapy eyes medical breakthrough
James Dahlman
Wallace H. Coulter Department of Biomedical Engineering

Featured Videos

Seth Osekre, a custodian in Facilities Management, follows safety protocols when cleaning. (Video by Allison Carter)

2020 graduate TJ Weiler talks about his journey to earning a Georgia Tech degree.

Georgia Tech Resources

  • Offices & Departments
  • News Center
  • Campus Calendar
  • Special Events
  • GreenBuzz
  • Institute Communications
  • Visitor Resources
  • Campus Visits
  • Directions to Campus
  • Visitor Parking Information
  • GTvisitor Wireless Network Information
  • Georgia Tech Global Learning Center
  • Georgia Tech Hotel & Conference Center
  • Barnes & Noble at Georgia Tech
  • Ferst Center for the Arts
  • Robert C. Williams Paper Museum

Colleges, Instructional Sites & Research

  • Colleges
  • College of Computing
  • College of Design
  • College of Engineering
  • College of Sciences
  • Ivan Allen College of Liberal Arts
  • Scheller College of Business
  • Instructional Sites
  • Georgia Tech-Lorraine
  • Georgia Tech-Savannah
  • Georgia Tech-Shenzhen
  • Georgia Tech Online
  • Professional Education
  • The Language Institute
  • Global Footprint
  • Global Engagement
  • Research
  • Georgia Tech Research Institute
  • Research at Georgia Tech
  • Executive Vice President for Research

Student & Parent Resources

  • Student Resources
  • Apply
  • BuzzPort
  • Buzzcard
  • Career Center
  • Co-ops & Internships
  • Commencement
  • Library
  • Student Life
  • Student Entrepreneurship
  • Study Abroad
  • T-Square
  • Parent Resources
  • Parent and Family Programs
  • Dean of Students
  • Scholarships & Financial Aid

Employee, Alumni, & Other Resources

  • Employees
  • Administration and Finance
  • Advising & Teaching
  • Faculty Affairs
  • Faculty Hiring
  • Human Resources
  • Office of the Provost
  • TechWorks
  • Alumni
  • Alumni Association
  • Alumni Career Services
  • Giving Back to Tech
  • Outreach
  • Startup Companies
  • Economic Development
  • Industry Engagement
  • Government & Community Partners
  • Professional Education
Map of News Center | Georgia Institute of Technology

Georgia Institute of Technology
North Avenue, Atlanta, GA 30332
Phone: (404) 894-2000

  • Contact Us
  • Site Feedback
  • Tech Lingo
  • Emergency Information
  • Legal & Privacy Information
  • Human Trafficking Notice
  • Accessibility
  • Accountability
  • Accreditation
  • Employment
Georgia Tech

© Georgia Institute of Technology