Skip to content

News Center | Georgia Institute of Technology Georgia Institute of Technology

Search

Search form

  • Facebook
  • Twitter
  • YouTube
  • LinkedIn
  • News Home
  • Campus Map
  • Directory
  • Offices

News Center

Menu
Close
  • Calendar
  • Categories
    • Business and Economic Development
    • Campus and Community
    • Earth and Environment
    • Health and Medicine
    • Science and Technology
    • Society and Culture
    • Feature Stories
  • Media Contacts
  • Experts
    • Find an Expert
    • Featured Expert
  • Daily Digest
  • The Whistle
    • Home
    • Classifieds
    • Archives
  • Social Media
  • Subscribe
  • You are here:
  • GT Home
  • Georgia Tech NewsCenter
  • Home
  • Your next opponent in Angry Birds could be a robot

Science and Technology

Your next opponent in Angry Birds could be a robot

Georgia Tech team pairs humanoid with popular game to help kids with rehabilitation

July 10, 2014 • Atlanta, GA

Because end users can easily program the robot to learn tasks, researchers envision the robot-smart tablet system as a future rehabilitation tool for children with cognitive and motor-skill disabilities.

With the help of a smart tablet and Angry Birds, children can now do something typically reserved for engineers and computer scientists: program a robot to learn new skills. The Georgia Institute of Technology project is designed to serve as a rehabilitation tool and to help kids with disabilities.

The researchers have paired a small humanoid robot with an Android tablet. Kids teach it how to play Angry Birds, dragging their finger on the tablet to whiz the bird across the screen. In the meantime, the robot watches what happens and records “snapshots” in its memory. The machine notices where fingers start and stop, and how the objects on the screen move according to each other, while constantly keeping an eye on the score to check for signs of success.

When it’s the robot’s turn, it mimics the child’s movements and plays the game. If the bird is a dud and doesn’t cause any damage, the robot shakes its head in disappointment. If the building topples and points increase, the eyes light up and the machine celebrates with a happy sound and dance.

“The robot is able to learn by watching because it knows how interaction with a tablet app is supposed to work,” said Georgia Tech’s Ayanna Howard, Motorola Foundation Professor in the School of Electrical and Computer Engineering who is leading the project. “It recognizes that a person touched here and ended there, then deciphers the information that is important and relevant to its progress.”

The robot analyzes the new information and provides appropriate social responses while changing its play strategy.

“One way to get robots more quickly into society is to design them to be flexible for end users,” said Hae Won Park, Howard’s postdoctoral fellow working closely on the project. “If a robot is only trained to perform a specific set of tasks and not able to learn and adapt to its owner or surroundings, its usefulness can become extremely limited.”

That flexibility is one reason Howard and Park see their robot-smart tablet system as a future rehabilitation tool for children with cognitive and motor-skill disabilities. A clinician could program the robot to cater to a child’s needs, such as turn taking or hand-eye coordination tasks, and then send the machine home.

Another benefit for rehab: parents don’t always have time or enough patience for repetitive rehabilitation sessions. But a robot never gets tired or bored.  

“Imagine that a child’s rehab requires a hundred arm movements to improve precise hand-coordination movements,” said Howard. “He or she must touch and swipe the tablet repeatedly, something that can be boring and monotonous after a while. But if a robotic friend needs help with the game, the child is more likely to take the time to teach it, even if it requires repeating the same instructions over and over again. The person’s desire to help their ‘friend’ can turn a five-minute, bland exercise into a 30-minute session they enjoy.”

In a new study, Howard and Park asked grade-school children to play Angry Birds with an adult watching nearby. Afterwards, the kids were asked to teach a robot how to play the game. The children spent an average of nine minutes with the game as the adult watched. They played nearly three times as long (26.5 minutes) with the robot. They also interacted considerably more with the robot than the person. Only 7 percent of their session with the adult included eye contact, gestures and talking. It was nearly 40 percent with the robot.

The next steps for the Georgia Tech team will include more games for the robot, including Candy Crush and ZyroSky. They will also recruit more children diagnosed with Autism Spectrum Disorder (ASD) and children with motor impairments to interact with the system. Their most recent study included two kids with ASD. Their interaction times with the adult were significantly less than those in the typically developing group. They were about the same with the robot. The findings were presented in June at the Rehabilitation Engineering and Assistive Technology Society of North America (RESNA) 2014 Annual Conference in Denver.  

This research was partially supported by the National Science Foundation (NSF) under grant 1208287. Any conclusions expressed are those of the principal investigator and may not necessarily represent the official views of the NSF.

Additional Videos

With the help of a smart tablet and Angry Birds, children can now do something typically reserved for engineers and computer scientists: program a robot to learn new skills. The Georgia Institute of Technology project is designed to serve as a rehabilitation tool and to help kids with disabilities.

Additional Photos

  • Robot Plays Angry Birds 2
     

    Robot Plays Angry Birds 2

    A robot plays Angry Birds using a tablet. Researchers see their system as a future rehabilitation tool for children with cognitive and motor-skill disabilities.

    Download Image
  • Robot Plays Angry Birds
     

    Robot Plays Angry Birds

    Hae Won Park, a postdoctoral fellow in the School of Electrical and Computing Engineering, teaches a robot how to play Angry Birds

    Download Image
  • Robot Plays Angry Birds 3
     

    Robot Plays Angry Birds 3

    Robot celebrates after successful turn in Angry Birds.

    Download Image
  • Robot Plays Angry Birds 4
     

    Robot Plays Angry Birds 4

    Postdoctoral fellow Hae Won Park (ECE) interacts with robot that can be programmed to learn new skills, including Angry Birds

    Download Image

Related Links

  • Institute for Robotics and Intelligent Machines
  • Ayanna Howard Website
  • School of Electrical and Computer Engineering

Contact Information

Jason Maderer
National Media Relations
maderer@gatech.edu
404-385-2966

Categories

Science and Technology

News Categories

  • Business and Economic Development
  • Campus and Community
  • Earth and Environment
  • Health and Medicine
  • Science and Technology
  • Society and Culture

Expert Voices

James Wray

James Wray (Photo Fitrah Hamid)

More Hints of Life on Ancient Mars
James Wray
School of Earth and Atmospheric Sciences
Mariel Borowitz

Photo by Rob Felt

Half of Earth’s satellites restrict use of climate data
Mariel Borowitz
Sam Nunn School of Int'l Affairs

Featured Videos

Seth Osekre, a custodian in Facilities Management, follows safety protocols when cleaning. (Video by Allison Carter)

2020 graduate TJ Weiler talks about his journey to earning a Georgia Tech degree.

Georgia Tech Resources

  • Offices & Departments
  • News Center
  • Campus Calendar
  • Special Events
  • GreenBuzz
  • Institute Communications
  • Visitor Resources
  • Campus Visits
  • Directions to Campus
  • Visitor Parking Information
  • GTvisitor Wireless Network Information
  • Georgia Tech Global Learning Center
  • Georgia Tech Hotel & Conference Center
  • Barnes & Noble at Georgia Tech
  • Ferst Center for the Arts
  • Robert C. Williams Paper Museum

Colleges, Instructional Sites & Research

  • Colleges
  • College of Computing
  • College of Design
  • College of Engineering
  • College of Sciences
  • Ivan Allen College of Liberal Arts
  • Scheller College of Business
  • Instructional Sites
  • Georgia Tech-Lorraine
  • Georgia Tech-Savannah
  • Georgia Tech-Shenzhen
  • Georgia Tech Online
  • Professional Education
  • The Language Institute
  • Global Footprint
  • Global Engagement
  • Research
  • Georgia Tech Research Institute
  • Research at Georgia Tech
  • Executive Vice President for Research

Student & Parent Resources

  • Student Resources
  • Apply
  • BuzzPort
  • Buzzcard
  • Career Center
  • Co-ops & Internships
  • Commencement
  • Library
  • Student Life
  • Student Entrepreneurship
  • Study Abroad
  • T-Square
  • Parent Resources
  • Parent and Family Programs
  • Dean of Students
  • Scholarships & Financial Aid

Employee, Alumni, & Other Resources

  • Employees
  • Administration and Finance
  • Advising & Teaching
  • Faculty Affairs
  • Faculty Hiring
  • Human Resources
  • Office of the Provost
  • TechWorks
  • Alumni
  • Alumni Association
  • Alumni Career Services
  • Giving Back to Tech
  • Outreach
  • Startup Companies
  • Economic Development
  • Industry Engagement
  • Government & Community Partners
  • Professional Education
Map of News Center | Georgia Institute of Technology

Georgia Institute of Technology
North Avenue, Atlanta, GA 30332
Phone: (404) 894-2000

  • Contact Us
  • Site Feedback
  • Tech Lingo
  • Emergency Information
  • Legal & Privacy Information
  • Human Trafficking Notice
  • Accessibility
  • Accountability
  • Accreditation
  • Employment
Georgia Tech

© Georgia Institute of Technology