Skip to content

News Center | Georgia Institute of Technology Georgia Institute of Technology

Search

Search form

  • Facebook
  • Twitter
  • YouTube
  • LinkedIn
  • News Home
  • Campus Map
  • Directory
  • Offices

News Center

Menu
Close
  • Calendar
  • Categories
    • Business and Economic Development
    • Campus and Community
    • Earth and Environment
    • Health and Medicine
    • Science and Technology
    • Society and Culture
    • Feature Stories
  • Media Contacts
  • Experts
    • Find an Expert
    • Featured Expert
  • Daily Digest
  • The Whistle
    • Classifieds
    • Archives
  • Social Media
  • Subscribe
  • You are here:
  • GT Home
  • Georgia Tech NewsCenter
  • Home
  • Algorithm Allows a Computer to Create a Vacation Highlight Video
Science and Technology

Algorithm Allows a Computer to Create a Vacation Highlight Video

By Tara La Bouff | March 10, 2016 • Atlanta, GA

Georgia Tech students created a computerized system that scanned 26 hours of video, selected the best clips and produced this 38-second highlight reel. The process took three hours.

Researchers at the Georgia Institute of Technology unveiled a novel video-editing solution this week that automatically sorts and edits untouched footage into the most picturesque highlights for a vacation reel that could fill anyone with envy.

The new approach is an algorithm – developed by students Daniel Castro and Vinay Bettadapura under the guidance of Professor Irfan Essa – that analyzes video for images with ideal artistic properties. It first considers geolocation, then composition, symmetry and color vibrancy to determine what is important or picturesque. Video frames with the highest scores are processed into a highlight reel. See the finished product here.

Castro and Bettadapura conceived the approach after the latter returned from a two-week vacation, driving coast-to-coast across the southern United States. He ended the trip with 26.5 hours of footage from a wearable, head-mounted camera. He had no idea what do with it.

“The data was essentially useless because there was just too much of it,” said Bettadapura, who completed his Ph.D. in the fall and now is a Google software engineer. “We liked the idea of being able to automatically generate photo albums from your vacation, algorithmically.”

The algorithm turned 26 hours of video into a 38-second highlight reel in three hours.  Because Bettadapura had worn a head-mounted Contour Action Camera that captured GPS data, the algorithm could filter by geographical location. That reduced the footage to 16 hours. Shot boundary detection further reduced it into 1,724 video shots or about 10.2 hours of video. It then processed for artistic quality and provided an output of the most picturesque content. Processing time is variable and depends on the number of computers used.

The algorithm can be adapted to user preferences.

“We can tweak the weights in our algorithm based on the user's aesthetic preferences,” Bettadapura said. “By incorporating facial recognition, we can further adapt the system to generate highlights that include people the user cares about.”

Castro and Bettadapura presented their findings at WACV 2016: IEEE’s Winter Conference on the Applications of Computer Vision, March 7 in Lake Placid, N.Y. The pair will continue to work together testing the algorithm with multiple participants to help generalize the approach, incorporate facial recognition, and develop data visualization techniques that make it easy to browse and search specific moments. The implications of future, successful tests could echo far beyond their initial work at Georgia Tech.

“This research brings together multiple modalities to more efficiently understand large amounts of data,” said Castro, who is completing his Ph.D. in computer science and also working as an intern at Google. “We are trying to optimize how easy it is to understand all of the data we have in an efficient manner because otherwise it would be impossible to do so.”

Additional Photos

  • How the Process Works
     

    How the Process Works

    A flowchart of how the process works, from examining 26 hours to video, trimming it to 20 hours, choosing the best visuals and producing the finished product.

    Download Image
  • Vinay Bettadapura
     

    Vinay Bettadapura

    Download Image

Related Links

  • School of Interactive Computing

Contact Information

Tara LaBouff
College of Computing
Marketing Communications Manager
602-770-0264

Categories

Science and Technology

News Categories

  • Business and Economic Development
  • Campus and Community
  • Earth and Environment
  • Health and Medicine
  • Science and Technology
  • Society and Culture

Expert Voices

Mariel Borowitz

Photo by Rob Felt

Half of Earth’s satellites restrict use of climate data
Mariel Borowitz
Sam Nunn School of Int'l Affairs
Benjamin Klein
Holograms: How Do They Work?
Benjamin Klein
School of Electrical and Computer Engineering

Featured Videos

Cybersecurity experts have a new tool in the fight against hackers – a decoy robot. Researchers at Georgia Tech built the “HoneyBot” to lure hackers into thinking they had taken control of a robot, but instead the robot gathers valuable information about the bad actors, helping businesses better protect themselves from future attacks.

See the shot built by the Harlem Globetrotter and Georgia Tech students.

For their work on an algorithm based on bee colony behavior a team of Georgia Tech systems engineers and a Cornell University collaborator, who studies bees, won The Golden Goose Award. It recognizes the practical, impactful contributions to society by research that may appear musing. The award highlights the high value of curiosity-driven science to humanity. Credit: National Science Foundation 

Georgia Tech Resources

  • Offices & Departments
  • News Center
  • Campus Calendar
  • Special Events
  • GreenBuzz
  • Institute Communications
  • Visitor Resources
  • Campus Visits
  • Directions to Campus
  • Visitor Parking Information
  • GTvisitor Wireless Network Information
  • Georgia Tech Global Learning Center
  • Georgia Tech Hotel & Conference Center
  • Barnes & Noble at Georgia Tech
  • Ferst Center for the Arts
  • Robert C. Williams Paper Museum

Colleges, Instructional Sites & Research

  • Colleges
  • College of Computing
  • College of Design
  • College of Engineering
  • College of Sciences
  • Ivan Allen College of Liberal Arts
  • Scheller College of Business
  • Instructional Sites
  • Georgia Tech-Lorraine
  • Georgia Tech-Shenzhen
  • Georgia Tech Online
  • Professional Education
  • The Language Institute
  • Global Footprint
  • Global Engagement
  • Research
  • Georgia Tech Research Institute
  • Research at Georgia Tech
  • Executive Vice President for Research

Student & Parent Resources

  • Student Resources
  • Apply
  • BuzzPort
  • Buzzcard
  • Career Center
  • Co-ops & Internships
  • Commencement
  • Library
  • Student Affairs
  • Student Entrepreneurship
  • Study Abroad
  • T-Square
  • Parent Resources
  • Parent and Family Programs
  • Dean of Students
  • Scholarships & Financial Aid

Employee, Alumni, & Other Resources

  • Employees
  • Administration and Finance
  • Advising & Teaching
  • Faculty Affairs
  • Faculty Hiring
  • Human Resources
  • Office of the Provost
  • TechWorks
  • Alumni
  • Alumni Association
  • Alumni Career Services
  • Giving Back to Tech
  • Outreach
  • Startup Companies
  • Economic Development
  • Industry Engagement
  • Government & Community Partners
  • Professional Education
Map of News Center | Georgia Institute of Technology

Georgia Institute of Technology
North Avenue, Atlanta, GA 30332
Phone: (404) 894-2000

  • Contact Us
  • Site Feedback
  • Tech Lingo
  • Emergency Information
  • Legal & Privacy Information
  • Human Trafficking Notice
  • Accessibility
  • Accountability
  • Accreditation
  • Employment
Georgia Tech

© Georgia Institute of Technology