"[It's] about unlocking the hidden intelligence in the photos and videos that we capture from our enemies," he said. "If you can imagine going through every video, frame by frame, every photo, ... we need some automated tools to help our warfighters and analysts know what the content of this critical media is."
The task to extract and analyze vital information in that incident alone could be daunting. But visual search reasoning filters the
"We do this by fusing this technology and really understanding in detail the contents of every pixel in that video frame or image," Geertsen said.
The program provides three different methods to conduct the search: natural clustering, query by example and content search, Geertsen said.
So if analysts seek, for example, images of an
"'Similar' might be patterns, colors, vehicles, anything," Geertsen said. "We're searching the contents of these photos in the wild, ... so we add a little bit of common-sense reasoning to this system, and we're able to get these kinds of results."
Similarly, documents with key phrases now yield information based on some 65 different algorithms from various universities, all in communication with each other for the first time.
"Within seconds, I can look at 100,000 images, find 186 that have documents, and click on one to see why it's similar," Geertsen said. "It's another quick way we're creating for analysts and warfighters to visually search and explore massive amounts of media."
The nascent program still has another year or so left in development, but law enforcement, the National Media Exploitation Center, U.S. Southern Command and others agencies are anxious for the program to be deployed, Geertsen noted.
"We're getting inquiries from all sorts of people, and
(Follow Amaani Lyle on Twitter: @LyleAFPS)
Most Popular Stories
- 5 Notable Hispanic Technology Executives
- Top Hispanic Tech Companies Push for the Top
- Russia, Crimea Discuss Referendum
- Maya Angelou Cancels Milagro Gala Appearance Due to Illness
- 'Holy grail of guitars' OM-45 Deluxe Available in in NY Auction
- Justin Bieber Loses Cool Over Selena Gomez
- Spotify Picking up Echo Nest
- GOP 2016 Hopefuls Face Off at CPAC
- Getty Releases Millions of Images for Free Via Embed Tool
- Daylight Savings Time Comes This Weekend