News Column

Researchers Submit Patent Application, "Removing an Object from an Image", for Approval

July 9, 2014



By a News Reporter-Staff News Editor at Telecommunications Weekly -- From Washington, D.C., VerticalNews journalists report that a patent application by the inventors Xiong, Yingen (Mountain View, CA); Zhang, Tao (Sunnyvale, CA); Bi, Ning (San Diego, CA), filed on July 18, 2013, was made available online on June 26, 2014.

The patent's assignee is QUALCOMM Incorporated.

News editors obtained the following quote from the background information supplied by the inventors: "In the last several decades, the use of electronic devices has become common. In particular, advances in electronic technology have reduced the cost of increasingly complex and useful electronic devices. Cost reduction and consumer demand have proliferated the use of electronic devices such that they are practically ubiquitous in modern society. As the use of electronic devices has expanded, so has the demand for new and improved features of electronic devices. More specifically, electronic devices that perform new functions and/or that perform functions faster, more efficiently or with higher quality are often sought after.

"Some electronic devices (e.g., cameras, video camcorders, digital cameras, cellular phones, smart phones, computers, televisions, etc.) capture or utilize images. For example, a digital camera may capture a digital image.

"New and/or improved features of electronic devices are often sought for. As can be observed from this discussion, systems and methods that add new and/or improved features of electronic devices may be beneficial."

As a supplement to the background information on this patent application, VerticalNews correspondents also obtained the inventors' summary information for this patent application: "A method for removing an object from an image is described. The image is separated into a source region and a target region. One or more filling candidate pixels are obtained. Multiple filling patches are also obtained. Each filling patch is centered at a filling candidate pixel.

"A contour of the target region may be extracted. The target region may include the object to be removed. The contour may be recalculated at each iteration. A filling patch may then be selected for replacement. The selected filling patch may include the largest number of pixels in a filling patch source region of the selected filling patch. A replacement patch that is most similar to the selected filling patch may be determined. The target region portion of the selected filling patch may be replaced with the corresponding part of the replacement patch.

"The replacement patch may be selected to maximize correlation of both color information and texture information between the replacement patch and the selected filling patch. The replacement patch may also be selected to maximize correlation between both grayscale information and gradient information between the replacement patch and the selected filling patch.

"The method may be iterated if all target region pixels are not filled. The replacement patch may be determined using a fast best patch matching algorithm. The replacement patch may be determined using one or more components that are weighted, including color information, grayscale information, texture information and gradient information. The components may be weighted corresponding to an edgy image, a smooth image and a normal image. A resolution may be adjusted at one or more iterations of the method.

"The source region and the target region may be separated based on a touchscreen input. Separating the source region and the target region may include determining a set of pixels corresponding to a contour of the target region. A contour of the target region may include a decimated set of pixels corresponding to the contour or an upscaled set of pixels corresponding to the contour. The target region may be selected using a user interface that includes a hidden pull-down menu.

"An electronic device is also described. The electronic device includes circuitry for separating an image into a source region and a target region. The electronic device also includes circuitry for obtaining one or more filling candidate pixels. The electronic device further includes circuitry for obtaining multiple filling patches. Each filling patch is centered at a filling candidate pixel.

"An apparatus is described. The apparatus includes means for separating an image into a source region and a target region. The apparatus also includes means for obtaining one or more filling candidate pixels. The apparatus further includes means for obtaining multiple filling patches. Each filling patch is centered at a filling candidate pixel.

"A computer-program product including a non-transitory tangible computer-readable medium having instructions thereon is also described. The instructions include code for causing an electronic device to separate an image into a source region and a target region. The instructions also include code for causing the electronic device to obtain one or more filling candidate pixels. The instructions further include code for causing the electronic device to obtain multiple filling patches. Each filling patch is centered at a filling candidate pixel.

BRIEF DESCRIPTION OF THE DRAWINGS

"FIG. 1 is a block diagram illustrating one configuration of an electronic device in which systems and methods for removing an object from an image may be implemented;

"FIG. 2 illustrates an image with an object to be removed;

"FIG. 3 is a more detailed illustration of a filling patch;

"FIG. 4 is a flow diagram of a method for removing an object from an image;

"FIG. 5 is a flow diagram illustrating another method for removing an object from an image;

"FIG. 6 is a flow diagram illustrating a method for fast best patch matching;

"FIG. 7 is a block diagram illustrating one example of a user interface that may be implemented in accordance with the systems and methods disclosed herein;

"FIG. 8 illustrates one example of the removal of an object from an image;

"FIG. 9 illustrates another example of the removal of an object from an image; and

"FIG. 10 illustrates various components that may be utilized in an electronic device."

For additional information on this patent application, see: Xiong, Yingen; Zhang, Tao; Bi, Ning. Removing an Object from an Image. Filed July 18, 2013 and posted June 26, 2014. Patent URL: http://appft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.html&r=4131&p=83&f=G&l=50&d=PG01&S1=20140619.PD.&OS=PD/20140619&RS=PD/20140619

Keywords for this news article include: QUALCOMM Incorporated.

Our reports deliver fact-based news of research and discoveries from around the world. Copyright 2014, NewsRx LLC


For more stories covering the world of technology, please see HispanicBusiness' Tech Channel



Source: Telecommunications Weekly


Story Tools






HispanicBusiness.com Facebook Linkedin Twitter RSS Feed Email Alerts & Newsletters