News Column

Researchers Submit Patent Application, "Automatic Extraction, Modeling, and Code Mapping of Application User Interface Display Screens and...

August 19, 2014



Researchers Submit Patent Application, "Automatic Extraction, Modeling, and Code Mapping of Application User Interface Display Screens and Components", for Approval

By a News Reporter-Staff News Editor at Information Technology Newsweekly -- From Washington, D.C., VerticalNews journalists report that a patent application by the inventors Ligman, Joseph W. (Wilton, CT); Pistoia, Marco (Amawalk, NY); Ponzo, John J. (Hawthorne, NY); Thomas, Gegi (Piermont, NY), filed on August 17, 2013, was made available online on August 7, 2014.

The patent's assignee is International Business Machines Corporation.

News editors obtained the following quote from the background information supplied by the inventors: "The disclosure relates generally to application management and more specifically to the automatic extraction, modeling, and code mapping of application user interface display screens and components within the display screens in order to track and log data generated by user activities within the application. The tracked and logged data may be a representation of one or more compiled program objects that represent user interface components during execution of the application and internal attributes of those compiled program objects and/or data that flows in and out of the compiled program objects during execution of the application. The user interface display screens provide a visualization to associate and to control functionality of selected components by acting on the compiled program objects within the application.

"Companies are increasingly supporting business applications, which cover a wide range of functionality, running on mobile data processing devices, such as smart phones, personal digital assistants, handheld computers, and laptop computers. Also, companies are adopting business application stores and allowing employees to bring their own personal mobile data processing devices to work. Thus, companies desiring to protect their computing infrastructures may want to manage these business applications and their distribution on employees' personal mobile data processing devices."

As a supplement to the background information on this patent application, VerticalNews correspondents also obtained the inventors' summary information for this patent application: "According to one illustrative embodiment, a computer system and a computer program product for managing user applications is provided. A visual model of user interface display screens of a user application is generated by mapping components displayed within the user interface display screens to screen position coordinates and by mapping the screen position coordinates corresponding to the components to original source code of the user application without accessing the original source code of the user application. A runtime policy for each component in a selected set of components within the user interface display screens of the user application is generated based on user interaction with the generated visual model of the user interface display screens. The generated runtime policy for each component in the selected set of components within the user interface display screens of the user application is sent to a client device via a network. Activity of each component in the selected set of components within the user interface display screens of the user application running on the client device is tracked using data that is tracked and logged on the client device based on the generated runtime policy on each component in the selected set of components.

"According to another illustrative embodiment, a data processing system and computer program product for managing user applications is provided. Images of displayed user interface display screens of a running user application on the data processing system are captured. An embedded instrumentation library in the running user application is used to capture the images of the displayed user interface display screens. Screen position coordinates are calculated corresponding to components within the displayed user interface display screens of the running user application. A display screen data package is generated that includes the captured images of the displayed user interface display screens of the running user application and the calculated screen position coordinates corresponding to the components within the displayed user interface display screens.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

"FIG. 1 is a pictorial representation of a network of data processing systems in which illustrative embodiments may be implemented;

"FIG. 2 is a diagram of a data processing system in which illustrative embodiments may be implemented;

"FIG. 3 is a diagram illustrating an example of an application management system in accordance with an illustrative embodiment;

"FIG. 4 is a diagram illustrating examples of user application instrumentation processes in accordance with an illustrative embodiment;

"FIG. 5 is an example of a display screen data package in accordance with an illustrative embodiment;

"FIG. 6 is an example of a runtime tracking and enforcement policy in accordance with an illustrative embodiment;

"FIG. 7 is a diagram illustrating an example of visual modeling of a user application in accordance with an illustrative embodiment;

"FIG. 8 is a diagram illustrating an example of a web browser user application control display in accordance with an illustrative embodiment;

"FIG. 9 is a diagram illustrating an example of a web browser user application usage display in accordance with an illustrative embodiment;

"FIG. 10A and FIG. 10B are a flowchart illustrating a process for managing applications in accordance with an illustrative embodiment;

"FIG. 11 is a flowchart illustrating a process for capturing user interface display screens in accordance with an illustrative embodiment;

"FIG. 12 is a flowchart illustrating a process for storing a display screen data package in accordance with an illustrative embodiment;

"FIG. 13 is a flowchart illustrating a process for concurrently displaying a user interface display screen rendering in accordance with an illustrative embodiment;

"FIG. 14 is a flowchart illustrating a process for generating a visual model of a user interface display screen in accordance with an illustrative embodiment;

"FIG. 15 is a flowchart illustrating a process for generating a runtime policy in accordance with an illustrative embodiment;

"FIG. 16 is a flowchart illustrating a process for sending a runtime policy to registered client devices in accordance with an illustrative embodiment; and

"FIG. 17 is a flowchart illustrating a process for enforcing runtime policies in accordance with an illustrative embodiment."

For additional information on this patent application, see: Ligman, Joseph W.; Pistoia, Marco; Ponzo, John J.; Thomas, Gegi. Automatic Extraction, Modeling, and Code Mapping of Application User Interface Display Screens and Components. Filed August 17, 2013 and posted August 7, 2014. Patent URL: http://appft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.html&r=329&p=7&f=G&l=50&d=PG01&S1=20140731.PD.&OS=PD/20140731&RS=PD/20140731

Keywords for this news article include: Information Technology, Information and Data Processing, International Business Machines Corporation.

Our reports deliver fact-based news of research and discoveries from around the world. Copyright 2014, NewsRx LLC


For more stories covering the world of technology, please see HispanicBusiness' Tech Channel



Source: Information Technology Newsweekly


Story Tools






HispanicBusiness.com Facebook Linkedin Twitter RSS Feed Email Alerts & Newsletters