News Column

Patent Application Titled "Interpreting a Gesture-Based Instruction to Selectively Display a Frame of an Application User Interface on a Mobile...

August 26, 2014



Patent Application Titled "Interpreting a Gesture-Based Instruction to Selectively Display a Frame of an Application User Interface on a Mobile Computing Device" Published Online

By a News Reporter-Staff News Editor at Journal of Mathematics -- According to news reporting originating from Washington, D.C., by VerticalNews journalists, a patent application by the inventors Pinto, Gus (Boca Raton, FL); Marano, Adam (Parkland, FL); Yang, Ruiguo (Parkland, FL); Fleck, Christopher (Boca Raton, FL), filed on April 10, 2014, was made available online on August 14, 2014.

The assignee for this patent application is Citrix Systems, Inc.

Reporters obtained the following quote from the background information supplied by the inventors: "Remote access systems have enabled users to access applications on servers from various portals. With the increasing prevalence of mobile computing devices, users can also access applications on those servers from handheld devices. However, displays on such devices often have low resolution. As a result, a user can view only a section of the application user interface on the mobile computing device's screen, and the user must scroll around the interface to view other sections of the interface. Thus, navigating within an application user interface can be a cumbersome process.

"It is common for many applications to have user interfaces that consist of multiple panes or frames of information in a single presentation or view. Often, a particular type of data or controls feature is grouped together in a frame of the user interface, such as emails in Microsoft Outlook. On devices that have larger screens, all of the frames may be displayed at the same time. However, when user interface (UI) designs with multiple frames or panes are delivered to a mobile device with a significantly smaller screen, the user will often be limited to a reduced view of all the frames or panes or must view an arbitrarily displayed limited view of the UI, making it hard for the user to navigate between the different frames. In some instances, the user must manually align the frame they wish to interact with on the devices screen, which can be a tedious interaction given the sensitivity of some mobile device's operation."

In addition to obtaining background information on this patent application, VerticalNews editors also obtained the inventors' summary information for this patent application: "The present disclosure is directed to a system and method for selectively displaying a frame of an application user interface on a mobile computing device. A user interface analyzer on a mobile computing device analyzes a user interface for an application executing on a remote server. The user interface analyzer identifies frames in the user interface, the positions of the frames, relationships between frames, and horizontal and vertical panning offsets to move between adjacent frames. The mobile computing device receives a user input requesting the display of an adjacent frame. Based on the information the user interface analyzer obtained, the mobile computing device displays an adjacent frame of the user interface.

"The systems and methods described herein increase the usability of applications with multiple frame by providing the means to smartly manage the locations of the different frames on the application UI and a user interface to easily navigate between the different frames. Users can perform the associated gesture or operation on their mobile devices to automatically align the application frame with the devices screen, eliminating the need for the user to manually align the application frame with the device's screen.

"The systems and methods described herein may provide easier navigation of static-sized UI frames and easy navigation to UI frames of different sizes to either the frame's offset or middle of the frame, including zooming a frame in or out to better align with the device's screen. The systems and methods described herein may provide tagged frame navigation which include embedding jump tags into the UI that allow the system to dynamically jump to specified frames. Guidelines may be provided for formatting application UIs using static sized UI frames to be compatible with the systems and methods described herein. Tagging and coding guidelines may be provided to allow the application to leverage the system. APIs may be provided that can be used in the development of the application to leverage more dynamic interaction with the system. APIs may be provided that will allow mobile devices to define the gestures/actions to be used to invoke the features of the invention related to how the application UI is positioned on the screen of the device.

"In one aspect, the present invention is directed to a method for selectively displaying a frame of an application user interface on a mobile computing device. A client agent of a mobile computing device receives an application user interface from an application executing remotely on a server. The client agent stores the application user interface to an extended virtual screen buffer maintained by the mobile computing device. The client agent displays, on a native display of the mobile computing device, a frame of the extended virtual screen buffer. The client agent interprets user input from a user as a request to view an adjacent frame of the application user interface. The client agent, responsive to the request, retrieves the adjacent frame and the position of the adjacent frame of the application user interface from the extended virtual screen buffer. The client agent displays the retrieved adjacent frame of the extended virtual screen buffer on the native display of the mobile computing device.

"In some embodiments, the client agent receives user input from the user via a touch screen of the native display. In some embodiments, the client agent identifies a plurality of frames of the received application user interface. In some further embodiments, the client agent identifies coordinates of each of the plurality of frames of the received application user interface on the extended virtual screen buffer. In some embodiments, the client agent identifies panning offsets of each of the plurality of frames of the received application user interface on the extended virtual screen buffer. In some embodiments, the client agent detects jump tags associated with each of the plurality of frames, wherein each jump tag identifies a command to execute to display a frame if a user inputs the command. In some embodiments, the client agent interprets the user input from the user a vertical swipe as the request to view an adjacent frame of the application user interface as one of above or below the displayed frame. The client agent applies an object recognition algorithm to the extended virtual screen buffer to identify the plurality of frames of the received application user interface. In some embodiments, the client agent determines to apply a zoom operation to the frame displayed on the native display of the mobile computing device. In some embodiments, the client agent determines dimensions of each of the plurality of frames of the application user interface.

"In one aspect, the present invention is directed to a system for selectively displaying a frame of an application user interface on a mobile computing device. In some embodiments, the system includes a mobile computing device, a server, an application executing remotely on the server, and a client agent executing on a mobile computing device. The client agent receives an application user interface from the application. The client agent stores the application user interface to an extended virtual screen buffer maintained by the mobile computing device. The client agent displays on a native display of the mobile computing device a frame of the extended virtual screen buffer. The client agent interprets user input from a user as a request to view an adjacent frame of the application user interface. The client agent retrieves, responsive to the request, the adjacent frame and the position of the adjacent frame of the application user interface from the extended virtual screen buffer. The client agent displays the retrieved adjacent frame of the extended virtual screen buffer on the native display of the mobile computing device.

"In some embodiments, the client agent receives user input from the user via a touch screen of the native display. In some embodiments, the client agent identifies a plurality of frames of the received application user interface. In some embodiments, the client agent identifies coordinates of each of the plurality of frames of the received application user interface on the extended virtual screen buffer. In some embodiments, the client agent identifies panning offsets of each of the plurality of frames of the received application user interface on the extended virtual screen buffer. In some embodiments, the client agent detects jump tags associated with each of the plurality of frames, wherein each jump tag identifies a command to execute to display a frame if a user inputs the command. In some embodiments, the client agent interprets the user input from the user a vertical swipe as the request to view an adjacent frame of the application user interface as one of above or below the displayed frame. In some embodiments, the client agent applies an object recognition algorithm to the extended virtual screen buffer to identify the plurality of frames of the received application user interface. In some embodiments, the client agent determines to apply a zoom operation to the frame displayed on the native display of the mobile computing device. In some embodiments, the client agent determines dimensions of each of the plurality of frames of the application user interface.

"The details of various embodiments of the methods and systems described herein are set forth in the accompanying drawings and the description below.

BRIEF DESCRIPTION OF THE DRAWINGS

"The foregoing and other objects, aspects, features, and advantages of the disclosure will become more apparent and better understood by referring to the following description taken in conjunction with the accompanying drawings, in which:

"FIG. 1A depicts embodiments of network environments that provide remote access to computing devices that can execute application programs.

"FIG. 1B and FIG. 1C are block diagrams that depict embodiments of computing devices.

"FIG. 2A is a block diagram of an exemplary system for selectively displaying a frame of an application user interface on a mobile computing device, wherein the application executes on a remote server;

"FIG. 2B is a block diagram of an exemplary mobile computing device that selectively displays a frame of an application user interface;

"FIG. 3 is a grid depicting an exemplary arrangement of frames in an application user interface;

"FIG. 4 depicts an exemplary gesture-based instruction for viewing an adjacent frame of an application user interface;

"FIGS. 5A-5C are exemplary views of a mobile computing device selectively displaying frames of an application user interface in response to a gesture-based instruction;

"FIG. 6 is a screenshot of an exemplary user interface for panning between applications; and

"FIG. 7 is a flow diagram that depicts a method for selectively displaying a frame of an application user interface on a mobile computing device."

For more information, see this patent application: Pinto, Gus; Marano, Adam; Yang, Ruiguo; Fleck, Christopher. Interpreting a Gesture-Based Instruction to Selectively Display a Frame of an Application User Interface on a Mobile Computing Device. Filed April 10, 2014 and posted August 14, 2014. Patent URL: http://appft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.html&r=314&p=7&f=G&l=50&d=PG01&S1=20140807.PD.&OS=PD/20140807&RS=PD/20140807

Keywords for this news article include: Citrix Systems Inc.

Our reports deliver fact-based news of research and discoveries from around the world. Copyright 2014, NewsRx LLC


For more stories covering the world of technology, please see HispanicBusiness' Tech Channel



Source: Journal of Mathematics


Story Tools






HispanicBusiness.com Facebook Linkedin Twitter RSS Feed Email Alerts & Newsletters