Multi-level selection methods and apparatus using context identification

Abstract

Abstract An image capture user interface receives an image of an area of a user interface selected by a user and translates the image into operations performable by a computer. The user interface is comprised of graphic entities and embedded code. The user places an image capture device, such as a camera pen, on or near a graphic entity of the user interface, and presses a button on the image capture device indicating selection of the graphic entity. In response to the button, an image is captured that corresponds to the graphic entity selected by the user. The image includes embedded code, which is analyzed to develop an image capture code corresponding to the captured image area. The image capture code is then mapped to a selection code corresponding to the graphic entity selected by the user. The user may then make other selections. The selection codes are processed for a particular syntax, and a computer operation is performed when a selection code, or combination of selection codes, is received which indicate that an operation is to be performed. In other embodiments, mapping of image capture codes to selection codes and syntax processing may be performed in accordance with a particular context.

Inventors

• 👤 David L. Hecht

Bibliographic Details