Patent US7010751B2 successfully refreshed from Google Patents.
← Back to Patent Explorer
US7010751B2 Expired / Lapsed US ⏱️ 0.0 years remaining

Methods for the electronic annotation, retrieval, and use of electronic images

Assignee: Mind Fusion LLC
•
Filing: 2001-10-15
•
Granted: 2006-03-07
•
Expires: 2021-10-15
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract The present invention provides software for electronically annotating electronic images, such as drawings, photographs, video, etc., through the drag-and-drop of annotations from a pre-defined, but extendable, list. The annotations are placed at a user-selected X, Y location on the image, and stored in a searchable database. Thus, they can be searched in order to retrieve, organize, group, or display desired electronic images or collections of such images. The annotations may be text, images, sounds, etc. The invention provides a flexible, easy to learn, rapid, low error rate and satisfying interface for accomplishing such tasks.

Inventors

  • 👤 Ben A. Shneiderman

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-02 17:36
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/50; G06F16/58; G06F40/00; G06F40/10; G06F40/166; G06F40/169; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99934; Y10S715/00; Y10S715/961; Y10S715/965; Y10S715/966; Y10S715/968

Claims Analysis

Total Claims: 30
Claim 1
Independent Claim 325 words
A computer software-mediated method for annotating a user-selected target image aspect contained within an electronic image that comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, said method comprising: (A) displaying said electronic image using a computer-generated display interface; (B) accessing and querying a searchable electronic list of annotation terms for a desired annotation term, and permitting a user to add or edit said desired annotation term to said database list; (C) associating said desired accessed or added or edited annotation term of said electronic list with said selected target image aspect of said electronic image, wherein said associating comprises positioning said desired annotation term at a user-selected location within the displayed electronic image to identify said selected target image aspect and distinguish it from a non-target image aspect contained within said electronic image, wherein said positioning is accomplished by selecting dragging and dropping said desired annotation term to said user-selected location; (D) storing said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; and (E) permitting a subsequent user to display an electronic image (D) containing said selected target image aspect upon the querying of said electronic database (D) for said associated annotation term, wherein said displayed electronic image (D) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (D), and permitting said subsequent user to add, or edit; and store a desired annotation term to said database list and to associate said new desired annotation term with an image aspect of said displayed electronic image.
Claim 2
Dependent Claim 325 words
A computer software-mediated method for annotating a user-selected target image aspect contained within an electronic image that comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, said method comprising: (A) displaying said electronic image using a computer-generated display interface; (B) accessing and querying a searchable electronic list of annotation terms for a desired annotation term, and permitting a user to add or edit said desired annotation term to said database list; (C) associating said desired accessed or added or edited annotation term of said electronic list with said selected target image aspect of said electronic image, wherein said associating comprises positioning said desired annotation term at a user-selected location within the displayed electronic image to identify said selected target image aspect and distinguish it from a non-target image aspect contained within said electronic image, wherein said positioning is accomplished by selecting dragging and dropping said desired annotation term to said user-selected location; (D) storing said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; and (E) permitting a subsequent user to display an electronic image (D) containing said selected target image aspect upon the querying of said electronic database (D) for said associated annotation term, wherein said displayed electronic image (D) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (D), and permitting said subsequent user to add, or edit; and store a desired annotation term to said database list and to associate said new desired annotation term with an image aspect of said displayed electronic image.
Claim 3
Dependent Claim 34 words
The computer software-mediated method of claim 1 , wherein said computer is a personal computer having a screen, and wherein said displaying comprises displaying the displayed image on the screen of the personal computer.
Claim 4
Dependent Claim 15 words
The computer software-mediated method of claim 1 , wherein said annotation is a textual annotation.
Claim 5
Dependent Claim 25 words
The computer software-mediated method of claim 1 , further comprising selecting said image from the group consisting of a photograph, a writing, and a drawing.
Claim 6
Dependent Claim 15 words
The computer software-mediated method of claim 4 , wherein said electronic image is a photograph.
Claim 7
Dependent Claim 22 words
The computer software-mediated method of claim 5 , wherein said image aspect to be annotated is a person depicted in said photograph.
Claim 8
Dependent Claim 21 words
The computer software-mediated method of claim 6 , wherein said annotation is a name of said person depicted in said photograph.
Claim 9
Dependent Claim 26 words
The computer software-mediated method of claim 1 , that further permits the user to selectively hide and re-display the annotation term positioned within the electronic image.
Claim 10
Dependent Claim 375 words
A computer software-mediated method for retrieving and displaying an electronic image containing a target image aspect; wherein: said electronic image comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and is stored in a database of electronic images and annotation terms, said target image aspect is associated with an annotation term of said database, said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said method comprising: (A) accessing and querying said database of electronic images and annotation terms for electronic images containing a target image aspect associated with a queried annotation term; (B) retrieving from said database an electronic image identified through such querying that contains said target image aspect; (C) displaying said retrieved electronic image, wherein said retrieved image displays said queried annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) permitting a user to add or edit said desired annotation term to said database list; (E) storing said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; and (F) permitting a subsequent user to display said electronic image (E) containing said selected target image aspect upon the querying of said electronic database (E) for said associated annotation term, wherein said displayed electronic image (E) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (E), and permitting said subsequent user to add, or edit, and store a new desired annotation term to said database list, and to associate said new desired annotation term with an image aspect of said displayed electronic image by selecting dragging and dropping said new desired annotation term to a user-selected location.
Claim 11
Dependent Claim 375 words
A computer software-mediated method for retrieving and displaying an electronic image containing a target image aspect; wherein: said electronic image comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and is stored in a database of electronic images and annotation terms, said target image aspect is associated with an annotation term of said database, said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said method comprising: (A) accessing and querying said database of electronic images and annotation terms for electronic images containing a target image aspect associated with a queried annotation term; (B) retrieving from said database an electronic image identified through such querying that contains said target image aspect; (C) displaying said retrieved electronic image, wherein said retrieved image displays said queried annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) permitting a user to add or edit said desired annotation term to said database list; (E) storing said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; and (F) permitting a subsequent user to display said electronic image (E) containing said selected target image aspect upon the querying of said electronic database (E) for said associated annotation term, wherein said displayed electronic image (E) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (E), and permitting said subsequent user to add, or edit, and store a new desired annotation term to said database list, and to associate said new desired annotation term with an image aspect of said displayed electronic image by selecting dragging and dropping said new desired annotation term to a user-selected location.
Claim 12
Dependent Claim 24 words
The computer software-mediated method of claim 9 , wherein in said step (C), said image is displayed on the screen of a personal computer.
Claim 13
Dependent Claim 15 words
The computer software-mediated method of claim 9 , wherein said annotation is a textual annotation.
Claim 14
Dependent Claim 26 words
The computer software-mediated method of claim 9 , wherein said electronic image is selected from the group consisting of a photograph, a writing, and a drawing.
Claim 15
Dependent Claim 15 words
The computer software-mediated method of claim 12 , wherein said electronic image is a photograph.
Claim 16
Dependent Claim 20 words
The computer software-mediated method of claim 13 , wherein said desired image aspect is a person depicted in said photograph.
Claim 17
Dependent Claim 21 words
The computer software-mediated method of claim 14 , wherein said annotation is a name of said person depicted in said photograph.
Claim 18
Dependent Claim 26 words
The computer software-mediated method of claim 9 , that further permits the user to selectively hide and re-display the annotation term positioned within the electronic image.
Claim 19
Dependent Claim 402 words
A computer software-mediated method for retrieving and displaying electronic images containing related target image aspects, wherein: said electronic images each comprise a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and are stored in a database of electronic images and annotation terms, said related target image aspects are each associated with at least one member of a family of related annotation terms of said database, each of said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said method comprising: (A) accessing and querying said database of electronic images and annotation terms for electronic images containing a target image aspect associated with any of said family of related annotation terms; (B) retrieving from said database electronic images identified through such querying that contain a target image aspect; (C) displaying a retrieved electronic image, wherein said retrieved image displays a queued annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) permitting a user to add or edit said desired annotation term to said database list by selecting, dragging and dropping said desired annotation term to a user-selected location; (E) storing said accessed or added or edited annotation terms and said electronic images containing said target image aspects in a searchable electronic database of annotation terms and electronic images; and (F) permitting a subsequent user to display said electronic images (D) containing said selected target image aspects upon the querying of said electronic database (D) for electronic images containing a target image aspect associated with any of said family of related annotation terms, wherein a displayed electronic image (D) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (D), and permitting said subsequent user to add, or edit; and store a new desired annotation term to said database list; and to associate said new desired annotation term with an image aspect of said displayed electronic image.
Claim 20
Dependent Claim 402 words
A computer software-mediated method for retrieving and displaying electronic images containing related target image aspects, wherein: said electronic images each comprise a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and are stored in a database of electronic images and annotation terms, said related target image aspects are each associated with at least one member of a family of related annotation terms of said database, each of said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said method comprising: (A) accessing and querying said database of electronic images and annotation terms for electronic images containing a target image aspect associated with any of said family of related annotation terms; (B) retrieving from said database electronic images identified through such querying that contain a target image aspect; (C) displaying a retrieved electronic image, wherein said retrieved image displays a queued annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) permitting a user to add or edit said desired annotation term to said database list by selecting, dragging and dropping said desired annotation term to a user-selected location; (E) storing said accessed or added or edited annotation terms and said electronic images containing said target image aspects in a searchable electronic database of annotation terms and electronic images; and (F) permitting a subsequent user to display said electronic images (D) containing said selected target image aspects upon the querying of said electronic database (D) for electronic images containing a target image aspect associated with any of said family of related annotation terms, wherein a displayed electronic image (D) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (D), and permitting said subsequent user to add, or edit; and store a new desired annotation term to said database list; and to associate said new desired annotation term with an image aspect of said displayed electronic image.
Claim 21
Dependent Claim 24 words
The computer software-mediated method of claim 17 , wherein in said step (C), said image is displayed on the screen of a personal computer.
Claim 22
Dependent Claim 15 words
The computer software-mediated method of claim 17 , wherein said annotation is a textual annotation.
Claim 23
Dependent Claim 26 words
The computer software-mediated method of claim 17 , wherein said electronic image is selected from the group consisting of a photograph, a writing, and a drawing.
Claim 24
Dependent Claim 15 words
The computer software-mediated method of claim 20 , wherein said electronic image is a photograph.
Claim 25
Dependent Claim 20 words
The computer software-mediated method of claim 21 , wherein said desired image aspect is a person depicted in said photograph.
Claim 26
Dependent Claim 21 words
The computer software-mediated method of claim 22 , wherein said annotation is a name of said person depicted in said photograph.
Claim 27
Dependent Claim 26 words
The computer software-mediated method of claim 17 , that further permits the user to selectively hide and re-display the annotation term positioned within an electronic image.
Claim 28
Dependent Claim 414 words
A computer system specially adapted by software to store, retrieve and display an electronic image containing a target image aspect; wherein: said electronic image comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and is stored in a database of electronic images and annotation terms, said target image aspect is associated with an annotation term of said database, said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said computer system accomplishing the: (A) accession and querying of said database of electronic images and annotation terms for electronic images containing a target image aspect associated with a queried annotation term upon the request of (B) retrieval from said database of an electronic image identified through such querying that contains said target image aspect; (C) display of said retrieved electronic image, wherein said retrieved image displays said queried annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) addition or editing of a desired annotation term to said database list by a user, and associating of a desired annotation term with an image aspect by selecting dragging and dropping said desired annotation term to a user-selected location in said electronic image; (E) storage of said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; (F) display of said electronic image (E) containing said selected target image aspect to a subsequent user upon the querying of said electronic database (E) for said associated annotation term either alone or in combination with a different annotation term, wherein said displayed electronic image (E) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (E); and (G) addition or editing and storage of a new desired annotation term to said database list by a subsequent user, and the association of said new desired annotation term with an image aspect of said displayed electronic image.
Claim 29
Dependent Claim 414 words
A computer system specially adapted by software to store, retrieve and display an electronic image containing a target image aspect; wherein: said electronic image comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and is stored in a database of electronic images and annotation terms, said target image aspect is associated with an annotation term of said database, said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said computer system accomplishing the: (A) accession and querying of said database of electronic images and annotation terms for electronic images containing a target image aspect associated with a queried annotation term upon the request of (B) retrieval from said database of an electronic image identified through such querying that contains said target image aspect; (C) display of said retrieved electronic image, wherein said retrieved image displays said queried annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) addition or editing of a desired annotation term to said database list by a user, and associating of a desired annotation term with an image aspect by selecting dragging and dropping said desired annotation term to a user-selected location in said electronic image; (E) storage of said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; (F) display of said electronic image (E) containing said selected target image aspect to a subsequent user upon the querying of said electronic database (E) for said associated annotation term either alone or in combination with a different annotation term, wherein said displayed electronic image (E) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (E); and (G) addition or editing and storage of a new desired annotation term to said database list by a subsequent user, and the association of said new desired annotation term with an image aspect of said displayed electronic image.
Claim 30
Dependent Claim 14 words
The computer system of claim 25 , wherein said annotation is a textual annotation.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2009-03-06 2009-09-05 2010-03-07 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2013-03-06 2013-09-05 2014-03-07 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2017-03-06 2017-09-05 2018-03-07 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag