US7010751B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Methods for the electronic annotation, retrieval, and use of electronic images
Assignee: Mind Fusion LLC
•
Filing: 2001-10-15
•
Granted: 2006-03-07
•
Expires: 2021-10-15
Abstract
Abstract The present invention provides software for electronically annotating electronic images, such as drawings, photographs, video, etc., through the drag-and-drop of annotations from a pre-defined, but extendable, list. The annotations are placed at a user-selected X, Y location on the image, and stored in a searchable database. Thus, they can be searched in order to retrieve, organize, group, or display desired electronic images or collections of such images. The annotations may be text, images, sounds, etc. The invention provides a flexible, easy to learn, rapid, low error rate and satisfying interface for accomplishing such tasks.
Inventors
- 👤 Ben A. Shneiderman
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 16:20
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/50; G06F16/58; G06F40/00; G06F40/10; G06F40/166; G06F40/169; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99934; Y10S715/00; Y10S715/961; Y10S715/965; Y10S715/966; Y10S715/968
Claims Analysis
Total Claims: 30
Claim 1
Independent Claim
325 words
A computer software-mediated method for annotating a user-selected target image aspect contained within an electronic image that comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, said method comprising: (A) displaying said electronic image using a computer-generated display interface; (B) accessing and querying a searchable electronic list of annotation terms for a desired annotation term, and permitting a user to add or edit said desired annotation term to said database list; (C) associating said desired accessed or added or edited annotation term of said electronic list with said selected target image aspect of said electronic image, wherein said associating comprises positioning said desired annotation term at a user-selected location within the displayed electronic image to identify said selected target image aspect and distinguish it from a non-target image aspect contained within said electronic image, wherein said positioning is accomplished by selecting dragging and dropping said desired annotation term to said user-selected location; (D) storing said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; and (E) permitting a subsequent user to display an electronic image (D) containing said selected target image aspect upon the querying of said electronic database (D) for said associated annotation term, wherein said displayed electronic image (D) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (D), and permitting said subsequent user to add, or edit; and store a desired annotation term to said database list and to associate said new desired annotation term with an image aspect of said displayed electronic image.
Claim 2
Dependent Claim
325 words
A computer software-mediated method for annotating a user-selected target image aspect contained within an electronic image that comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, said method comprising: (A) displaying said electronic image using a computer-generated display interface; (B) accessing and querying a searchable electronic list of annotation terms for a desired annotation term, and permitting a user to add or edit said desired annotation term to said database list; (C) associating said desired accessed or added or edited annotation term of said electronic list with said selected target image aspect of said electronic image, wherein said associating comprises positioning said desired annotation term at a user-selected location within the displayed electronic image to identify said selected target image aspect and distinguish it from a non-target image aspect contained within said electronic image, wherein said positioning is accomplished by selecting dragging and dropping said desired annotation term to said user-selected location; (D) storing said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; and (E) permitting a subsequent user to display an electronic image (D) containing said selected target image aspect upon the querying of said electronic database (D) for said associated annotation term, wherein said displayed electronic image (D) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (D), and permitting said subsequent user to add, or edit; and store a desired annotation term to said database list and to associate said new desired annotation term with an image aspect of said displayed electronic image.
Claim 3
Dependent Claim
34 words
The computer software-mediated method of claim 1 , wherein said computer is a personal computer having a screen, and wherein said displaying comprises displaying the displayed image on the screen of the personal computer.
Claim 4
Dependent Claim
15 words
The computer software-mediated method of claim 1 , wherein said annotation is a textual annotation.
Claim 5
Dependent Claim
25 words
The computer software-mediated method of claim 1 , further comprising selecting said image from the group consisting of a photograph, a writing, and a drawing.
Claim 6
Dependent Claim
15 words
The computer software-mediated method of claim 4 , wherein said electronic image is a photograph.
Claim 7
Dependent Claim
22 words
The computer software-mediated method of claim 5 , wherein said image aspect to be annotated is a person depicted in said photograph.
Claim 8
Dependent Claim
21 words
The computer software-mediated method of claim 6 , wherein said annotation is a name of said person depicted in said photograph.
Claim 9
Dependent Claim
26 words
The computer software-mediated method of claim 1 , that further permits the user to selectively hide and re-display the annotation term positioned within the electronic image.
Claim 10
Dependent Claim
375 words
A computer software-mediated method for retrieving and displaying an electronic image containing a target image aspect; wherein: said electronic image comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and is stored in a database of electronic images and annotation terms, said target image aspect is associated with an annotation term of said database, said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said method comprising: (A) accessing and querying said database of electronic images and annotation terms for electronic images containing a target image aspect associated with a queried annotation term; (B) retrieving from said database an electronic image identified through such querying that contains said target image aspect; (C) displaying said retrieved electronic image, wherein said retrieved image displays said queried annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) permitting a user to add or edit said desired annotation term to said database list; (E) storing said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; and (F) permitting a subsequent user to display said electronic image (E) containing said selected target image aspect upon the querying of said electronic database (E) for said associated annotation term, wherein said displayed electronic image (E) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (E), and permitting said subsequent user to add, or edit, and store a new desired annotation term to said database list, and to associate said new desired annotation term with an image aspect of said displayed electronic image by selecting dragging and dropping said new desired annotation term to a user-selected location.
Claim 11
Dependent Claim
375 words
A computer software-mediated method for retrieving and displaying an electronic image containing a target image aspect; wherein: said electronic image comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and is stored in a database of electronic images and annotation terms, said target image aspect is associated with an annotation term of said database, said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said method comprising: (A) accessing and querying said database of electronic images and annotation terms for electronic images containing a target image aspect associated with a queried annotation term; (B) retrieving from said database an electronic image identified through such querying that contains said target image aspect; (C) displaying said retrieved electronic image, wherein said retrieved image displays said queried annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) permitting a user to add or edit said desired annotation term to said database list; (E) storing said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; and (F) permitting a subsequent user to display said electronic image (E) containing said selected target image aspect upon the querying of said electronic database (E) for said associated annotation term, wherein said displayed electronic image (E) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (E), and permitting said subsequent user to add, or edit, and store a new desired annotation term to said database list, and to associate said new desired annotation term with an image aspect of said displayed electronic image by selecting dragging and dropping said new desired annotation term to a user-selected location.
Claim 12
Dependent Claim
24 words
The computer software-mediated method of claim 9 , wherein in said step (C), said image is displayed on the screen of a personal computer.
Claim 13
Dependent Claim
15 words
The computer software-mediated method of claim 9 , wherein said annotation is a textual annotation.
Claim 14
Dependent Claim
26 words
The computer software-mediated method of claim 9 , wherein said electronic image is selected from the group consisting of a photograph, a writing, and a drawing.
Claim 15
Dependent Claim
15 words
The computer software-mediated method of claim 12 , wherein said electronic image is a photograph.
Claim 16
Dependent Claim
20 words
The computer software-mediated method of claim 13 , wherein said desired image aspect is a person depicted in said photograph.
Claim 17
Dependent Claim
21 words
The computer software-mediated method of claim 14 , wherein said annotation is a name of said person depicted in said photograph.
Claim 18
Dependent Claim
26 words
The computer software-mediated method of claim 9 , that further permits the user to selectively hide and re-display the annotation term positioned within the electronic image.
Claim 19
Dependent Claim
402 words
A computer software-mediated method for retrieving and displaying electronic images containing related target image aspects, wherein: said electronic images each comprise a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and are stored in a database of electronic images and annotation terms, said related target image aspects are each associated with at least one member of a family of related annotation terms of said database, each of said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said method comprising: (A) accessing and querying said database of electronic images and annotation terms for electronic images containing a target image aspect associated with any of said family of related annotation terms; (B) retrieving from said database electronic images identified through such querying that contain a target image aspect; (C) displaying a retrieved electronic image, wherein said retrieved image displays a queued annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) permitting a user to add or edit said desired annotation term to said database list by selecting, dragging and dropping said desired annotation term to a user-selected location; (E) storing said accessed or added or edited annotation terms and said electronic images containing said target image aspects in a searchable electronic database of annotation terms and electronic images; and (F) permitting a subsequent user to display said electronic images (D) containing said selected target image aspects upon the querying of said electronic database (D) for electronic images containing a target image aspect associated with any of said family of related annotation terms, wherein a displayed electronic image (D) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (D), and permitting said subsequent user to add, or edit; and store a new desired annotation term to said database list; and to associate said new desired annotation term with an image aspect of said displayed electronic image.
Claim 20
Dependent Claim
402 words
A computer software-mediated method for retrieving and displaying electronic images containing related target image aspects, wherein: said electronic images each comprise a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and are stored in a database of electronic images and annotation terms, said related target image aspects are each associated with at least one member of a family of related annotation terms of said database, each of said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said method comprising: (A) accessing and querying said database of electronic images and annotation terms for electronic images containing a target image aspect associated with any of said family of related annotation terms; (B) retrieving from said database electronic images identified through such querying that contain a target image aspect; (C) displaying a retrieved electronic image, wherein said retrieved image displays a queued annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) permitting a user to add or edit said desired annotation term to said database list by selecting, dragging and dropping said desired annotation term to a user-selected location; (E) storing said accessed or added or edited annotation terms and said electronic images containing said target image aspects in a searchable electronic database of annotation terms and electronic images; and (F) permitting a subsequent user to display said electronic images (D) containing said selected target image aspects upon the querying of said electronic database (D) for electronic images containing a target image aspect associated with any of said family of related annotation terms, wherein a displayed electronic image (D) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (D), and permitting said subsequent user to add, or edit; and store a new desired annotation term to said database list; and to associate said new desired annotation term with an image aspect of said displayed electronic image.
Claim 21
Dependent Claim
24 words
The computer software-mediated method of claim 17 , wherein in said step (C), said image is displayed on the screen of a personal computer.
Claim 22
Dependent Claim
15 words
The computer software-mediated method of claim 17 , wherein said annotation is a textual annotation.
Claim 23
Dependent Claim
26 words
The computer software-mediated method of claim 17 , wherein said electronic image is selected from the group consisting of a photograph, a writing, and a drawing.
Claim 24
Dependent Claim
15 words
The computer software-mediated method of claim 20 , wherein said electronic image is a photograph.
Claim 25
Dependent Claim
20 words
The computer software-mediated method of claim 21 , wherein said desired image aspect is a person depicted in said photograph.
Claim 26
Dependent Claim
21 words
The computer software-mediated method of claim 22 , wherein said annotation is a name of said person depicted in said photograph.
Claim 27
Dependent Claim
26 words
The computer software-mediated method of claim 17 , that further permits the user to selectively hide and re-display the annotation term positioned within an electronic image.
Claim 28
Dependent Claim
414 words
A computer system specially adapted by software to store, retrieve and display an electronic image containing a target image aspect; wherein: said electronic image comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and is stored in a database of electronic images and annotation terms, said target image aspect is associated with an annotation term of said database, said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said computer system accomplishing the: (A) accession and querying of said database of electronic images and annotation terms for electronic images containing a target image aspect associated with a queried annotation term upon the request of (B) retrieval from said database of an electronic image identified through such querying that contains said target image aspect; (C) display of said retrieved electronic image, wherein said retrieved image displays said queried annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) addition or editing of a desired annotation term to said database list by a user, and associating of a desired annotation term with an image aspect by selecting dragging and dropping said desired annotation term to a user-selected location in said electronic image; (E) storage of said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; (F) display of said electronic image (E) containing said selected target image aspect to a subsequent user upon the querying of said electronic database (E) for said associated annotation term either alone or in combination with a different annotation term, wherein said displayed electronic image (E) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (E); and (G) addition or editing and storage of a new desired annotation term to said database list by a subsequent user, and the association of said new desired annotation term with an image aspect of said displayed electronic image.
Claim 29
Dependent Claim
414 words
A computer system specially adapted by software to store, retrieve and display an electronic image containing a target image aspect; wherein: said electronic image comprises a plurality of inherently unrelated image aspects, in which the placement of all desired image annotations is not determined solely by the scale of the image, and the X, Y coordinates of the image's center, wherein said inherently unrelated image aspects include a target image aspect and a non-target image aspect, and is stored in a database of electronic images and annotation terms, said target image aspect is associated with an annotation term of said database, said associated annotation terms being displayable positioned at a location within the displayed electronic image that identifies said selected target image aspect and distinguishes it from non-target image aspects contained within said electronic image, said computer system accomplishing the: (A) accession and querying of said database of electronic images and annotation terms for electronic images containing a target image aspect associated with a queried annotation term upon the request of (B) retrieval from said database of an electronic image identified through such querying that contains said target image aspect; (C) display of said retrieved electronic image, wherein said retrieved image displays said queried annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within the displayed electronic image; (D) addition or editing of a desired annotation term to said database list by a user, and associating of a desired annotation term with an image aspect by selecting dragging and dropping said desired annotation term to a user-selected location in said electronic image; (E) storage of said accessed or added or edited annotation term and said electronic image containing said target image aspect in a searchable electronic database of annotation terms and electronic images; (F) display of said electronic image (E) containing said selected target image aspect to a subsequent user upon the querying of said electronic database (E) for said associated annotation term either alone or in combination with a different annotation term, wherein said displayed electronic image (E) optionally displays said annotation term positioned to identify the associated target image aspect and distinguish it from non-target image aspects contained within said displayed electronic image (E); and (G) addition or editing and storage of a new desired annotation term to said database list by a subsequent user, and the association of said new desired annotation term with an image aspect of said displayed electronic image.
Claim 30
Dependent Claim
14 words
The computer system of claim 25 , wherein said annotation is a textual annotation.
References Cited (Backward Citations)
US5142662A
Cited
US5680636A
Cited
US5241671A
Cited
US5241671C1
Cited
US5581682A
Cited
US5404435A
Cited
US5751286A
Cited
US5579471A
Cited
US5734915A
Cited
US5452416A
Cited
US5938724A
Cited
US5793969A
Cited
US5689717A
Cited
US5583980A
Cited
US5493677A
Cited
US5640553A
Cited
US5845288A
Cited
US5757466A
Cited
US6111586A
Cited
US5911139A
Cited
US5920317A
Cited
US6085185A
Cited
US6154755A
Cited
US5873080A
Cited
US5899999A
Cited
US6041335A
Cited
US6128446A
Cited
EP0938227A2
Cited
US6014581A
Cited
US6172676B1
Cited
US6112215A
Cited
EP1006464A2
Cited
WO2000046695A1
Cited
US6687878B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-03-06 | 2009-09-05 | 2010-03-07 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-03-06 | 2013-09-05 | 2014-03-07 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-03-06 | 2017-09-05 | 2018-03-07 | $7700.00 | Window Closed / Lapsed |