US5845288A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Automated system for indexing graphical documents having associated text labels
Assignee: Google LLC
•
Filing: 1995-12-11
•
Granted: 1998-12-01
•
Expires: 2015-12-11
Abstract
Abstract A system for image indexing for the domain of technical manual documents depicting line drawing images of physical equipment. Such line drawings are often associated with text labels that indicate references to component parts in an associated table. The indexing system locates regions containing a machine part in relevant pages of the manual in response to a query describing the part. The query supplied by the user is a textual description of the machine part from which an associated geometric description of the object is retrieved. The indexing mechanism includes two stages, i.e., selection and recognition. The selection phase involves isolating relevant images from the document database using a combination to textual and visual processing and indicating the appropriate regions within those images that are likely to contain the queried machine part. Model-based object recognition then confirms the presence of the part at that location by finding a match of features between the part and the model using a 3D model description associated with the textual query.
Inventors
- 👤 Tanveer F. Syeda-Mahmood
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-29 16:30
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/50; G06F16/58; G06F16/583; G06F16/5846; G06F16/5854; G06V; G06V30/00; G06V30/10; G06V30/18; G06V30/1801; G06V30/18076; G06V30/18162; G06V30/26; G06V30/262; G06V30/40; G06V30/41; G06V30/412; G06V30/414; G06V30/42; G06V30/422; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99941; Y10S707/99943; Y10S707/99944; Y10S707/99945
Claims Analysis
Total Claims: 19
Claim 1
Independent Claim
106 words
An automated indexing system for indexing documents, which include graphics having associated text labels, in a manner allowing object querying within said documents, comprising: a microprocessor for: a) processing graphic portions of a document and identifying isolated graphic objects within said graphic portions; b) recognizing text labels in said graphic portions; c) relating said isolated graphic objects to text labels associated therewith; and a database for storing references to said isolated graphic objects and said text labels associated therewith in a queryable database index of said database, for independent retrieval of said isolated graphic objects and said associated text labels upon directing an independent query thereto.
Claim 2
Dependent Claim
106 words
An automated indexing system for indexing documents, which include graphics having associated text labels, in a manner allowing object querying within said documents, comprising: a microprocessor for: a) processing graphic portions of a document and identifying isolated graphic objects within said graphic portions; b) recognizing text labels in said graphic portions; c) relating said isolated graphic objects to text labels associated therewith; and a database for storing references to said isolated graphic objects and said text labels associated therewith in a queryable database index of said database, for independent retrieval of said isolated graphic objects and said associated text labels upon directing an independent query thereto.
Claim 3
Independent Claim
107 words
A method of processing a document containing graphics and text for use in an indexing system associated with a computer implemented database management system, wherein: a bitmapped image containing graphic portions further comprised of isolated graphic objects having associated text labels is received and stored; said bitmapped image is processed to identify said isolated graphic objects and to identify and recognize said text labels therein; said text labels and said isolated graphic objects are associated; references to said isolated graphic objects and said associated text labels are stored in a queryable database index, for retrieval of graphic objects and associated text upon directing a query independently thereto.
Claim 4
Independent Claim
107 words
A method of processing a document containing graphics and text for use in an indexing system associated with a computer implemented database management system, wherein: a bitmapped image containing graphic portions further comprised of isolated graphic objects having associated text labels is received and stored; said bitmapped image is processed to identify said isolated graphic objects and to identify and recognize said text labels therein; said text labels and said isolated graphic objects are associated; references to said isolated graphic objects and said associated text labels are stored in a queryable database index, for retrieval of graphic objects and associated text upon directing a query independently thereto.
Claim 5
Dependent Claim
35 words
The method as described in claim 2, wherein said processing of said bitmapped image to identify said isolated graphic objects therein includes identifying groups of graphic objects connected to said isolated objects within said image.
Claim 6
Dependent Claim
78 words
The method as described in claim 2, wherein said association of said text labels and said isolated graphic objects includes identifying lead lines associated with said text labels, each lead line having a text end and a pointing end; and identifying isolated graphic objects near said pointing end of said lead lines, whereby said isolated graphic objects near said pointing end of said lead lines are associated with said text characters at the end of said lead line.
Claim 7
Dependent Claim
71 words
An automated image indexing system for indexing graphical objects within graphical portions of documents in a manner allowing querying for said objects independently of said graphical portions, comprising: means for processing graphic portions of documents into isolated connected graphical regions; means for approximately localizing queried graphical objects by associating existing annotating text words with said connected graphical regions; and means for automatically isolating single graphical objects from said connected graphics regions.
Claim 8
Dependent Claim
71 words
An automated image indexing system for indexing graphical objects within graphical portions of documents in a manner allowing querying for said objects independently of said graphical portions, comprising: means for processing graphic portions of documents into isolated connected graphical regions; means for approximately localizing queried graphical objects by associating existing annotating text words with said connected graphical regions; and means for automatically isolating single graphical objects from said connected graphics regions.
Claim 9
Dependent Claim
35 words
The system of claim 5 further comprising a means for verifying a match to posed queries using visual object recognition by matching object features from said posed queries with stored geometric models representing said objects.
Claim 10
Dependent Claim
18 words
The system of claim 5 further comprising a means for recognizing annotating text words in bit-mapped line-drawing images.
Claim 11
Dependent Claim
26 words
The system of claim 7 further comprising a means for forming data representations in a database management system using feature maps extracted from said line-drawing images.
Claim 12
Dependent Claim
35 words
The system of claim 8 further comprising a means for verifying a match to posed queries using visual object recognition by matching object features from said posed queries with stored geometric models representing said objects.
Claim 13
Dependent Claim
35 words
The system of claim 7 further comprising a means for verifying a match to posed queries using visual object recognition by matching object features from said posed queries with stored geometric models representing said objects.
Claim 14
Dependent Claim
21 words
The system of claim 7 wherein said graphical documents have associated text tables which are used for indexing said graphical documents.
Claim 15
Dependent Claim
17 words
The system of claim 11 further comprising means for receiving queries and suitably transforming them for indexing.
Claim 16
Dependent Claim
18 words
The system of claim 5 further comprising a means for recognizing annotating text words in bit-mapped line-drawing images.
Claim 17
Dependent Claim
17 words
The system of claim 13 further comprising means for receiving queries and suitably transforming them for indexing.
Claim 18
Dependent Claim
35 words
The system of claim 14 further comprising a means for verifying a match to posed queries using visual object recognition by matching object features from said pose queries with stored geometric models representing said objects.
Claim 19
Dependent Claim
93 words
The system of claim 5 wherein said graphical portions of said documents have associated text tables related to said graphical, said system further comprising: means for receiving queries and transforming them for indexing; means for recognizing annotating text words in bit-mapped line-drawing images; means for forming data representations in a database management system using feature maps extracted from said line-drawing images; and means for verifying a match to posed queries using visual object recognition by matching, using said feature maps, object features from said posed queries with stored geometric models representing said objects.
References Cited (Backward Citations)
US5444840A
Cited
US5404435A
Cited
US5579471A
Cited
US5647058A
Cited
US5465353A
Cited
US5640553A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-11-30 | 2002-06-01 | 2002-12-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-11-30 | 2006-06-01 | 2006-12-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-11-30 | 2010-06-01 | 2010-12-01 | $7700.00 | Window Closed / Lapsed |