← Back to Patent Explorer
US6038337A Expired / Lapsed US ⏱️ 0.0 years remaining

Method and apparatus for object recognition

Assignee: NEC Corp
•
Filing: 1996-03-29
•
Granted: 2000-03-14
•
Expires: 2016-03-29
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A hybrid neural network system for object recognition exhibiting local image sampling, a self-organizing map neural network, and a hybrid convolutional neural network. The self-organizing map provides a quantization of the image samples into a topological space where inputs that are nearby in the original space are also nearby in the output space, thereby providing dimensionality reduction and invariance to minor changes in the image sample, and the hybrid convolutional neural network provides for partial invariance to translation, rotation, scale, and deformation. The hybrid convolutional network extracts successively larger features in a hierarchical set of layers. Alternative embodiments using the Karhunen-Loeve transform in place of the self-organizing map, and a multi-layer perceptron in place of the convolutional network are described.

Inventors

  • 👤 Stephen Robert Lawrence
  • 👤 C. Lee Giles

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-26 20:45
CPC Classifications
G; G06; G06V; G06V10/00; G06V10/40; G06V10/44; G06V10/443; G06V10/449; G06V10/451; G06V10/454

Claims Analysis

Total Claims: 13
Claim 1
Independent Claim 164 words
A method for recognizing an object having an object having a set of features, the method comprising the steps of: sampling a plurality of local regions of an image of the object by stepping a local window in discrete steps over the image to generate a set of sample vectors; reducing the dimensionality of the sample vectors, including (a) training a self-organizing map on the set of sample vectors, (b) stepping, in discrete steps, the local window over any images contained in any training and any test sets, thereby producing a resultant local image sample at each one of the discrete steps, and (c) generating a new training set in an output space of the self-organizing map by passing the resulting local image samples through the self-organizing map; extracting the features of the object from the dimensionally reduced sample vectors, including training a convolutional neural network on the newly generated training set; and classifying the object into a known classification using the extracted features.
Claim 2
Independent Claim 164 words
A method for recognizing an object having an object having a set of features, the method comprising the steps of: sampling a plurality of local regions of an image of the object by stepping a local window in discrete steps over the image to generate a set of sample vectors; reducing the dimensionality of the sample vectors, including (a) training a self-organizing map on the set of sample vectors, (b) stepping, in discrete steps, the local window over any images contained in any training and any test sets, thereby producing a resultant local image sample at each one of the discrete steps, and (c) generating a new training set in an output space of the self-organizing map by passing the resulting local image samples through the self-organizing map; extracting the features of the object from the dimensionally reduced sample vectors, including training a convolutional neural network on the newly generated training set; and classifying the object into a known classification using the extracted features.
Claim 3
Dependent Claim 15 words
The method according to claim 1, wherein the reducing step further comprises a Karhunen-Loeve transform.
Claim 4
Independent Claim 159 words
An apparatus for recognizing an object, the apparatus comprising: means for local image sampling which samples a plurality of local regions of an image of the object by stepping a local window in discrete steps over the image to generate a set of sample vectors; means for dimensionality reduction which trains a self-organizing map on the set of sample vectors, and steps, in discrete steps, the local window over any images contained in any training and any test sets, thereby producing a resultant local image sample at each one of the discrete steps, and generates a new training set in an output space of the self-organizing map by passing the resulting local image samples through the self-organizing map; means for feature extraction which extracts features of the object from the sample vectors and trains a convolutional neural network on the newly generated training set; means for classification which classifies the object into a known classification using the extracted features.
Claim 5
Independent Claim 159 words
An apparatus for recognizing an object, the apparatus comprising: means for local image sampling which samples a plurality of local regions of an image of the object by stepping a local window in discrete steps over the image to generate a set of sample vectors; means for dimensionality reduction which trains a self-organizing map on the set of sample vectors, and steps, in discrete steps, the local window over any images contained in any training and any test sets, thereby producing a resultant local image sample at each one of the discrete steps, and generates a new training set in an output space of the self-organizing map by passing the resulting local image samples through the self-organizing map; means for feature extraction which extracts features of the object from the sample vectors and trains a convolutional neural network on the newly generated training set; means for classification which classifies the object into a known classification using the extracted features.
Claim 6
Dependent Claim 42 words
The object recognition apparatus according to claim 3, wherein the feature extraction means successively transforms the output of the local image sampling means into a plurality of new representations which successively correspond to a set of higher level features of the image.
Claim 7
Dependent Claim 21 words
The object recognition apparatus according to claim 3, wherein the dimensionality reduction means further comprises means for performing a Karhunen-Loeve transform.
Claim 8
Dependent Claim 57 words
The object recognition apparatus according to claim 3, wherein the classification means further estimates a probability that the image contains an individual member of a group based on the extracted features, and wherein the apparatus further comprises means for confidence estimation which estimates a confidence that the individual member of the group is contained within the image.
Claim 9
Dependent Claim 45 words
The object recognition apparatus according to claim 6, wherein the confidence estimation means generates the confidence according to y m (y m -y 2m ) where y m is a first maximum output and y 2m is a second maximum output of the classification means.
Claim 10
Dependent Claim 19 words
The object recognition apparatus according to claim 3, wherein the classification means is a multi layer perceptron style classifier.
Claim 11
Dependent Claim 17 words
The object recognition apparatus according to claim 3, wherein the classification means is a nearest neighbor system.
Claim 12
Independent Claim 204 words
An apparatus for recognizing an object, the apparatus comprising: means for local image sampling which samples a plurality of local regions of an image of the object by stepping a local window in discrete steps over the image to generate a set of sample vectors; means for dimensionality reduction wherein the set of sample vectors is mapped into a space of lower dimension wherein similar points in the input space are mapped to similar points in the output space; means for feature extraction which extracts features from the sample vectors; means for classification which estimates a probability that the image contains an individual member of a group based on the extracted features; means for confidence estimation which estimates a confidence that the individual member of the group is contained within the image; wherein the feature extraction means successively transforms the output of the local image sampling means into a plurality of new representations which successively correspond to a set of higher level features of the image; and wherein the confidence estimation means generates the confidence according to y m (y m -y 2m ), where y m is a first maximum output and y 2m is a second maximum output of the classification means.
Claim 13
Independent Claim 204 words
An apparatus for recognizing an object, the apparatus comprising: means for local image sampling which samples a plurality of local regions of an image of the object by stepping a local window in discrete steps over the image to generate a set of sample vectors; means for dimensionality reduction wherein the set of sample vectors is mapped into a space of lower dimension wherein similar points in the input space are mapped to similar points in the output space; means for feature extraction which extracts features from the sample vectors; means for classification which estimates a probability that the image contains an individual member of a group based on the extracted features; means for confidence estimation which estimates a confidence that the individual member of the group is contained within the image; wherein the feature extraction means successively transforms the output of the local image sampling means into a plurality of new representations which successively correspond to a set of higher level features of the image; and wherein the confidence estimation means generates the confidence according to y m (y m -y 2m ), where y m is a first maximum output and y 2m is a second maximum output of the classification means.

References Cited (Backward Citations)

JPH0520422A Cited
US5408585A Cited
JPH05143651A Cited
US5450504A Cited
JPH07141506A Cited
US5497430A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-03-14 2003-09-13 2004-03-14 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-03-14 2007-09-13 2008-03-14 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-03-14 2011-09-13 2012-03-14 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag