Patent US5675663A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5675663A Expired / Lapsed US ⏱️ 0.0 years remaining

Artificial visual system and method for image recognition

Assignee: Honda Motor Co Ltd
•
Filing: 1996-03-21
•
Granted: 1997-10-07
•
Expires: 2016-03-21
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract An artificial visual apparatus and method for image recognition having a simple adaptive scaling mechanism enables the definition of scale invariant visual icons in a processing area corresponding to the anterior inferotemporal cortex (AIT) in a one-step, value-based decision making process. Icon related activity states resulting from sensory filtering to a fourth stage KL filter corresponding to the V4 area are recognized independent of the scale and position of the item to be recognized within the maximum visual field. The AIT processing area controls the window of attention in the V4 area and confines further processing onto this selected spotlight. The invention presents a biologically plausible method for scale invariant mapping from the V4 stage filter to the AIT processor. Filtering based on principal component analysis (PCA), or Karhunen-Loeve (KL) filtering, yields image data of the item of interest in the V4 stage filter, such data then being supplied to the AIT processor by a scale-invariant mapping process which controls the number of inputs to the KL filters to achieve constant resolution independent of the scale of the item of interest in the maximum visual field. Thus, the problem of scale-invariant mapping is reduced to a simple adaptive thresholding by feedforward inhibition at the AIT processor.

Inventors

  • 👤 Edgar Koerner
  • 👤 Hiroshi Tsujino
  • 👤 Tomohiko Masutani

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-30 21:19
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/164

Claims Analysis

Total Claims: 22
Claim 1
Independent Claim 209 words
An artificial visual system comprising: video camera means for picking up a visual image; conversion means for converting said visual image into a matrix of pixels, said visual image containing at least one item therein to be recognized by said visual system, said item occupying a portion of said matrix of pixels; KL (Karhunen-Loeve) filtering means for focusing attention on said item within said matrix of pixels thereby defining said item as a plurality of vectors defining a sub-space of said item within said image, each of said vectors being defined by a predetermined number of KL components; means for supplying pixel information of said item to a memory means, said means for supplying comprising constant resolution filtering means for limiting the number of KL components per vector in order to maintain a resolution of said item at a predetermined constant resolution; comparator means for comparing said pixel information supplied from said means for supplying with stored data in said memory means of a similar item in order to recognize said pixel information as corresponding to said item; and means for triggering formation of an icon representing said item when a result of the comparison indicates an agreement between said pixel information of said item and said stored data.
Claim 2
Dependent Claim 209 words
An artificial visual system comprising: video camera means for picking up a visual image; conversion means for converting said visual image into a matrix of pixels, said visual image containing at least one item therein to be recognized by said visual system, said item occupying a portion of said matrix of pixels; KL (Karhunen-Loeve) filtering means for focusing attention on said item within said matrix of pixels thereby defining said item as a plurality of vectors defining a sub-space of said item within said image, each of said vectors being defined by a predetermined number of KL components; means for supplying pixel information of said item to a memory means, said means for supplying comprising constant resolution filtering means for limiting the number of KL components per vector in order to maintain a resolution of said item at a predetermined constant resolution; comparator means for comparing said pixel information supplied from said means for supplying with stored data in said memory means of a similar item in order to recognize said pixel information as corresponding to said item; and means for triggering formation of an icon representing said item when a result of the comparison indicates an agreement between said pixel information of said item and said stored data.
Claim 3
Dependent Claim 58 words
An artificial visual system according to claim 1 wherein said constant resolution filtering means limits the number of KL components according to the following equation (1) such that, RF=C (1) wherein R is a radius of a window of attention circumscribing said item, F is a maximum frequency of said window of attention, and C is a constant.
Claim 4
Dependent Claim 84 words
An artificial visual system according to claim 1 or claim 2, wherein said constant resolution filtering means limits the number of KL components to a predetermined number M depending on the input, based on the following equation (2), such that, ##EQU5## wherein R is a radius of a window of attention circumscribing said item, F is a maximum frequency of said window of attention, ActPCA(i,F) is an activity (vector value) of an i-th principal component of said frequency F, and C is a constant.
Claim 5
Dependent Claim 42 words
An artificial visual system according to claim 1, wherein said KL filtering means comprises a plurality of KL filter systems interconnected together, each KL filter system defining said item as a plurality of vectors defined by a predetermined number of KL components.
Claim 6
Dependent Claim 22 words
An artificial visual system according to claim 4, wherein said plurality of KL filter systems comprises first through fourth KL filter systems.
Claim 7
Dependent Claim 32 words
An artificial visual system according to claim 5, wherein an output from at least one of said first through fourth KL filter systems is supplied as an input to said memory means.
Claim 8
Dependent Claim 26 words
An artificial visual system according to claim 1, further comprising a low pass filter for low pass filtering said image processed by said KL filtering means.
Claim 9
Dependent Claim 30 words
An artificial visual system according to claim 1, wherein a pre-attentive processing means defines said visual image containing at least one item therein to be recognized by said visual system.
Claim 10
Dependent Claim 29 words
An artificial visual system according to claim 8, wherein said pre-attentive processing means determines a window of attention within said visual image by low pass filtering and/or color filtering.
Claim 11
Dependent Claim 50 words
An artificial visual system according to claim 9, further comprising means for supplying a feedback signal from said memory means, following triggering of said icon in said memory means, to said KL filtering means, to enable more refined filtering of said window of attention identified by said pre-attentive processing means.
Claim 12
Dependent Claim 77 words
An artificial visual system according to claim 9, further comprising means for supplying a feedback signal from said memory means, following triggering of said icon in said memory means, to a control means for controlling said video camera to thereby cause said video camera to zoom or selectively scan an area within said image identified by the triggered icon so as to optimize a matching of the triggered icon with respective outputs from said KL filtering means.
Claim 13
Independent Claim 182 words
A method for image recognition based on adaptive scaling including the steps of: picking up a visual image; converting said visual image into a matrix of pixels, said visual image containing at least one item therein to be recognized, said item occupying a portion of said matrix of pixels; filtering said image through KL (Karhunen-Loeve) filtering to focus attention on said item within said matrix of pixels, thereby defining said item as a plurality of vectors defining a sub-space of said item within said image, each of said vectors being defined by a predetermined number of KL components; supplying pixel information of said item to a memory means while limiting the number of KL components per vector in order to maintain a resolution of said item at a predetermined constant resolution; comparing the supplied pixel information with stored data of a similar item in order to recognize said pixel information as corresponding to said item; and triggering an icon representing said item when a result of the comparison indicates an agreement between said pixel information of said item and said stored data.
Claim 14
Independent Claim 182 words
A method for image recognition based on adaptive scaling including the steps of: picking up a visual image; converting said visual image into a matrix of pixels, said visual image containing at least one item therein to be recognized, said item occupying a portion of said matrix of pixels; filtering said image through KL (Karhunen-Loeve) filtering to focus attention on said item within said matrix of pixels, thereby defining said item as a plurality of vectors defining a sub-space of said item within said image, each of said vectors being defined by a predetermined number of KL components; supplying pixel information of said item to a memory means while limiting the number of KL components per vector in order to maintain a resolution of said item at a predetermined constant resolution; comparing the supplied pixel information with stored data of a similar item in order to recognize said pixel information as corresponding to said item; and triggering an icon representing said item when a result of the comparison indicates an agreement between said pixel information of said item and said stored data.
Claim 15
Dependent Claim 51 words
A method for image recognition according to claim 12, wherein the constant resolution is maintained according to the following equation (1): RF=C (1) where R is a radius of a window of attention circumscribing said item, F is a maximum frequency of said window of attention, and C is a constant.
Claim 16
Dependent Claim 83 words
A method for image recognition according to claim 12 or 13, wherein the constant resolution is maintained by limiting the number of KL components to a predetermined number M depending on the input according to the following equation (2): ##EQU6## where R is a radius of a window of attention circumscribing said item, F is a maximum frequency of said window of attention, ActPCA(i,F) is an activity (vector value) of an i-th principal component of the frequency F, and C is a constant.
Claim 17
Dependent Claim 44 words
A method for image recognition according to claim 12, wherein said step of filtering includes filtering said image through a plurality of interconnected KL filters, each KL filter defining said item as a plurality of vectors each having a predetermined number of KL components.
Claim 18
Dependent Claim 22 words
A method for image recognition according to claim 15, wherein said plurality of KL filters comprises first through fourth KL filter systems.
Claim 19
Dependent Claim 33 words
A method for image recognition according to claim 12, wherein an output from at least one of said first through fourth KL filter systems is supplied as an input to said memory means.
Claim 20
Dependent Claim 40 words
A method for image recognition according to claim 12, further comprising a step of low pass and/or color filtering said image processed in said KL filtering step so as to pre-attentively select a window of attention within said visual image.
Claim 21
Dependent Claim 47 words
A method for image recognition according to claim 18, further comprising a step of supplying a feedback signal from said memory means, following triggering of said icon in said memory means, to said KL filtering step, to enable more refined KL filtering of said window of attention.
Claim 22
Dependent Claim 86 words
A method for image recognition according to claim 18, further comprising a step of supplying a feedback signal from said memory means, following triggering of said icon in said memory means, to a control means for controlling a video camera that is picking up said visual image to thereby cause said video camera to zoom or selectively scan an area within said image identified by the triggered icon so as to optimize a matching of the triggered icon with respective outputs from said KL filtering step.

References Cited (Backward Citations)

US5164992A Cited
US5331544A Cited
US5432864A Cited
US5337372A Cited
US5497430A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2000-10-06 2001-04-07 2001-10-07 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2004-10-06 2005-04-07 2005-10-07 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2008-10-06 2009-04-07 2009-10-07 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag