US5864630A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Multi-modal method for locating objects in images
Assignee: AT&T Inc
•
Filing: 1996-11-20
•
Granted: 1999-01-26
•
Expires: 2016-11-20
Abstract
Abstract A multi-modal method for locating objects in images wherein a tracking analysis is first performed using a plurality of channels which may comprise a shape channel, a color channel, and a motion channel. After a predetermined number of frames, intermediate feature representations are obtained from each channel and evaluated for reliability. Based on the evaluation of each channel, one or more channels are selected for additional tracking. The results of all representations are ultimately integrated into a final tracked output. Additionally, any of the channels may be calibrated using initial results obtained from one or more channels.
Inventors
- 👤 Eric Cosatto
- 👤 Hans Peter Graf
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-30 12:45
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/80; G06T7/70; G06T7/73; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/162; G06V40/167
Claims Analysis
Total Claims: 33
Claim 1
Independent Claim
114 words
A method for locating objects in images, comprising: tracking designated objects in the images using a plurality of channels during a first number of frames, the objects comprised of one or more features, each of said channels producing an independent representation comprising perceived locations of said one or more features; determining a general score for each channel; selecting, based on said general scores, at least one channel for additional tracking; tracking the objects using said at least one channel during a second number of frames, each said at least one channel producing an independent representation comprising perceived locations of said one or more features; and combining said independent representations to produce a tracked output.
Claim 2
Independent Claim
114 words
A method for locating objects in images, comprising: tracking designated objects in the images using a plurality of channels during a first number of frames, the objects comprised of one or more features, each of said channels producing an independent representation comprising perceived locations of said one or more features; determining a general score for each channel; selecting, based on said general scores, at least one channel for additional tracking; tracking the objects using said at least one channel during a second number of frames, each said at least one channel producing an independent representation comprising perceived locations of said one or more features; and combining said independent representations to produce a tracked output.
Claim 3
Dependent Claim
59 words
The method according to claim 1, wherein said determining step comprises: searching for said features and combinations of said features within said independent representations produced during said first number of frames; assigning measures of confidence to each said feature and each said combination of features; and computing, based on said measures of confidence, said general score for each channel.
Claim 4
Dependent Claim
14 words
The method according to claim 2, wherein said searching step comprises an n-gram search.
Claim 5
Dependent Claim
40 words
The method according to claim 1, wherein the number of channels used for said tracking during said first number of frames is three, said three channels programmed to perform respective analyses of shape, color and motion to track the objects.
Claim 6
Dependent Claim
40 words
The method according to claim 2, wherein the number of channels used for said tracking during said first number of frames is three, said three channels programmed to perform respective analyses of shape, color and motion to track the objects.
Claim 7
Dependent Claim
23 words
The method according to claim 4, wherein the number of channels used for said tracking during said second number of frames is one.
Claim 8
Dependent Claim
24 words
The method according to claim 6, wherein said one channel used for said tracking during said second number of frames comprises the color channel.
Claim 9
Dependent Claim
24 words
The method according to claim 5, wherein the number of channels used for said additional tracking during said second number of frames is one.
Claim 10
Dependent Claim
23 words
The method according to claim 8, wherein said channel used for said tracking during said second number of frames comprises the color channel.
Claim 11
Dependent Claim
14 words
The method according to claim 2, wherein said combining step comprises an n-gram search.
Claim 12
Dependent Claim
14 words
The method according to claim 6, wherein said first number of frames is one.
Claim 13
Dependent Claim
63 words
The method according to claim 10, further comprising: tracking the objects during a third number of frames using at least one channel used for said tracking during said second number of frames and at least one additional channel, each channel used for said tracking during said third number of frames producing an independent representation comprising perceived locations of said one or more features.
Claim 14
Independent Claim
107 words
A method for locating objects in images, comprising: tracking the objects during a first number of frames only using a channel programmed to perform a shape analysis and to produce calibrating data based on said analysis, said shape channel producing independent representations comprising perceived locations of the objects; producing calibrating data by said shape channel after the passage of said first number of frames; tracking the objects during a second number of frames using a channel programmed to perform a color analysis, said color channel calibrated using said calibrating data obtained by said shape channel, said color channel producing independent representations comprising perceived locations of the objects.
Claim 15
Independent Claim
107 words
A method for locating objects in images, comprising: tracking the objects during a first number of frames only using a channel programmed to perform a shape analysis and to produce calibrating data based on said analysis, said shape channel producing independent representations comprising perceived locations of the objects; producing calibrating data by said shape channel after the passage of said first number of frames; tracking the objects during a second number of frames using a channel programmed to perform a color analysis, said color channel calibrated using said calibrating data obtained by said shape channel, said color channel producing independent representations comprising perceived locations of the objects.
Claim 16
Independent Claim
109 words
A method for locating objects in images, comprising: tracking the objects during a first number of frames only using a channel programmed to perform a motion analysis and to produce calibrating data based on said analysis, said motion channel producing independent representations comprising perceived locations of the objects; producing calibrating data by said motion channel after the passage of said first number of frames; and tracking the objects during a second number of frames using a second channel programmed to perform a color analysis, said second channel calibrated using said calibrating data obtained by said motion channel, said color channel producing independent representations comprising perceived locations of the objects.
Claim 17
Independent Claim
109 words
A method for locating objects in images, comprising: tracking the objects during a first number of frames only using a channel programmed to perform a motion analysis and to produce calibrating data based on said analysis, said motion channel producing independent representations comprising perceived locations of the objects; producing calibrating data by said motion channel after the passage of said first number of frames; and tracking the objects during a second number of frames using a second channel programmed to perform a color analysis, said second channel calibrated using said calibrating data obtained by said motion channel, said color channel producing independent representations comprising perceived locations of the objects.
Claim 18
Dependent Claim
16 words
The method according to claim 13, further comprising integrating said independent representations into a tracked output.
Claim 19
Dependent Claim
14 words
The method according to claim 15, wherein said integration step comprises an n-gram search.
Claim 20
Dependent Claim
16 words
The method according to claim 14, further comprising integrating said independent representations into a tracked output.
Claim 21
Dependent Claim
14 words
The method according to claim 17, wherein said integration step comprises an n-gram search.
Claim 22
Independent Claim
202 words
A method for locating heads and faces in images, comprising: tracking the heads and faces during a first number of frames using a plurality of channels; obtaining an independent intermediate feature representation from each of said plurality of channels after the passage of said first number of frames, said independent intermediate feature representations comprising data comprising perceived locations of head or facial features; running a first n-gram search using said independent intermediate feature representations, wherein a measure of confidence is computed for each of said features and combinations of features within said independent intermediate feature representations, and wherein a general score is assigned to each channel based on said measures of confidence; selecting one or more channels for additional tracking, said selection based on said general scores assigned to each channel; tracking the heads and faces during a second number of frames using said one or more selected channels; obtaining further independent feature representations from each of said one or more channels, each further independent feature representation comprising data comprising perceived locations of head or facial features; and running a second n-gram search wherein said further independent feature representations are integrated into said independent intermediate feature representations to produce a tracked output.
Claim 23
Independent Claim
202 words
A method for locating heads and faces in images, comprising: tracking the heads and faces during a first number of frames using a plurality of channels; obtaining an independent intermediate feature representation from each of said plurality of channels after the passage of said first number of frames, said independent intermediate feature representations comprising data comprising perceived locations of head or facial features; running a first n-gram search using said independent intermediate feature representations, wherein a measure of confidence is computed for each of said features and combinations of features within said independent intermediate feature representations, and wherein a general score is assigned to each channel based on said measures of confidence; selecting one or more channels for additional tracking, said selection based on said general scores assigned to each channel; tracking the heads and faces during a second number of frames using said one or more selected channels; obtaining further independent feature representations from each of said one or more channels, each further independent feature representation comprising data comprising perceived locations of head or facial features; and running a second n-gram search wherein said further independent feature representations are integrated into said independent intermediate feature representations to produce a tracked output.
Claim 24
Dependent Claim
30 words
The method of claim 19, wherein said plurality of channels used for tracking during said first number of frames comprise a shape channel, a motion channel, and a color channel.
Claim 25
Dependent Claim
93 words
The method of claim 19, wherein said plurality of channels used for tracking during said first number of frames comprise a shape channel, said tracking step using said shape channel further comprising: passing the images through a band pass filter, said band pass filter having cutoff frequencies which permit the passage of facial features through said filter; convolving the images with a structuring kernel using a second filter; and thresholding the images using an adaptive thresholding technique, wherein said thresholding step transforms the head and facial features into connected components within the images.
Claim 26
Independent Claim
150 words
A method for locating heads and faces within images, comprising: tracking the images for a first number of frames using a plurality of channels; obtaining, after the passage of said first number of frames, independent intermediate feature representations from each of said plurality of channels; evaluating said independent intermediate feature representations, said evaluation step used to determine a level of reliability for each of said plurality of channels; selecting, based on said determination of said reliability for each of said plurality of channels, one or more channels for additional tracking; tracking the images for a second number of frames using said selected one or more channels; obtaining further independent feature representations from said selected one or more channels after the passage of said second number of frames; and combining said independent intermediate feature representations and said further independent feature representations into a net representation of likely head and facial locations.
Claim 27
Independent Claim
150 words
A method for locating heads and faces within images, comprising: tracking the images for a first number of frames using a plurality of channels; obtaining, after the passage of said first number of frames, independent intermediate feature representations from each of said plurality of channels; evaluating said independent intermediate feature representations, said evaluation step used to determine a level of reliability for each of said plurality of channels; selecting, based on said determination of said reliability for each of said plurality of channels, one or more channels for additional tracking; tracking the images for a second number of frames using said selected one or more channels; obtaining further independent feature representations from said selected one or more channels after the passage of said second number of frames; and combining said independent intermediate feature representations and said further independent feature representations into a net representation of likely head and facial locations.
Claim 28
Dependent Claim
18 words
The method according to claim 22, wherein said evaluating step and said combining step comprise an n-gram search.
Claim 29
Dependent Claim
31 words
The method according to claim 22, wherein said plurality of channels used for tracking during said first number of frames comprises a shape channel, a motion channel, and a color channel.
Claim 30
Independent Claim
128 words
A method for locating objects in images, comprising: tracking the objects during a first number of frames using only a first channel programmed to perform a shape analysis and a second channel programmed to perform a motion analysis, said first and second channels producing calibrating data based on said analyses, said first and second channels each producing independent representations comprising perceived locations of the object; producing calibrating data by said first and second channels after the passage of said first number of frames; tracking the objects during a second number of frames using a channel programmed to perform a color analysis, said color channel calibrated using said calibrating data obtained by said first and second channels, said color channel producing independent representations comprising perceived locations of the objects.
Claim 31
Independent Claim
128 words
A method for locating objects in images, comprising: tracking the objects during a first number of frames using only a first channel programmed to perform a shape analysis and a second channel programmed to perform a motion analysis, said first and second channels producing calibrating data based on said analyses, said first and second channels each producing independent representations comprising perceived locations of the object; producing calibrating data by said first and second channels after the passage of said first number of frames; tracking the objects during a second number of frames using a channel programmed to perform a color analysis, said color channel calibrated using said calibrating data obtained by said first and second channels, said color channel producing independent representations comprising perceived locations of the objects.
Claim 32
Dependent Claim
16 words
The method according to claim 25, further comprising integrating said independent representations into a tracked output.
Claim 33
Dependent Claim
14 words
The method according to claim 26, wherein said integration step comprises an n-gram search.
References Cited (Backward Citations)
US4972359A
Cited
US5280530A
Cited
US5243418A
Cited
US5430809A
Cited
US5497430A
Cited
US5675663A
Cited
US5706365A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-01-25 | 2002-07-27 | 2003-01-26 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-01-25 | 2006-07-27 | 2007-01-26 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-01-25 | 2010-07-27 | 2011-01-26 | $7700.00 | Window Closed / Lapsed |