US5488674A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method for fusing images and apparatus therefor
Assignee: Sarnoff Corp
•
Filing: 1993-05-12
•
Granted: 1996-01-30
•
Expires: 2013-05-12
Abstract
Abstract A method for fusing two or more source images to form a composite image with extended information content which may be color augmented and apparatus for forming the composite image from the source images is disclosed. Each source image is decomposed into a number of source images of varying resolution. The decomposed source images are analyzed using directionally sensitive operators to generate a set of oriented basis functions characteristic of the information content of the original images. The oriented basis functions for the composite image are then selected from those of the different source images and the inverse of the decomposition performed to construct the composite image. Color augmentation provides information as to the relative weighting of the contribution of each source to the composite image.
Inventors
- 👤 Peter J. Burt
- 👤 Gooitzen S. van der Wal
- 👤 Raymond J. Kolczynski
- 👤 Rajesh Hingorani
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-29 05:15
CPC Classifications
G; G06; G06T; G06T5/00; G06T5/50; H; H04; H04N; H04N19/00; H04N19/20; H04N19/23; H04N7/00; H04N7/18; H04N7/181; G06T2207/00; G06T2207/20; G06T2207/20016; G06T2207/20212; G06T2207/20221
Claims Analysis
Total Claims: 9
Claim 1
Independent Claim
178 words
In apparatus for forming a composite image from at least first and second monochrome source images comprising first means for decomposing each of the source images into a set of a plurality of component patterns and deriving a monochrome composite image in response to a weighted average of amplitudes of the component patterns of the source images; the combination therewith of: second means for assigning amplitudes of a first of opponent colors to first component patterns of a source image in accordance with their normalized weight contribution to said weighted average of the amplitudes of the component patterns of the source images; and third means for assigning amplitudes of a second of said opponent colors to second component patterns of a source image in accordance with their normalized weight contributions to said weighted average of the amplitudes of the component patterns of the source images; and fourth means responsive to outputs from said first, second and third means for augmenting said monochrome composite image with said first and second opponent colors thereby to provide a color composite image.
Claim 2
Dependent Claim
178 words
In apparatus for forming a composite image from at least first and second monochrome source images comprising first means for decomposing each of the source images into a set of a plurality of component patterns and deriving a monochrome composite image in response to a weighted average of amplitudes of the component patterns of the source images; the combination therewith of: second means for assigning amplitudes of a first of opponent colors to first component patterns of a source image in accordance with their normalized weight contribution to said weighted average of the amplitudes of the component patterns of the source images; and third means for assigning amplitudes of a second of said opponent colors to second component patterns of a source image in accordance with their normalized weight contributions to said weighted average of the amplitudes of the component patterns of the source images; and fourth means responsive to outputs from said first, second and third means for augmenting said monochrome composite image with said first and second opponent colors thereby to provide a color composite image.
Claim 3
Dependent Claim
56 words
The apparatus of claim 1 wherein said color composite image is an NTSC video image in which said fourth means derives the Y luminance channel thereof from the output of said first means, the I chrominance channel from the output of said second means, and the Q chrominance channel from the output of said third means.
Claim 4
Dependent Claim
176 words
The apparatus of claim 1 wherein said first means includes a first means for deriving a first set of given different resolution component patterns of said first source image, a second means for deriving a corresponding second set of said given different resolution component patterns of said second source image, and a first reconstruction means responsive to a weighted average of each corresponding pair of component patterns of said first and second sets having the same resolution for deriving said monochrome composite image; and wherein: said second means includes a second reconstruction means responsive to the normalized weights of a first selected group of said given different resolution component patterns of said first and/or second source images for deriving a first weighting image for said first of said opponent colors; and said third means includes a third reconstruction means responsive to the normalized weights of a second selected group of said given different resolution component patterns of said first and/or second source images for deriving a second weighting image for said second of said opponent colors.
Claim 5
Dependent Claim
47 words
The apparatus of claim 3 wherein said first and second means are Laplacian means and said first reconstruction means is an RE or FSD Laplacian pyramid; and wherein each of said second and third reconstruction means is a Gaussian reconstruction pyramid deriving respective normalized output amplitudes therefrom.
Claim 6
Dependent Claim
44 words
The apparatus of claim 4 wherein said first and second means are gradient pyramids and said first reconstruction means is a gradient pyramid; and wherein each of said second and third reconstruction means is a gradient reconstruction means deriving respective normalized output amplitudes therefrom.
Claim 7
Independent Claim
190 words
A method for forming a composite image from N source images where N is greater than one comprising the steps of: a) decomposing each source image I n into a plurality L of sets of component patterns P n (m, l), where n is indicative of the N th source image and m is the number of patterns in each of the L sets; (b) computing a match measure M n1 ,n2 (m, l) for the source images, where n1 is the first and and n2 is the second of each pair of patterns being matched; (c) computing a saliency measure S n (m, l) for a component pattern P n (m, l); (d) selecting component patterns from the component pattern sets P n (m, l) using the match measures M n1 ,n2 (m, l) and the saliency measures S n (m, l) to form a set of component patterns P c (m, l) for the composite image, where c is indicative of the formed component patterns of the set being composite component patterns; and (e) constructing the composite image from the set of component patterns P c (m, l).
Claim 8
Independent Claim
190 words
A method for forming a composite image from N source images where N is greater than one comprising the steps of: a) decomposing each source image I n into a plurality L of sets of component patterns P n (m, l), where n is indicative of the N th source image and m is the number of patterns in each of the L sets; (b) computing a match measure M n1 ,n2 (m, l) for the source images, where n1 is the first and and n2 is the second of each pair of patterns being matched; (c) computing a saliency measure S n (m, l) for a component pattern P n (m, l); (d) selecting component patterns from the component pattern sets P n (m, l) using the match measures M n1 ,n2 (m, l) and the saliency measures S n (m, l) to form a set of component patterns P c (m, l) for the composite image, where c is indicative of the formed component patterns of the set being composite component patterns; and (e) constructing the composite image from the set of component patterns P c (m, l).
Claim 9
Dependent Claim
65 words
The method of claim 6 wherein said component patterns P n (m, l) into which said plurality L of sets of each source image I n are decomposed by step (a) are oriented component patterns; whereby oriented component patterns are selected by step (d) to form the set of component patterns P c (m, l) from which the composite image is constructed by step (e).
References Cited (Backward Citations)
US4661986A
Cited
US4639768A
Cited
US4692806A
Cited
US4703514A
Cited
US4849746A
Cited
US5140416A
Cited
US5210799A
Cited
US5259040A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-01-29 | 1999-07-31 | 2000-01-30 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-01-29 | 2003-07-31 | 2004-01-30 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-01-29 | 2007-07-31 | 2008-01-30 | $7700.00 | Window Closed / Lapsed |