Patent US5646679A successfully refreshed from Google Patents.
US5646679A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image combining method and apparatus
Assignee: Canon Inc
•
Filing: 1995-06-28
•
Granted: 1997-07-08
•
Expires: 2015-06-28
Abstract
Abstract In image combining method of phototaking an object to be photographed by using a plurality of image taking systems with portions of fields of view thereof overlapping, and forming combined image information by combining pieces of image information obtained by the image taking systems, coordinates changing processing is performed by using the distance information of an object to be photographed, and image signals output from the respective image taking systems are compensated in accordance with the changed coordinates. One of the compensated image signals is selected with respect to a region where a far-distance portion of the object is concealed by a near-distance object, of the overlapping region of a combined image signal. With this operation, a plurality of image signals output from the respective image taking systems are combined into one image signal output in a state defined by an arbitrary object distance and the imaging magnification from an image taking system in which the viewpoint position and the optical axis direction are defined by the shift amount of the viewpoint position from each image taking system and the convergence angle of the optical axis.
Inventors
- 👤 Kotaro Yano
- 👤 Katsumi Iijima
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-02 21:22
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4007; G06T3/4038; H; H04; H04N; H04N13/00; H04N13/20; H04N13/204; H04N13/239; H04N13/296; H04N7/00; H04N7/18; H04N7/181; G03; G03B; G03B2213/00; G03B2213/02; G03B2213/025; G06T2207/00; G06T2207/10; G06T2207/10004; G06T2207/10012; H04N13/10; H04N13/189; H04N2013/0074; H04N2013/0081; H04N2013/0088
Claims Analysis
Total Claims: 8
Claim 1
Independent Claim
185 words
An image combining method for image-taking an object by using a plurality of image taking systems, and forming combined image information by combining pieces of image information obtained by said image taking systems, comprising the steps of: extracting corresponding point information between the pieces of image information; calculating distance information by using optical information in each of said image taking systems and the corresponding point information; sequentially generating two-dimensional coordinates of a display image based on the combined image information; changing the two-dimensional coordinates to two-dimensional coordinates of each piece of image information by using the optical information and the distance information; performing compensation processing for each piece of image information on the basis of the changed two-dimensional coordinates for each piece of image information; determining an occlusion portion in which a far-distance portion of the object is concealed by a near-distance portion, of an overlapping region of images on the basis of the corresponding point information; and selecting one of pieces of compensated image information with respect to the occlusion portion in forming combined image information by combining the pieces of compensated image information.
Claim 2
Dependent Claim
185 words
An image combining method for image-taking an object by using a plurality of image taking systems, and forming combined image information by combining pieces of image information obtained by said image taking systems, comprising the steps of: extracting corresponding point information between the pieces of image information; calculating distance information by using optical information in each of said image taking systems and the corresponding point information; sequentially generating two-dimensional coordinates of a display image based on the combined image information; changing the two-dimensional coordinates to two-dimensional coordinates of each piece of image information by using the optical information and the distance information; performing compensation processing for each piece of image information on the basis of the changed two-dimensional coordinates for each piece of image information; determining an occlusion portion in which a far-distance portion of the object is concealed by a near-distance portion, of an overlapping region of images on the basis of the corresponding point information; and selecting one of pieces of compensated image information with respect to the occlusion portion in forming combined image information by combining the pieces of compensated image information.
Claim 3
Dependent Claim
40 words
A method according to claim 1, wherein the step of selecting compensated image information with respect to the occlusion portion includes the step of selecting compensated image information exhibiting the least occlusion portion, of the pieces of compensated image information.
Claim 4
Dependent Claim
212 words
An image combining apparatus for image-taking an object by using a plurality of image taking systems, and forming combined image information by combining pieces of image information obtained by said image taking systems, comprising: corresponding points extracting means for extracting corresponding point information between the pieces of image information; distance information calculating means for calculating distance information by using optical information in each of said image taking systems and the corresponding point information; address generating means for sequentially generating two-dimensional coordinates of a display image based on the combined image information; coordinates changing means for changing the two-dimensional coordinates to two-dimensional coordinates of each piece of image information by using the optical information and the distance information; image information compensating means for performing compensation processing for each piece of image information on the basis of the changed two-dimensional coordinates for each piece of image information; determining means for determining an occlusion portion in which a far-distance portion of the object is concealed by a near-distance portion, of an overlapping region of phototaken images on the basis of the corresponding point information; and selecting means for selecting one of pieces of compensated image information with respect to the occlusion portion in forming combined image information by combining the pieces of compensated image information.
Claim 5
Dependent Claim
212 words
An image combining apparatus for image-taking an object by using a plurality of image taking systems, and forming combined image information by combining pieces of image information obtained by said image taking systems, comprising: corresponding points extracting means for extracting corresponding point information between the pieces of image information; distance information calculating means for calculating distance information by using optical information in each of said image taking systems and the corresponding point information; address generating means for sequentially generating two-dimensional coordinates of a display image based on the combined image information; coordinates changing means for changing the two-dimensional coordinates to two-dimensional coordinates of each piece of image information by using the optical information and the distance information; image information compensating means for performing compensation processing for each piece of image information on the basis of the changed two-dimensional coordinates for each piece of image information; determining means for determining an occlusion portion in which a far-distance portion of the object is concealed by a near-distance portion, of an overlapping region of phototaken images on the basis of the corresponding point information; and selecting means for selecting one of pieces of compensated image information with respect to the occlusion portion in forming combined image information by combining the pieces of compensated image information.
Claim 6
Dependent Claim
35 words
An apparatus according to claim 3, wherein in selecting compensated image information with respect to the occlusion portion, compensated image information exhibiting the least occlusion portion is selected from the pieces of compensated image information.
Claim 7
Dependent Claim
42 words
An apparatus according to claim 3, further comprising image correlating means for dividing each compensated image information into small regions, and determining an occlusion portion in accordance with a similarity between corresponding small regions of the respective pieces of compensated image information.
Claim 8
Dependent Claim
35 words
An apparatus according to claim 5, wherein in selecting compensated image information with respect to the occlusion portion, compensated image information exhibiting the least occlusion portion is selected from the pieces of compensated image information.
References Cited (Backward Citations)
US4825393A
Cited
US5142642A
Cited
US5253302A
Cited
US5175616A
Cited
US5432543A
Cited
US5424773A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-07-07 | 2001-01-06 | 2001-07-08 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-07-07 | 2005-01-06 | 2005-07-08 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-07-07 | 2009-01-06 | 2009-07-08 | $7700.00 | Window Closed / Lapsed |