US6166744A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System for combining virtual images with real-world scenes
Assignee: Microsoft Technology Licensing LLC
•
Filing: 1998-09-15
•
Granted: 2000-12-26
•
Expires: 2018-09-15
Abstract
Abstract A system for combining virtual images with images of the real world. A range scanner determines the shape and distance of real-world objects within a field of interest to the observer using the apparatus. Virtual masking objects, which are simplified computer models of real-world objects, are derived from the range data. Virtual entities that are not present in the real world are simulated in an electronic computer. Images of the virtual entities and the virtual masking objects are combined into masked virtual images. The masked virtual images show the portions of virtual entities that would be visible if these entities actually existed in the real world. The masked virtual images and images of the real world scene are combined in such a manner that the virtual images appear to be obscured, when appropriate for their simulated, virtual location by real-world objects. The resulting combined image is presented in an electronic or optical display.
Inventors
- 👤 Ivan J. Jaszlics
- 👤 Sheila L. Jaszlics
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-08 09:41
CPC Classifications
G; G06; G06T; G06T17/00
Claims Analysis
Total Claims: 32
Claim 1
Independent Claim
139 words
A system for combining virtual images with a real-world scene within a field of interest for an observer, said system comprising: a range scanner scanning the field of interest and generating range data indicating the distance of real-world objects within the field of interest; a computer model simulating a virtual entity and producing a virtual image of said virtual entity at a location within the field of interest; means for generating masked virtual objects from said range data and said virtual image indicating those portions of said virtual image that are visible in the field of interest; means for combining said masked virtual objects and a real-world image of the field of interest to create a combined image in which said virtual image appears in the real-world image; and display means for displaying said combined image to the observer.
Claim 2
Independent Claim
139 words
A system for combining virtual images with a real-world scene within a field of interest for an observer, said system comprising: a range scanner scanning the field of interest and generating range data indicating the distance of real-world objects within the field of interest; a computer model simulating a virtual entity and producing a virtual image of said virtual entity at a location within the field of interest; means for generating masked virtual objects from said range data and said virtual image indicating those portions of said virtual image that are visible in the field of interest; means for combining said masked virtual objects and a real-world image of the field of interest to create a combined image in which said virtual image appears in the real-world image; and display means for displaying said combined image to the observer.
Claim 3
Dependent Claim
32 words
The system of claim 1 wherein said display means comprises the imaging system of an armored vehicle and wherein the field of view comprises the field of view through said imaging system.
Claim 4
Dependent Claim
34 words
The system of claim 1 wherein said display means comprises the display of an aircraft simulator and wherein the field of view comprises the field of view from the cockpit of a simulated aircraft.
Claim 5
Dependent Claim
28 words
The system of claim 1 wherein said display means comprises an electronically-controlled visor and wherein the field of view comprises the field of view visible through said visor.
Claim 6
Dependent Claim
38 words
The system of claim 1 wherein said display means comprises the display system of a computing device and wherein the field of view comprises the field of view of a video camera transmitting images to said computing device.
Claim 7
Dependent Claim
60 words
The system of claim 1 further comprising means for generating virtual masking objects from said range data corresponding to real-world objects within the field of interest, and wherein said means for generating masked virtual objects combines said virtual masking objects with said virtual image to determine those portions of said virtual image that are visible in the field of interest.
Claim 8
Dependent Claim
26 words
The system of claim 6 wherein said virtual masking objects, said virtual images, and said masked virtual objects are defined in virtual reality modeling language (VRML).
Claim 9
Dependent Claim
19 words
The system of claim 1 further comprising control means for enabling the observer to change the field of view.
Claim 10
Dependent Claim
23 words
The system of claim 1 further comprising means for enabling the observer to interact with said computer model simulation and said virtual image.
Claim 11
Dependent Claim
21 words
The system of claim 1 wherein said range scanner periodically scans an array of ranging sectors in the field of view.
Claim 12
Dependent Claim
20 words
The system of claim 10 further comprising means for extrapolating changes in said masked virtual objects between said periodic scans.
Claim 13
Independent Claim
126 words
A method for combining virtual images with a real-world scene within a field of interest for an observer, said method comprising: scanning the field of interest to generate range data indicating the distance of real-world objects within the field of interest; simulating a virtual entity to produce a virtual image of said virtual entity at a location within the field of interest; generating masked virtual objects from said range data and said virtual image indicating those portions of said virtual image that are visible in the field of interest; combining said masked virtual objects and a real-world image of the field of interest to create a combined image in which said virtual image appears in the real-world image; and displaying said combined image to the observer.
Claim 14
Independent Claim
126 words
A method for combining virtual images with a real-world scene within a field of interest for an observer, said method comprising: scanning the field of interest to generate range data indicating the distance of real-world objects within the field of interest; simulating a virtual entity to produce a virtual image of said virtual entity at a location within the field of interest; generating masked virtual objects from said range data and said virtual image indicating those portions of said virtual image that are visible in the field of interest; combining said masked virtual objects and a real-world image of the field of interest to create a combined image in which said virtual image appears in the real-world image; and displaying said combined image to the observer.
Claim 15
Dependent Claim
34 words
The method of claim 12 wherein said combined image is displayed through the imaging system of an armored vehicle and wherein the field of view comprises the field of view through said imaging system.
Claim 16
Dependent Claim
36 words
The method of claim 12 wherein said combined image is displayed through the display of an aircraft simulator and wherein the field of view comprises the field of view from the cockpit of a simulated aircraft.
Claim 17
Dependent Claim
30 words
The method of claim 12 wherein said combined image is displayed through an electronically-controlled visor and wherein the field of view comprises the field of view visible through said visor.
Claim 18
Dependent Claim
39 words
The method of claim 12 wherein said combined image is displayed through the display of a computing device and wherein the field of view comprises the field of view of a video camera transmitting images to said computing device.
Claim 19
Dependent Claim
19 words
The method of claim 12 wherein said combined image is injected into the optical train of an optical instrument.
Claim 20
Dependent Claim
58 words
The method of claim 12 further comprising generating virtual masking objects from said range data corresponding to real-world objects within the field of interest, and wherein said step of generating masked virtual objects combines said virtual masking objects with said virtual image to determine those portions of said virtual image that are visible in the field of interest.
Claim 21
Dependent Claim
26 words
The method of claim 18 wherein said virtual masking objects, said virtual images, and said masked virtual objects are defined in virtual reality modeling language (VRML).
Claim 22
Dependent Claim
19 words
The method of claim 12 further comprising providing controls to enable the observer to change the field of view.
Claim 23
Dependent Claim
22 words
The method of claim 12 further comprising providing controls to enable the observer to interact with said simulation of said virtual entity.
Claim 24
Dependent Claim
23 words
The method of claim 12 wherein said step of scanning comprises periodically scanning an array of ranging sectors in the field of view.
Claim 25
Dependent Claim
18 words
The method of claim 22 further comprising extrapolating changes in said masked virtual objects between said periodic scans.
Claim 26
Independent Claim
153 words
A method for combining virtual images with a real-world scene within a field of interest for an observer, said method comprising: scanning the field of interest to generate range data for a two-dimensional array of range sectors indicating the distance of real-world objects within the field of interest; generating virtual masking objects from said range data corresponding to real-world objects within the field of interest; simulating a virtual entity to produce a virtual image of said virtual entity at a location within the field of interest; combining said virtual image and said virtual masking objects to generate a masked virtual object indicating those portions of said virtual image that are visible in the field of interest; combining said masked virtual objects and the real-world image of the field of interest to create a combined image in which said virtual image appears in the real-world image; and displaying said combined image to the observer.
Claim 27
Independent Claim
153 words
A method for combining virtual images with a real-world scene within a field of interest for an observer, said method comprising: scanning the field of interest to generate range data for a two-dimensional array of range sectors indicating the distance of real-world objects within the field of interest; generating virtual masking objects from said range data corresponding to real-world objects within the field of interest; simulating a virtual entity to produce a virtual image of said virtual entity at a location within the field of interest; combining said virtual image and said virtual masking objects to generate a masked virtual object indicating those portions of said virtual image that are visible in the field of interest; combining said masked virtual objects and the real-world image of the field of interest to create a combined image in which said virtual image appears in the real-world image; and displaying said combined image to the observer.
Claim 28
Dependent Claim
26 words
The method of claim 24 wherein said virtual masking objects, said virtual images, and said masked virtual objects are defined in virtual reality modeling language (VRML).
Claim 29
Dependent Claim
19 words
The method of claim 24 further comprising providing controls to enable the observer to change the field of view.
Claim 30
Dependent Claim
22 words
The method of claim 24 further comprising providing controls to enable the observer to interact with said simulation of said virtual entity.
Claim 31
Dependent Claim
23 words
The method of claim 24 wherein said step of scanning comprises periodically scanning an array of ranging sectors in the field of view.
Claim 32
Dependent Claim
17 words
The method of claim 28 further comprising extrapolating changes in said virtual masking objects between said scans.
References Cited (Backward Citations)
US4970666A
Cited
US5214615A
Cited
US5130794A
Cited
US5684943A
Cited
US5479597A
Cited
US5355325A
Cited
US5502747A
Cited
US5347400A
Cited
US5544249A
Cited
US5625765A
Cited
US5510832A
Cited
US5436638A
Cited
US5412619A
Cited
US5616030A
Cited
US5488508A
Cited
US5563988A
Cited
US5566370A
Cited
US5737533A
Cited
US5781198A
Cited
US5854857A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-12-26 | 2004-06-26 | 2004-12-26 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-12-26 | 2008-06-26 | 2008-12-26 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-12-26 | 2012-06-26 | 2012-12-26 | $7700.00 | Window Closed / Lapsed |