US6205260B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Sprite-based video coding system with automatic segmentation integrated into coding and sprite building processes
Assignee: Rakuten Group Inc
•
Filing: 1997-12-29
•
Granted: 2001-03-20
•
Expires: 2017-12-29
Abstract
Abstract A sprite-based coding system includes an encoder and decoder where sprite-building is automatic and segmentation of the sprite object is automatic and integrated into the sprite building as well as the coding process. The sprite object is distinguished from the rest of the video objects on basis of its motion. The sprite object moves according to the dominant component of the scene motion, which is usually due to camera motion or zoom. Hence, the sprite-based coding system utilizes dominant motion, to distinguish background images from foreground images. The sprite-based coding system is easily integrated into a video object-based coding framework such as MPEG-4, where shape and texture of individual video objects are coded separately. The automatic segmentation integrated in the sprite-based coding system identifies the shape and texture of the sprite object.
Inventors
- 👤 Regis J. Crinon
- 👤 Muhammed Ibrahim Sezan
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 21:22
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/20; H; H04; H04N; H04N19/00; H04N19/20; H04N19/23; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933
Claims Analysis
Total Claims: 11
Claim 1
Independent Claim
217 words
A method for building in a coding environment a mosaic representing a composite of multiple images, comprising: forming a mosaic out of a first image; segmenting a second image into background regions and foreground regions by identifying changes between the second image and the mosaic; and updating the mosaic only with the segmented background regions of the second image, the method including: identifying regions that have changed between the first and second image; segmenting background regions in the second image where associated regions in a current mosaic are unknown and where there have not been any identified changes in the associated regions of the first and second image; segmenting background regions in the second image where there have not been any identified changes between the second image and the associated regions in the current mosaic; segmenting foreground regions in the second image where there have been changes between the second image and the associated regions in the current mosaic; segmenting foreground regions in the second image where there have been identified changes between first image and second image and associated regions in the current mosaic are unknown; and segmenting foreground regions in the second image where there have been identified regions that only exist in the second image and associated regions in the current mosaic are unknown.
Claim 2
Independent Claim
217 words
A method for building in a coding environment a mosaic representing a composite of multiple images, comprising: forming a mosaic out of a first image; segmenting a second image into background regions and foreground regions by identifying changes between the second image and the mosaic; and updating the mosaic only with the segmented background regions of the second image, the method including: identifying regions that have changed between the first and second image; segmenting background regions in the second image where associated regions in a current mosaic are unknown and where there have not been any identified changes in the associated regions of the first and second image; segmenting background regions in the second image where there have not been any identified changes between the second image and the associated regions in the current mosaic; segmenting foreground regions in the second image where there have been changes between the second image and the associated regions in the current mosaic; segmenting foreground regions in the second image where there have been identified changes between first image and second image and associated regions in the current mosaic are unknown; and segmenting foreground regions in the second image where there have been identified regions that only exist in the second image and associated regions in the current mosaic are unknown.
Claim 3
Dependent Claim
33 words
The method of claim 1 wherein the associated regions in the mosaic are derived by first warping the mosaic and then comparing same pixel locations in the second image and the warped mosaic.
Claim 4
Dependent Claim
20 words
The method of claim 1 including tagging background and foreground regions in the second image according to the segmented regions.
Claim 5
Dependent Claim
36 words
The method of claim 3 including: representing the background regions in the second image by encoding and decoding shape information identifying foreground regions; and tagging all non-foreground regions of the decoded second image as background regions.
Claim 6
Dependent Claim
32 words
The method of claim 1 including: determining the differences between the background regions in the second image and associated regions in the mosaic; and using the decoded differences to update the mosaic.
Claim 7
Dependent Claim
34 words
The method of claim 5 including transmitting the encoded differences over a transmission medium to a decoder; and using the encoded differences in the background regions to update a second mosaic in the decoder.
Claim 8
Dependent Claim
28 words
The method of claim 1 including applying a blending factor that selectively varies an amount of the mosaic updated with the associated background region of the second image.
Claim 9
Dependent Claim
60 words
The method of claim 7 including the following: conducting a configuration phase where a background mosaic is built off line; setting the blending factor to zero to prevent the mosaic from being updated for a given period of time after the configuration phase; and using the mosaic during the given period of time to encode and decode transmitted image data.
Claim 10
Dependent Claim
37 words
The method of claim 1 including: setting the entire second image to a single background region to avoid having to send shape information; and setting the blending factor to always incorporate data representing the decoded second image.
Claim 11
Dependent Claim
19 words
The method of claim 1 including selecting a fixed initial warping transformation for optimizing viewing conditions and mosaic quality.
References Cited (Backward Citations)
US5649032A
Cited
US5999662A
Cited
US5686956A
Cited
US5896176A
Cited
US5778098A
Cited
US6037988A
Cited
US5943445A
Cited
US5956026A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-03-19 | 2004-09-18 | 2005-03-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-03-19 | 2008-09-18 | 2009-03-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-03-19 | 2012-09-18 | 2013-03-20 | $7700.00 | Window Closed / Lapsed |