Patent US5327242A successfully refreshed from Google Patents.
US5327242A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Video noise reduction apparatus and method using three dimensional discrete cosine transforms and noise measurement
Assignee: Panasonic Corp of North America
•
Filing: 1993-03-18
•
Granted: 1994-07-05
•
Expires: 2013-03-18
Abstract
Abstract A noise component of a video signal is reduced by using a three dimensional discrete cosign transform (3-D DCT) to determine the time frequency spectrum of both the video signal and the noise component, subtracting the time frequency spectrum of the noise component from the time frequency spectrum of the video signal, and converting the time frequency spectrum of the modified video signal back to the spatial time domain by using an inverse 3-D DCT.
Inventors
- 👤 Saiprasad V. Naimpally
- 👤 Jimmy C. Tran
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-01 14:14
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/14; H04N5/21; H04N19/00; H04N19/60; H04N19/62; H04N19/649; H04N19/80
Claims Analysis
Total Claims: 26
Claim 1
Independent Claim
207 words
A method of processing a first video signal having a noise component to produce a second video signal representative of the first video signal with the noise component reduced, said method comprising the steps of: (a) taking corresponding data samples in a plurality of frames of the first video signal to produce three dimensional (3-D) blocks of time spatial samples of the first video signal; (b) transforming the 3-D blocks of time spatial samples of the first video signal to produce 3-D blocks of time frequency spectrum coefficients of the first video signal; (c) generating, from selected segments of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients of the noise component; (d) modifying the 3-D blocks of time frequency spectrum coefficients of the first video signal as a function of the 3-D block of time frequency spectrum coefficients of the noise component to produce modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal; and (e) transforming the modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal to produce corresponding 3-D blocks of data samples in a plurality of frames of the second video signal.
Claim 2
Independent Claim
207 words
A method of processing a first video signal having a noise component to produce a second video signal representative of the first video signal with the noise component reduced, said method comprising the steps of: (a) taking corresponding data samples in a plurality of frames of the first video signal to produce three dimensional (3-D) blocks of time spatial samples of the first video signal; (b) transforming the 3-D blocks of time spatial samples of the first video signal to produce 3-D blocks of time frequency spectrum coefficients of the first video signal; (c) generating, from selected segments of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients of the noise component; (d) modifying the 3-D blocks of time frequency spectrum coefficients of the first video signal as a function of the 3-D block of time frequency spectrum coefficients of the noise component to produce modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal; and (e) transforming the modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal to produce corresponding 3-D blocks of data samples in a plurality of frames of the second video signal.
Claim 3
Dependent Claim
16 words
A method according to claim 1, where step (b) and (e) use a 3-D orthogonal transform.
Claim 4
Dependent Claim
17 words
A method according to claim 2, where the 3-D orthogonal transform is a 3-D Discrete Cosine Transform.
Claim 5
Independent Claim
269 words
A method of processing a first video signal having a noise component to produce a second video signal representative of the first video signal with the noise component reduced, said method comprising the steps of: (a) taking corresponding data samples in a plurality of frames of the first video signal to produce three dimensional (3-D) blocks of time spatial samples of the first video signal; (b) transforming the 3-D blocks of time spatial samples of the first video signal to produce 3-D blocks of time frequency spectrum coefficients representing the first video signal; (c) generating, from selected segments of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients representing the noise component of the video signal to the substantial exclusion of any other components; (d) modifying the 3-D blocks of time frequency spectrum coefficients of the first video signal as a function of the 3-D block of time frequency spectrum coefficients which represent the noise component to produce modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal, wherein step (d) includes the step of generating modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal from sums and differences of corresponding coefficients of the 3-D first video signal and the 3-D blocks of time frequency spectrum coefficients which represent the noise component; and (e) transforming the modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal to produce corresponding 3-D blocks of data samples in a plurality of frames of the second video signal.
Claim 6
Independent Claim
269 words
A method of processing a first video signal having a noise component to produce a second video signal representative of the first video signal with the noise component reduced, said method comprising the steps of: (a) taking corresponding data samples in a plurality of frames of the first video signal to produce three dimensional (3-D) blocks of time spatial samples of the first video signal; (b) transforming the 3-D blocks of time spatial samples of the first video signal to produce 3-D blocks of time frequency spectrum coefficients representing the first video signal; (c) generating, from selected segments of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients representing the noise component of the video signal to the substantial exclusion of any other components; (d) modifying the 3-D blocks of time frequency spectrum coefficients of the first video signal as a function of the 3-D block of time frequency spectrum coefficients which represent the noise component to produce modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal, wherein step (d) includes the step of generating modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal from sums and differences of corresponding coefficients of the 3-D first video signal and the 3-D blocks of time frequency spectrum coefficients which represent the noise component; and (e) transforming the modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal to produce corresponding 3-D blocks of data samples in a plurality of frames of the second video signal.
Claim 7
Dependent Claim
130 words
A method according to claim 4 wherein: step (a) further comprises the step of generating one 3-D block of time spatial samples by using motion estimation (ME) to locate similar image content blocks of time spatial samples in each of the plurality of frames of the first video signal and forming the one 3-D block of time spatial samples from the selected similar image contents blocks of time spatial samples located by the ME; step (b) further comprises the step of transforming the one 3-D block of time spatial samples to a one 3-D block of time frequency spectrum coefficients; and step (c) comprises the step of generating, from the one 3-D block of time frequency spectrum coefficients, a 3-D block of time frequency spectrum coefficients of the noise component.
Claim 8
Dependent Claim
93 words
A method according to claim 4 where step (c) comprises the steps of: selecting a plurality of 3-D blocks of time frequency spectrum coefficients of the first video signal, the selected blocks representing image content areas of the first video signal that should not change from frame to frame in the plurality of frames of the first video signal; and generating, from selected segments of the plurality of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients of the noise component.
Claim 9
Dependent Claim
49 words
A method according to claim 6, where in step (c), the plurality of the 3-D blocks of time frequency spectrum coefficients of the first video signal are selected from image content areas of the first video signal that represent horizontal or vertical blanking intervals of the first video signal.
Claim 10
Dependent Claim
106 words
A method according to claim 4 where step (d) comprises the steps of: determining square roots of sums of squares of corresponding coefficients of each 3-D block of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component, where the time frequency spectrum coefficients of the first video signal have a sign; and generating modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal from the determined square roots and the sign of the corresponding coefficients of the 3-D block of time frequency spectrum coefficients of the first video signal.
Claim 11
Dependent Claim
228 words
A method according to claim 4 wherein: step (a) further comprises the step of generating one 3-D block of time spatial samples by using motion estimation (ME) to locate similar image content blocks of time spatial samples in each of the plurality of frames of the first video signal and forming the one 3-D block of time spatial samples from the selected similar image contents blocks of time spatial samples located by the ME; step (b) further comprises the step of transforming the one 3-D block of time spatial samples to one 3-D block of time frequency spectrum coefficients; step (c) comprises the step of generating, from the one 3-D block of time frequency spectrum coefficients, a 3-D block of time frequency spectrum coefficients of the noise component; and step (d) comprises the steps of: determining square roots of sums of squares of corresponding coefficients of each 3-D block of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component, where the time frequency spectrum coefficients of the first video signal have a sign; and generating modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal from the determined square roots and the sign of the corresponding coefficients of the 3-D block of time frequency spectrum coefficients of the first video signal.
Claim 12
Dependent Claim
150 words
A method according to claim 4 wherein: step (c) comprises the steps of: selecting a plurality of 3-D blocks of time frequency spectrum coefficients of the first video signal, the selected blocks representing image content areas of the first video signal that should not change from frame to frame in the plurality of frames of the first video signal; and generating, from selected segments of the plurality of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients of the noise component; and where step (d) comprises the step of generating modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal from sums and differences of corresponding coefficients of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component.
Claim 13
Dependent Claim
262 words
A method according to claim 10 where step (d) comprises: determining sums of corresponding coefficients of each of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component if the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the first video signal is less than or equal to zero and the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the first video signal is greater than or equal to the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the noise component in magnitude; determining differences of corresponding coefficients of each of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component if the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the first video signal is greater than zero and the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the first video signal is greater than or equal to the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the noise component in magnitude; and generating modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal from the determined sums and differences of the corresponding coefficients of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D blocks of time frequency spectrum coefficients of the noise component.
Claim 14
Independent Claim
217 words
A system for processing a first video signal having a noise component to produce a second video signal representative of the first video signal with the noise component reduced, said system comprising: sampling means for taking corresponding data samples in a plurality of frames of the first video signal to produce three dimensional (3-D) blocks of time spatial samples of the first video signal; first transforming means for transforming the 3-D blocks of time spatial samples of the first video signal to produce 3-D blocks of time frequency spectrum coefficients of the first video signal; noise generating means for generating, from selected segments of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients of the noise component; modifying means for modifying the 3-D blocks of time frequency spectrum coefficients of the first video signal as a function of the 3-D block of time frequency spectrum coefficients of the noise component to produce modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal; and second transforming means for transforming the modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal to produce corresponding 3-D blocks of data samples in a plurality of frames of the second video signal.
Claim 15
Independent Claim
217 words
A system for processing a first video signal having a noise component to produce a second video signal representative of the first video signal with the noise component reduced, said system comprising: sampling means for taking corresponding data samples in a plurality of frames of the first video signal to produce three dimensional (3-D) blocks of time spatial samples of the first video signal; first transforming means for transforming the 3-D blocks of time spatial samples of the first video signal to produce 3-D blocks of time frequency spectrum coefficients of the first video signal; noise generating means for generating, from selected segments of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients of the noise component; modifying means for modifying the 3-D blocks of time frequency spectrum coefficients of the first video signal as a function of the 3-D block of time frequency spectrum coefficients of the noise component to produce modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal; and second transforming means for transforming the modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal to produce corresponding 3-D blocks of data samples in a plurality of frames of the second video signal.
Claim 16
Dependent Claim
20 words
A system according to claim 12, where the first transforming means and second transforming means use a 3-D orthogonal transform.
Claim 17
Dependent Claim
17 words
A system according to claim 13, where the 3-D orthogonal transform is a 3-D Discrete Cosine Transform.
Claim 18
Independent Claim
287 words
A system for processing a first video signal having a noise component to produce a second video signal representative of the first video signal with the noise component reduced, said system comprising: sampling means for taking corresponding data samples in a plurality of frames of the first video signal to produce three dimensional (3-D) blocks of time spatial samples representing the first video signal; first transforming means for transforming the 3-D blocks of the spatial samples of the first video signal to produce 3-D blocks of time frequency spectrum coefficients representing the first video signal; noise generating means for generating, from selected segments of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients representing the noise component of the first video signal to the substantial exclusion of any other components; modifying means for modifying the 3-D blocks of time frequency spectrum coefficients of the first video signal as a function of the 3-D block of time frequency spectrum coefficients which represent the noise component to produce modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal, wherein the modifying means includes means for generating modified 3-D blocks of time frequency spectrum coefficients, which represent the second video signal, using sums and differences of corresponding coefficients of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients which represent the noise component; second transforming means for transforming the modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal to produce corresponding 3-D blocks of data samples in a plurality of frames of the second video signal.
Claim 19
Independent Claim
287 words
A system for processing a first video signal having a noise component to produce a second video signal representative of the first video signal with the noise component reduced, said system comprising: sampling means for taking corresponding data samples in a plurality of frames of the first video signal to produce three dimensional (3-D) blocks of time spatial samples representing the first video signal; first transforming means for transforming the 3-D blocks of the spatial samples of the first video signal to produce 3-D blocks of time frequency spectrum coefficients representing the first video signal; noise generating means for generating, from selected segments of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients representing the noise component of the first video signal to the substantial exclusion of any other components; modifying means for modifying the 3-D blocks of time frequency spectrum coefficients of the first video signal as a function of the 3-D block of time frequency spectrum coefficients which represent the noise component to produce modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal, wherein the modifying means includes means for generating modified 3-D blocks of time frequency spectrum coefficients, which represent the second video signal, using sums and differences of corresponding coefficients of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients which represent the noise component; second transforming means for transforming the modified 3-D blocks of time frequency spectrum coefficients which represent the second video signal to produce corresponding 3-D blocks of data samples in a plurality of frames of the second video signal.
Claim 20
Dependent Claim
133 words
A system according to claim 15 wherein: the sampling means further comprises means for generating one 3-D block of time spatial samples by using motion estimation (ME) to locate similar image content blocks of time spatial samples in each of the plurality of frames of the first video signal and for forming the one 3-D block of time spatial samples from the selected similar image contents blocks of time spatial samples located by the ME; the first transforming means further comprises means for transforming the one 3-D block of time spatial samples to a one 3-D block of time frequency spectrum coefficients; and the noise generating means comprises means for generating, from the one 3-D block of time frequency spectrum coefficients, a 3-D block of time frequency spectrum coefficients of the noise component.
Claim 21
Dependent Claim
96 words
A system according to claim 15 where the noise generating means comprises: means for selecting a plurality of 3-D blocks of time frequency spectrum coefficients of the first video signal, the selected blocks representing image content areas of the first video signal that should not change from frame to frame in the plurality of frames of the first video signal; and means for generating, from selected segments of the plurality of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients of the noise component.
Claim 22
Dependent Claim
49 words
A system according to claim 17, wherein the noise generating means selects the plurality of the 3-D blocks of time frequency spectrum coefficients of the first video signal from image content areas of the first video signal that represent horizontal or vertical blanking intervals of the first video signal.
Claim 23
Dependent Claim
108 words
A system according to claim 15 where the modifying means comprises: means for determining square roots of sums of squares of corresponding coefficients of each 3-D block of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component, where the time frequency spectrum coefficients of the first video signal have a sign; and means for generating modified 3-D blocks of time frequency spectrum coefficients, which represent the second video signal, using the determined square roots and the sign of the corresponding coefficients of the 3-D blocks of time frequency spectrum coefficients of the first video signal.
Claim 24
Dependent Claim
234 words
A system according to claim 15 wherein: the sampling means further comprises means for generating, one 3-D block of time spatial samples by using motion estimation (ME) to locate similar image content blocks of time spatial samples in each of the plurality of frames of the first video signal and for forming the one 3-D block of time spatial samples from the selected similar image contents blocks of time spatial samples located by the ME; the first transforming means further comprises means for transforming the one 3-D block of time spatial samples to a one 3-D block of time frequency spectrum coefficients; the noise generating means comprises means for generating, from the one 3-D block of time frequency spectrum coefficients, a 3-D block of time frequency spectrum coefficients of the noise component; and the modifying means comprises: means for determining square roots of sums of squares of corresponding coefficients of each 3-D block of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component, where the time frequency spectrum coefficients of the first video signal have a sign; and means for generating modified 3-D blocks of time frequency spectrum coefficients, which represent the second video signal, using the determined square roots and the sign of the corresponding coefficients of the 3-D blocks of time frequency spectrum coefficients of the first video signal.
Claim 25
Dependent Claim
152 words
A system according to claim 15 wherein: the noise generating means comprises: means for selecting a plurality of 3-D blocks of time frequency spectrum coefficients of the first video signal, the selected blocks representing image content areas of the first video signal that should not change from frame to frame in the plurality of frames of the first video signal; and means for generating, from selected segments of the plurality of the 3-D blocks of time frequency spectrum coefficients of the first video signal, a 3-D block of time frequency spectrum coefficients of the noise component; and the modifying means comprises means for generating modified 3-D blocks of time frequency spectrum coefficients, which represent the second video signal, using sums and differences of corresponding coefficients of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component.
Claim 26
Dependent Claim
269 words
A system according to claim 21 where the modifying means comprises: means for determining sums of corresponding coefficients of each of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component if the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the first video signal is less than or equal to zero and the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the first video signal is greater than or equal to the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the noise component in magnitude; means for determining differences of corresponding coefficients of each of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component if the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the first video signal is greater than zero and the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the first video signal is greater than or equal to the corresponding coefficient of the 3-D block of time frequency spectrum coefficients of the noise component in magnitude; and means for generating modified 3-D blocks of time frequency spectrum coefficients, which represent the second video signal, using the determined sums and differences of the corresponding coefficients of the 3-D blocks of time frequency spectrum coefficients of the first video signal and the 3-D block of time frequency spectrum coefficients of the noise component.
References Cited (Backward Citations)
US4435751A
Cited
US4442454A
Cited
US4549212A
Cited
US4865031A
Cited
US4807033A
Cited
JPS6416193A
Cited
JPH01226287A
Cited
JPH01233892A
Cited
JPH0272720A
Cited
JPH0292180A
Cited
JPH02117271A
Cited
EP0412713A2
Cited
US5126842A
Cited
JPH03217183A
Cited
EP0461659A2
Cited
US5128756A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1997-07-04 | 1998-01-03 | 1998-07-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2001-07-04 | 2002-01-03 | 2002-07-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2005-07-04 | 2006-01-03 | 2006-07-05 | $7700.00 | Window Closed / Lapsed |