Patent US5174641A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5174641A Expired / Lapsed US ⏱️ 0.0 years remaining

Video encoding method for television applications

Assignee: Massachusetts Institute of Technology
•
Filing: 1990-07-25
•
Granted: 1992-12-29
•
Expires: 2010-07-25
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Continuously monitoring successive frames of a video signal and deciding, based on the similarity between the frames, whether to encode one of them with low or high information content, i.e., as a "low-resolution" frame or a "high-resolution" frame, and whether to encode the next transmitted frame as a low- resolution frame or as a high-resolution frame, and, when sending a high-resolution frame, determining whether to transmit an indication to re-display the past frame or to transmit an indication to display the high-resolution frame as a representation of the present frame. The compression method provides efficient compression of a video signal. A single future frame embodiment allows up to a doubling of the number of pixels transmitted through a channel. With multiple frame systems, even higher compression ratios are possible. Further improvements in compression ratios may be obtained by compressing the individual frames.

Inventors

  • 👤 Jae S. Lim

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-08 12:01
CPC Classifications
H; H04; H04N; H04N7/00; H04N7/01; H04N7/0112; H04N19/00; H04N19/50; H04N19/503; H04N19/59; H04N19/30

Claims Analysis

Total Claims: 40
Claim 1
Independent Claim 110 words
A method for encoding a video signal, comprising the steps of continuously monitoring at least a present frame, a past frame, and a future frame in said video signal, determining from said frames whether said present frame is similar to said past frame and whether said present frame is similar to said future frame, based on said determinations deciding whether to encode the next transmitted frame as a low-resolution frame or a high-resolution frame and, when sending a high-resolution frame, determining whether to transmit an indication to re-display said past frame or to transmit an indication to display said high-resolution frame being sent as a representation of said present frame.
Claim 2
Independent Claim 110 words
A method for encoding a video signal, comprising the steps of continuously monitoring at least a present frame, a past frame, and a future frame in said video signal, determining from said frames whether said present frame is similar to said past frame and whether said present frame is similar to said future frame, based on said determinations deciding whether to encode the next transmitted frame as a low-resolution frame or a high-resolution frame and, when sending a high-resolution frame, determining whether to transmit an indication to re-display said past frame or to transmit an indication to display said high-resolution frame being sent as a representation of said present frame.
Claim 3
Dependent Claim 31 words
The method of claim 1 further comprising the step of determining whether said past frame was a high-resolution frame and using said determination of resolution as a factor in said decision.
Claim 4
Dependent Claim 52 words
The method of claim 2 wherein said determination of resolution occurs before said determination of similarity between said present frame and said past frame, and renders said determination of similarity between said present frame and said past frame unnecessary for at least some of the frames, whereby computational resources may be conserved.
Claim 5
Dependent Claim 34 words
The method of claim 1 wherein said low-resolution frames are placed in a format that allows them to be encoded using the same method for encoding frames as that used for the high-resolution frames.
Claim 6
Dependent Claim 26 words
The method of claim 4 wherein said low-resolution frames are transmitted as partial frames and the frames are filled before being displayed, using an interpolation technique.
Claim 7
Dependent Claim 12 words
The method of claim 5 wherein said interpolation is a line-interpolation technique.
Claim 8
Dependent Claim 12 words
The method of claim 5 wherein said interpolation is a column-interpolation technique.
Claim 9
Dependent Claim 15 words
The method of claim 1 wherein said video signal contains information in 3-2 pull-down format.
Claim 10
Dependent Claim 33 words
The method of claim 1 wherein at least one of said steps of determining similarity is performed with a frame that has been reconstructed from the encoded frame by decoding said encoded frame.
Claim 11
Dependent Claim 80 words
The method of claim 1 further including the step of encoding, and then reconstructing by decoding, said future frame before said determination of whether said present frame is similar to said future frame, and the step of reconstructing said past frame by decoding an encoded version of said past frame before said determination of whether said present frame is similar to said past frame, and wherein said steps of determining similarity are based on said reconstructed present and past frames.
Claim 12
Dependent Claim 19 words
The method of claim 1 wherein said determinations are made based on evaluating a gauging function against a threshold.
Claim 13
Dependent Claim 14 words
The method of claim 11 wherein said gauging function is a mean-square error function.
Claim 14
Dependent Claim 20 words
The method of claim 11 wherein said gauging function includes a motion compensated mean-square error function and a displacement magnitude.
Claim 15
Dependent Claim 43 words
The method of claim 1 wherein said determinations of similarity are used to determine whether said present frame should be represented as said past frame or said future frame when said present frame is similar to both said past and said future frames.
Claim 16
Dependent Claim 54 words
The method of claim 14 wherein said determinations of whether said present frame is similar to said past frame and whether said present frame is similar to said future frame are weighted unequally relative to each other to achieve a preference for representing said present frame as said past frame or said future frame.
Claim 17
Dependent Claim 12 words
The method of claim 15 wherein said preference favors said future frame.
Claim 18
Dependent Claim 27 words
The method of claim 1 wherein the step of monitoring frames includes more than three frames and wherein further determinations are made based on said further frames.
Claim 19
Independent Claim 211 words
A method for encoding a video signal, comprising the steps of continuously monitoring at least a present frame, a past frame, and a future frame in said video signal, determining whether said present frame is similar to said future frame, determining whether said past frame and said present frame are similar, I) if said present and future frames are determined to be similar, and said past and present frames are determined to be similar, then representing the present frame by one of the past or future frames based on a certain measure and encoding the future frame in high-resolution format, II) if said present and future frames are determined to be different and said past and present frames are determined to be similar, then representing the present frame by the past frame and encoding the future frame in high-resolution format, III) if said present and future frames are determined to be similar and said past and present frames are determined to be different, then representing the present frame by the future frame and encoding the future frame in high-resolution format, IV) if said present and future frames are determined to be different, and said past and present frames are determined to be different, then encoding the present frame in low-resolution format.
Claim 20
Independent Claim 211 words
A method for encoding a video signal, comprising the steps of continuously monitoring at least a present frame, a past frame, and a future frame in said video signal, determining whether said present frame is similar to said future frame, determining whether said past frame and said present frame are similar, I) if said present and future frames are determined to be similar, and said past and present frames are determined to be similar, then representing the present frame by one of the past or future frames based on a certain measure and encoding the future frame in high-resolution format, II) if said present and future frames are determined to be different and said past and present frames are determined to be similar, then representing the present frame by the past frame and encoding the future frame in high-resolution format, III) if said present and future frames are determined to be similar and said past and present frames are determined to be different, then representing the present frame by the future frame and encoding the future frame in high-resolution format, IV) if said present and future frames are determined to be different, and said past and present frames are determined to be different, then encoding the present frame in low-resolution format.
Claim 21
Independent Claim 338 words
A method for encoding a video signal, comprising the steps of continuously monitoring at least a present frame, a past frame, and a future frame in said video signal, determining whether said present frame is similar to said future frame, determining whether said past frame was encoded in high-resolution format or in low-resolution format, if said past frame was encoded in high-resolution format, determining whether said past frame and said present frame are similar, I) if said present and future frames are determined to be similar, and said past and present frames are determined to be similar, and said past frame was encoded in high-resolution format, then representing the present frame by one of the past or future frames based on a certain measure and encoding the future frame in high-resolution format, II) if said present and future frames are determined to be different and said past and present frames are determined to be similar and said past frame was encoded in high-resolution format, then representing the present frame by the past frame and encoding the future frame in high-resolution format, III) if said present and future frames are determined to be similar and said past and present frames are determined to be different and said past frame was encoded in high-resolution format, then representing the present frame by the future frame and encoding the future frame in high-resolution format, IV) if said present and future frames are determined to be different, and said past and present frames are determined to be different, and said past frame was encoded in low-resolution format, then encoding the present frame in low-resolution format, V) if said present and future frames are determined to be similar and said past frame was encoded in low-resolution format, then representing the present frame by the future frame and encoding the future frame in high-resolution format, and VI) if said present and future frames are determined to be different, and said past frame was encoded in low-resolution format, then encoding the present frame in low-resolution format.
Claim 22
Independent Claim 338 words
A method for encoding a video signal, comprising the steps of continuously monitoring at least a present frame, a past frame, and a future frame in said video signal, determining whether said present frame is similar to said future frame, determining whether said past frame was encoded in high-resolution format or in low-resolution format, if said past frame was encoded in high-resolution format, determining whether said past frame and said present frame are similar, I) if said present and future frames are determined to be similar, and said past and present frames are determined to be similar, and said past frame was encoded in high-resolution format, then representing the present frame by one of the past or future frames based on a certain measure and encoding the future frame in high-resolution format, II) if said present and future frames are determined to be different and said past and present frames are determined to be similar and said past frame was encoded in high-resolution format, then representing the present frame by the past frame and encoding the future frame in high-resolution format, III) if said present and future frames are determined to be similar and said past and present frames are determined to be different and said past frame was encoded in high-resolution format, then representing the present frame by the future frame and encoding the future frame in high-resolution format, IV) if said present and future frames are determined to be different, and said past and present frames are determined to be different, and said past frame was encoded in low-resolution format, then encoding the present frame in low-resolution format, V) if said present and future frames are determined to be similar and said past frame was encoded in low-resolution format, then representing the present frame by the future frame and encoding the future frame in high-resolution format, and VI) if said present and future frames are determined to be different, and said past frame was encoded in low-resolution format, then encoding the present frame in low-resolution format.
Claim 23
Independent Claim 94 words
A method for decoding an encoded video signal comprising the steps of receiving said video signal as a series of frames encoded as high-resolution frames and low-resolution frames, and indications indicating which of said high-resolution frames are to be repeated and whether said high-resolution frames are to be repeated to replace a later frame or an earlier frame producing a decoded series of video frames from said series of received frames and said indications, wherein at least some of said high-resolution frames are repeated at least once in said decoded series of video frames.
Claim 24
Independent Claim 94 words
A method for decoding an encoded video signal comprising the steps of receiving said video signal as a series of frames encoded as high-resolution frames and low-resolution frames, and indications indicating which of said high-resolution frames are to be repeated and whether said high-resolution frames are to be repeated to replace a later frame or an earlier frame producing a decoded series of video frames from said series of received frames and said indications, wherein at least some of said high-resolution frames are repeated at least once in said decoded series of video frames.
Claim 25
Independent Claim 122 words
A method for decoding a video signal including a series of encoded frames wherein at least some of said frames are high resolution frames, said signal also including indications indicating which of said high-resolution frames are to be repeated and whether said high-resolution frames are to be repeated to replace a later frame or an earlier frame comprising receiving said encoded frames, buffering information from each of said received frames in a plurality of buffers, and producing a decoded series of video frames from said series of received frames and said indications, by alternatively accessing the buffered frames and repeating said at least some of said high-resolution frames in said decoded series based on said indications by re-accessing one of said buffers.
Claim 26
Independent Claim 122 words
A method for decoding a video signal including a series of encoded frames wherein at least some of said frames are high resolution frames, said signal also including indications indicating which of said high-resolution frames are to be repeated and whether said high-resolution frames are to be repeated to replace a later frame or an earlier frame comprising receiving said encoded frames, buffering information from each of said received frames in a plurality of buffers, and producing a decoded series of video frames from said series of received frames and said indications, by alternatively accessing the buffered frames and repeating said at least some of said high-resolution frames in said decoded series based on said indications by re-accessing one of said buffers.
Claim 27
Dependent Claim 15 words
The method of claim 21 wherein said plurality of buffers is a pair of buffers.
Claim 28
Dependent Claim 121 words
Apparatus for encoding a video signal, comprising circuitry for continuously monitoring at least a present frame, a past frame, and a future frame in said video signal, including computational circuitry for determining from said frames whether said present frame is similar to said past frame and whether said present frame is similar to said future frame, encoding circuitry, associated with said computational circuitry, for encoding the next transmitted frame as a low-resolution frame or a high-resolution frame and, when sending a high-resolution frame, determining whether to transmit an indication to re-display said past frame or to transmit an indication to display said high-resolution frame being sent as a representation of said present frame based on determinations obtained from said computational circuitry.
Claim 29
Dependent Claim 121 words
Apparatus for encoding a video signal, comprising circuitry for continuously monitoring at least a present frame, a past frame, and a future frame in said video signal, including computational circuitry for determining from said frames whether said present frame is similar to said past frame and whether said present frame is similar to said future frame, encoding circuitry, associated with said computational circuitry, for encoding the next transmitted frame as a low-resolution frame or a high-resolution frame and, when sending a high-resolution frame, determining whether to transmit an indication to re-display said past frame or to transmit an indication to display said high-resolution frame being sent as a representation of said present frame based on determinations obtained from said computational circuitry.
Claim 30
Dependent Claim 153 words
A decoder for decoding a video signal including a series of encoded frames wherein at least some of said frames are encoded as high-resolution frames and some of said frames are encoded as low-resolution frames, said signal also including indications indicating which of said high-resolution frames are to be repeated and whether said high-resolution frames are to be repeated to replace a later frame or an earlier frame, said decoder comprising a receiver for receiving said encoded frames, first and second storage buffers responsive to said receiver which accept frames received by said receiver, and circuitry controlling access to said buffers for producing a decoded series of video frames from the contents of alternating ones of said storage buffers and from said indications wherein at least some of said high-resolution frames are repeated at least once in said decoded series of video frames by re-accessing one of said buffers based on said indications.
Claim 31
Dependent Claim 153 words
A decoder for decoding a video signal including a series of encoded frames wherein at least some of said frames are encoded as high-resolution frames and some of said frames are encoded as low-resolution frames, said signal also including indications indicating which of said high-resolution frames are to be repeated and whether said high-resolution frames are to be repeated to replace a later frame or an earlier frame, said decoder comprising a receiver for receiving said encoded frames, first and second storage buffers responsive to said receiver which accept frames received by said receiver, and circuitry controlling access to said buffers for producing a decoded series of video frames from the contents of alternating ones of said storage buffers and from said indications wherein at least some of said high-resolution frames are repeated at least once in said decoded series of video frames by re-accessing one of said buffers based on said indications.
Claim 32
Dependent Claim 22 words
The apparatus of claim 24 further including a third storage buffer responsive to said receiver which accepts frames received by said receiver.
Claim 33
Dependent Claim 36 words
The method of claim 1 further comprising, in the case when a high-resolution frame is to represent two successive frames (e.g., past and present frames), the step of estimating the displacement between the two successive frames.
Claim 34
Dependent Claim 27 words
The method of claim 1 wherein, when a high-resolution frame has been encoded at the transmitter, using the high-resolution frame for two successive frames at the receiver.
Claim 35
Dependent Claim 45 words
The method of claim 27 further comprising the steps of estimating (during encoding) the displacement between the two successive frames, transmitting the estimated displacement, and shifting (during decoding) the high-resolution frame by the amount of the displacement when displaying one of the two successive frames.
Claim 36
Dependent Claim 31 words
The method of claim 28, 21, or 24 wherein repetition of the high-resolution frame includes shifting the frame by an estimated displacement (estimated by the encoder and transmitted to the decoder).
Claim 37
Independent Claim 205 words
A method for receiving decoded video frames from a decoder and transmitting said decoded frames, comprising the following steps: receiving said video signal as a series of frames, some of which were encoded as high-resolution frames and others of which were encoded as low-resolution frames; selectively receiving indications whether a frame is to be re-displayed; providing a first buffer and a second buffer wherein said first buffer contains a first decoded frame; and I) if the next decoded frame received is low-resolution frame, then storing said next decoded frame in said second buffer and transmitting said first decoded frame; II) if the next decoded frame received is high-resolution and an indication is received to re-display said first decoded frame, then receiving a portion of said next decoded frame and transmitting said first decoded frame, and then receiving the remainder of said next decoded frame and re-transmitting said first decoded frame; III) if the next decoded frame received is high-resolution and there is no indication to re-display said first decoded frame, then receiving a portion of said next decoded frame in said second buffer and transmitting said first decoded frame, and then receiving the remainder of said next decoded frame and transmitting said next decoded frame.
Claim 38
Independent Claim 205 words
A method for receiving decoded video frames from a decoder and transmitting said decoded frames, comprising the following steps: receiving said video signal as a series of frames, some of which were encoded as high-resolution frames and others of which were encoded as low-resolution frames; selectively receiving indications whether a frame is to be re-displayed; providing a first buffer and a second buffer wherein said first buffer contains a first decoded frame; and I) if the next decoded frame received is low-resolution frame, then storing said next decoded frame in said second buffer and transmitting said first decoded frame; II) if the next decoded frame received is high-resolution and an indication is received to re-display said first decoded frame, then receiving a portion of said next decoded frame and transmitting said first decoded frame, and then receiving the remainder of said next decoded frame and re-transmitting said first decoded frame; III) if the next decoded frame received is high-resolution and there is no indication to re-display said first decoded frame, then receiving a portion of said next decoded frame in said second buffer and transmitting said first decoded frame, and then receiving the remainder of said next decoded frame and transmitting said next decoded frame.
Claim 39
Independent Claim 145 words
A method for receiving decoded video frames from a decoder and transmitting said decoded frames comprising the following steps: receiving said video signal as a series of frames, some of which were encoded as high-resolution frames and others from which were encoded as low-resolution frames; providing a first buffer, a second buffer, and a third buffer, wherein said first buffer contains a first decoded frame and said second buffer contains a second decoded frame; I) if the next decoded frame is a low-resolution frame, then receiving said next decoded frame in said third buffer and transmitting said first decoded frame; II) if the next decoded frame is a high-resolution frame, then receiving a portion of said next decoded frame in said third buffer and transmitting said first decoded frame, and then receiving the remainder of said next decoded frame and transmitting said second decoded frame.
Claim 40
Independent Claim 145 words
A method for receiving decoded video frames from a decoder and transmitting said decoded frames comprising the following steps: receiving said video signal as a series of frames, some of which were encoded as high-resolution frames and others from which were encoded as low-resolution frames; providing a first buffer, a second buffer, and a third buffer, wherein said first buffer contains a first decoded frame and said second buffer contains a second decoded frame; I) if the next decoded frame is a low-resolution frame, then receiving said next decoded frame in said third buffer and transmitting said first decoded frame; II) if the next decoded frame is a high-resolution frame, then receiving a portion of said next decoded frame in said third buffer and transmitting said first decoded frame, and then receiving the remainder of said next decoded frame and transmitting said second decoded frame.

References Cited (Backward Citations)

US2939909A Cited
US3715483A Cited
US4184177A Cited
JPS5775072A Cited
US4494144A Cited
US4620225A Cited
US4838685A Cited
US4931855A Cited
US4998287A Cited
US5072296A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1995-12-29 1996-06-29 1996-12-29 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1999-12-29 2000-06-29 2000-12-29 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2003-12-29 2004-06-29 2004-12-29 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag