US5900919A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Efficient shot change detection on compressed video data
Assignee: Transpacific IP Ltd
•
Filing: 1996-12-02
•
Granted: 1999-05-04
•
Expires: 2016-12-02
Abstract
Abstract A mask matching approach to detect shot changes in MPEG coded video uses reference ratio variances of macroblocks between MPEG coded frames. A function is designed to quantize the results into shot change probability values. Moreover, a conversion function modifies this probability computation to minimize misdetection and loss of detection under unusual image pattern situations. A shot change probability threshold is defined for the video to be examined. When a frame's modified shot change probability exceeds this threshold, the frame is considered to contain a shot change. With this approach, processing time is reduced by evaluating MPEG coded data directly, rather than the raw video.
Inventors
- 👤 Shu-Chin Su Chen
- 👤 Cheng-Yao Ni
- 👤 Tony C. T. Kuo
- 👤 Y. B. Lin
- 👤 Arbee L. P. Chen
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-31 10:52
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/50; H04N19/503; H04N5/00; H04N5/14; H04N5/147
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
235 words
A method for detecting shot changes in compressed MPEG coded video data having I, P, and B frames, with an IPB ratio corresponding to the numbers of I, P, and B frames, respectively, comprising the steps of: (a) defining a qualifying set of shot change masks in accordance with said IPB ratio of said compressed MPEG coded video data, said qualifying set of shot change masks comprising a sequence of I, P, and B types of frame masks, each of said I, P, and B types of frame masks having low reference ratio characteristics between adjacent frames within each I, P, and B type of frame mask, (b) calculating a shot change probability function P for each I, P, and B frame of said video data, based on said reference ratio of characteristics shot change frame masks, wherein each said P and B frame is encoded with references to adjacent frames, and wherein said I frames are encoded independently, (c) determining a threshold value T for said shot change probability function P, (d) comparing said shot change probability function P for each said I, P, and B frame of said video data with said threshold value T, and (e) detecting a shot change at any of said I, P, and B frames of said video data when said shot change probability function P of said I, P, or B frame exceeds said threshold value T.
Claim 2
Independent Claim
235 words
A method for detecting shot changes in compressed MPEG coded video data having I, P, and B frames, with an IPB ratio corresponding to the numbers of I, P, and B frames, respectively, comprising the steps of: (a) defining a qualifying set of shot change masks in accordance with said IPB ratio of said compressed MPEG coded video data, said qualifying set of shot change masks comprising a sequence of I, P, and B types of frame masks, each of said I, P, and B types of frame masks having low reference ratio characteristics between adjacent frames within each I, P, and B type of frame mask, (b) calculating a shot change probability function P for each I, P, and B frame of said video data, based on said reference ratio of characteristics shot change frame masks, wherein each said P and B frame is encoded with references to adjacent frames, and wherein said I frames are encoded independently, (c) determining a threshold value T for said shot change probability function P, (d) comparing said shot change probability function P for each said I, P, and B frame of said video data with said threshold value T, and (e) detecting a shot change at any of said I, P, and B frames of said video data when said shot change probability function P of said I, P, or B frame exceeds said threshold value T.
Claim 3
Dependent Claim
63 words
The method of claim 1 wherein step (b) calculates said shot change probability function P for each said I, P, and B frame in accordance with the following equation: ##EQU3## where f 1 , f 2 , . . . F n , .di-elect cons. said frame masks, and RR fi is the corresponding reference ratio of a frame mask f i .
Claim 4
Dependent Claim
57 words
The method of claim 1 wherein step (c) determines said threshold value T for said shot change probability function P in accordance with the following equation: ##EQU4## where F is the average probability of 97.5% of all said frames having lowest probabilities, and F' is the average probability of 2.5% of all said frames having highest probabilities.
Claim 5
Dependent Claim
84 words
The method of claim 2 wherein step (b) further comprises an adjustment to said shot change probability function P for each said I, P, and B frame in accordance with the following conversion function: ##EQU5## where i is the frame number of said I, P, and B frame whose shot change probability is currently being computed, where j is a predetermined value which represents a minimum distance between two successive shot changes, and where k is determined by said values of i and j.
Claim 6
Independent Claim
188 words
A method for detecting shot changes in compressed MPEG coded video data having I, P, and B frames, with an IPB ratio corresponding to the numbers of I, P, and B frames, respectively, comprising the steps of: (a) defining a shot change mask cluster in accordance with said IPB ratio of said compressed MPEG coded video data, wherein said shot change mask cluster comprises a sequence of I, P, and B types of frame masks, each of said I, P, and B types of frame masks having low reference ratio characteristics between adjacent frames within each I, P, and B type of frame mask, (b) comparing said shot change mask cluster with each said I, P, and B frame of video data to find a match between said I, P, and B frame and its corresponding type of frame mask within said shot change mask cluster, and (c) detecting a shot change at any of said I, P, and B frames of said video data when one of said shot change mask cluster frame masks matches one of a corresponding type of said I, P, and B frames.
Claim 7
Independent Claim
188 words
A method for detecting shot changes in compressed MPEG coded video data having I, P, and B frames, with an IPB ratio corresponding to the numbers of I, P, and B frames, respectively, comprising the steps of: (a) defining a shot change mask cluster in accordance with said IPB ratio of said compressed MPEG coded video data, wherein said shot change mask cluster comprises a sequence of I, P, and B types of frame masks, each of said I, P, and B types of frame masks having low reference ratio characteristics between adjacent frames within each I, P, and B type of frame mask, (b) comparing said shot change mask cluster with each said I, P, and B frame of video data to find a match between said I, P, and B frame and its corresponding type of frame mask within said shot change mask cluster, and (c) detecting a shot change at any of said I, P, and B frames of said video data when one of said shot change mask cluster frame masks matches one of a corresponding type of said I, P, and B frames.
Claim 8
Independent Claim
247 words
A system for detecting shot changes in compressed MPEG coded video data having I, P, and B frames, with an IPB ratio corresponding to the numbers of I, P, and B frames, respectively, comprising: (a) an input device for receiving MPEG coded data, (b) a processor for operating on said received data, (c) a memory for storing data operated on by said processor, (d) an output device for displaying results from said processor, (e) said processor for defining a shot change mask cluster based on said IPB ratio of said compressed MPEG coded video data, (f) said processor for calculating a shot change probability function P for each frame of said video data, wherein each said P and B frame is encoded with references to adjacent frames, and wherein said I frames are encoded independently, (g) said processor for determining a threshold value T for said shot change probability function P, (h) said processor for comparing said shot change probability function P for each said frame with said threshold value T, and (i) said processor for detecting a shot change at any of said frames when said shot change probability function P of said frame exceeds said threshold value T, wherein said shot change mask cluster comprises a sequence of I, P, and B types of frame masks, each of said I, P, and B types of frame masks having low reference ratio characteristics between adjacent frames within said I, P, and B types of frame masks.
Claim 9
Independent Claim
247 words
A system for detecting shot changes in compressed MPEG coded video data having I, P, and B frames, with an IPB ratio corresponding to the numbers of I, P, and B frames, respectively, comprising: (a) an input device for receiving MPEG coded data, (b) a processor for operating on said received data, (c) a memory for storing data operated on by said processor, (d) an output device for displaying results from said processor, (e) said processor for defining a shot change mask cluster based on said IPB ratio of said compressed MPEG coded video data, (f) said processor for calculating a shot change probability function P for each frame of said video data, wherein each said P and B frame is encoded with references to adjacent frames, and wherein said I frames are encoded independently, (g) said processor for determining a threshold value T for said shot change probability function P, (h) said processor for comparing said shot change probability function P for each said frame with said threshold value T, and (i) said processor for detecting a shot change at any of said frames when said shot change probability function P of said frame exceeds said threshold value T, wherein said shot change mask cluster comprises a sequence of I, P, and B types of frame masks, each of said I, P, and B types of frame masks having low reference ratio characteristics between adjacent frames within said I, P, and B types of frame masks.
Claim 10
Dependent Claim
62 words
The system of claim 6 wherein step (b) calculates said shot change probability function P for each I, P, and B frame in accordance with the following equation: ##EQU6## where f 1 , f 2 , . . . f n , .di-elect cons. said frame masks, and RR fi is the corresponding reference ratio of a frame mask f i .
Claim 11
Dependent Claim
57 words
The system of claim 6 wherein step (c) determines said threshold value T for said shot change probability function P in accordance with the following equation: ##EQU7## where F is the average probability of 97.5% of all said frames having lowest probabilities, and F' is the average probability of 2.5% of all said frames having highest probabilities.
Claim 12
Dependent Claim
84 words
The system of claim 7 wherein step (b) further comprises an adjustment to said shot change probability function P for each said I, P, and B frame in accordance with the following conversion function: ##EQU8## where i is the frame number of said I, P, and B frame whose shot change probability is currently being computed, where j is a predetermined value which represents a minimum distance between two successive shot changes, and where k is determined by said values of i and j.
Claim 13
Independent Claim
186 words
A system for detecting shot changes in compressed MPEG coded video data having I, P, and B frames, with an IPB ratio corresponding to the numbers of I, P, and B frames, respectively, comprising: (a) a processor for defining a shot change mask cluster based on said IPB ratio of said compressed MPEG coded video data, wherein said shot change mask cluster comprises a sequence of I, P, and B types of frame masks, each of said I, P, and B types of frame masks having low reference ratio characteristics between adjacent frames within said types of I, P, and B frame masks, (b) said processor for comparing said shot change mask cluster with each said I, P, and B frame to find a match between said I, P, and B frame and its corresponding type of frame mask within said shot change mask cluster, and (c) said processor for detecting a shot change at any of said I, P, and B frames when one of said shot change mask cluster frame masks matches one of a corresponding type of said I, P, and B frames.
Claim 14
Independent Claim
186 words
A system for detecting shot changes in compressed MPEG coded video data having I, P, and B frames, with an IPB ratio corresponding to the numbers of I, P, and B frames, respectively, comprising: (a) a processor for defining a shot change mask cluster based on said IPB ratio of said compressed MPEG coded video data, wherein said shot change mask cluster comprises a sequence of I, P, and B types of frame masks, each of said I, P, and B types of frame masks having low reference ratio characteristics between adjacent frames within said types of I, P, and B frame masks, (b) said processor for comparing said shot change mask cluster with each said I, P, and B frame to find a match between said I, P, and B frame and its corresponding type of frame mask within said shot change mask cluster, and (c) said processor for detecting a shot change at any of said I, P, and B frames when one of said shot change mask cluster frame masks matches one of a corresponding type of said I, P, and B frames.
References Cited (Backward Citations)
US4890160A
Cited
US5179449A
Cited
US5212547A
Cited
US5262856A
Cited
US5327232A
Cited
US5488425A
Cited
US5606655A
Cited
US5635982A
Cited
US5734419A
Cited
US5485611A
Cited
US5691775A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-05-03 | 2002-11-02 | 2003-05-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-05-03 | 2006-11-02 | 2007-05-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-05-03 | 2010-11-02 | 2011-05-04 | $7700.00 | Window Closed / Lapsed |