US6163510A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Multimedia search and indexing system and method of operation using audio cues with signal thresholds
Assignee: GlobalFoundries Inc
•
Filing: 1998-06-30
•
Granted: 2000-12-19
•
Expires: 2018-06-30
Abstract
Abstract A multimedia search and indexing system automatically selects scenes or events of interest from any media, i.e., video, film, sound for replay, in whole or in part, in other contexts. The entire audio track of a recorded event in video, film, sound, etc., is analyzed to determine audio levels within a set of frequency ranges of interest. Audio clip levels within the selected frequency ranges are chosen as audio cues representative of events of interest in the track. The selection criteria are applied to the audio track of the recorded event. An Edit Decision List (EDL) is generated from the analysis of the audio track. The list is representative of scenes or sounds of interest as clips for reuse. The clips are reviewed and accepted or rejected for reuse. Once selected, the clips are edited using industry standard audio and video editing techniques.
Inventors
- 👤 Peter S. Lee
- 👤 Edith H. Stern
- 👤 Barry E. Willner
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 19:58
CPC Classifications
G; G11; G11B; G11B27/00; G11B27/10; G11B27/19; G11B27/28; G06; G06F; G06F16/00; G06F16/70; G06F16/78; G06F16/783; G06F16/7834; G06Q; G06Q99/00; G11B27/02; G11B27/031; G11B27/102; G11B27/107; G11B2220/00; G11B2220/20; G11B2220/90; G11B27/032; G11B27/034
Claims Analysis
Total Claims: 7
Claim 1
Independent Claim
220 words
In a signal processing system including a multimedia search and indexing system for automatic selection of scenes or sounds recorded in a media for replay in other contexts, a method for generating an edit list of candidate scenes or sounds of interest in the media for replay based upon audio cues in different audio frequency ranges comprising the steps of: (a) comparing recorded audio levels in different frequency ranges of the media with set audio clip levels indicative of a scene or sounds of interest in the media; (b) recording the index as a time code for the scene or sound exceeding the audio level in the frequency range in an Edit Decision List (EDL); (c) subtracting a time interval P in seconds preceding a time code for the index (TC) obtained in step b; (d) replacing (TC-P) with time code for start of media, if (TC-P) is before the start of the media; (e) adding a time interval F in seconds to TC in step (d) to obtain (TC+F); (f) replacing (TC+F) with end of media if (TC+F) is greater than the end of the media; (g) recording the media from (TC-P) to (TC+F) in EDL; and (h) repeating steps a-g for each frequency and record in the EDL for each time code indicative of a scene of interest.
Claim 2
Dependent Claim
220 words
In a signal processing system including a multimedia search and indexing system for automatic selection of scenes or sounds recorded in a media for replay in other contexts, a method for generating an edit list of candidate scenes or sounds of interest in the media for replay based upon audio cues in different audio frequency ranges comprising the steps of: (a) comparing recorded audio levels in different frequency ranges of the media with set audio clip levels indicative of a scene or sounds of interest in the media; (b) recording the index as a time code for the scene or sound exceeding the audio level in the frequency range in an Edit Decision List (EDL); (c) subtracting a time interval P in seconds preceding a time code for the index (TC) obtained in step b; (d) replacing (TC-P) with time code for start of media, if (TC-P) is before the start of the media; (e) adding a time interval F in seconds to TC in step (d) to obtain (TC+F); (f) replacing (TC+F) with end of media if (TC+F) is greater than the end of the media; (g) recording the media from (TC-P) to (TC+F) in EDL; and (h) repeating steps a-g for each frequency and record in the EDL for each time code indicative of a scene of interest.
Claim 3
Dependent Claim
23 words
The method of claim 1 further comprising the step of combining the intervals which overlap or are contiguous to form a new EDL.
Claim 4
Dependent Claim
49 words
The method of claim 1 wherein the step of comparing recorded audio levels in different frequency ranges of the media is for audio clip levels greater than a threshold or greater than or equal to a threshold as indicative of a scene or sound of interest in the media.
Claim 5
Dependent Claim
49 words
The method of claim 1 wherein the step of comparing recorded audio levels in different frequency ranges of the media is for audio clip levels equal to or less than a threshold or less than a threshold as indicative of a scene or sounds of interest in the media.
Claim 6
Dependent Claim
60 words
The method of claim 1 wherein the step of comparing recorded audio levels in different frequency ranges of the media has audio clips levels less than a threshold for a set of frequency ranges and audio clip levels greater than a threshold for another set of frequency ranges, where both frequency ranges are indicative of scenes or sounds of interest.
Claim 7
Dependent Claim
22 words
The method of claim 5 where comparisons which treat audio levels equal to the threshold as selected or not selected are included.
References Cited (Backward Citations)
US4716557A
Cited
US4760526A
Cited
US5289450A
Cited
US5561649A
Cited
US5469270A
Cited
US5621658A
Cited
US6044197A
Cited
US5771330A
Cited
US5683253A
Cited
US5613032A
Cited
US5930446A
Cited
US5713021A
Cited
US5911030A
Cited
US5732184A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-12-19 | 2004-06-19 | 2004-12-19 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-12-19 | 2008-06-19 | 2008-12-19 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-12-19 | 2012-06-19 | 2012-12-19 | $7700.00 | Window Closed / Lapsed |