← Back to Patent Explorer
US7222300B2 Expired / Lapsed US ⏱️ 0.0 years remaining

System and method for automatically authoring video compositions using video cliplets

Assignee: Microsoft Technology Licensing LLC
•
Filing: 2002-06-19
•
Granted: 2007-05-22
•
Expires: 2022-06-19
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract The present invention includes a system and a method for automatically authoring video compositions from longer units of digitized video (or a source video) by using short segments of video (or video “cliplets”). The video composition authoring process provides an aesthetically-pleasing layout of data elements to create a video composition. The data elements include multimedia elements, parameter information and description information. Any data elements that are missing but required are automatically selected by the system. The user may then review preliminary video composition results and refine the results if desired. The video composition authoring system includes an element selection and layout module for selecting the data elements in the video composition, and an iterative refinement module that allows the user to change and refine the preliminary results.

Inventors

  • 👤 Kentaro Toyama
  • 👤 Andreas Soupliotis
  • 👤 Sheldon R. Fisher

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-24 17:56
CPC Classifications
G; G11; G11B; G11B27/00; G11B27/10; G11B27/34; G11B27/02; G11B27/031

Claims Analysis

Total Claims: 17
Claim 1
Independent Claim 203 words
A method for authoring a video composition from source video using short segments of the source video called video cliplets, comprising: generating a set of windows to be contained within the video composition; automatically selecting a cliplet to be placed within each window of the set of windows so as to create the video composition based on multi-dimensional cliplet interest ratings associated with the cliplet, wherein automatically selecting a cliplet further comprises: defining cliplet interest rating categories; ranking each of the cliplets in each of the cliplet interest rating categories; selecting the top-ranked cliplets in each of the cliplet interest rating categories to be placed in each of the windows; presenting the video composition to a user for review; allowing the user to change the cliplets within each of the windows if the user not satisfied with the video composition after the review; allowing a user to choose an output style of the video composition; determining whether any of the top-ranked cliplets in each of the cliplet interest rating categories are close in time; and if so, then choosing one of the top-ranked cliplets that are close in time and discarding the other ones of the top-ranked cliplets that are close in time.
Claim 2
Independent Claim 203 words
A method for authoring a video composition from source video using short segments of the source video called video cliplets, comprising: generating a set of windows to be contained within the video composition; automatically selecting a cliplet to be placed within each window of the set of windows so as to create the video composition based on multi-dimensional cliplet interest ratings associated with the cliplet, wherein automatically selecting a cliplet further comprises: defining cliplet interest rating categories; ranking each of the cliplets in each of the cliplet interest rating categories; selecting the top-ranked cliplets in each of the cliplet interest rating categories to be placed in each of the windows; presenting the video composition to a user for review; allowing the user to change the cliplets within each of the windows if the user not satisfied with the video composition after the review; allowing a user to choose an output style of the video composition; determining whether any of the top-ranked cliplets in each of the cliplet interest rating categories are close in time; and if so, then choosing one of the top-ranked cliplets that are close in time and discarding the other ones of the top-ranked cliplets that are close in time.
Claim 3
Dependent Claim 61 words
The method as set forth in claim 1 , wherein the multi-dimensional cliplet interest ratings include at least one of the following: (a) voice recognition; (b) speaker recognition; (c) face detection; (d) zoom detection; (e) pan detection; (f) any type of audio analyses; (g) any type of audio recognition; (h) any type of video analyses; (i) any type of video recognition.
Claim 4
Dependent Claim 15 words
A computer-readable medium having computer-executable instructions for performing the method recited in claim 1 .
Claim 5
Dependent Claim 33 words
The method as set forth in claim 1 , wherein automatically selecting a cliplet further comprises correlating usage statistics with the cliplet interest ratings to increase the accuracy of the cliplet interest ratings.
Claim 6
Dependent Claim 64 words
The method as set forth in claim 1 , wherein automatically selecting a cliplet further comprises: defining a set of M number of cliplets within each of the cliplet interest rating categories; and randomly selecting for each of the cliplet interest rating categories a set of N number of cliplets from the set of M number of cliplets, where M is greater than N.
Claim 7
Dependent Claim 68 words
The method as set forth in claim 1 , wherein allowing the user to change the cliplets within each of the windows further comprises providing drag and drop functionality such that using an input device a user can perform at least one of the following in the video composition: (a) change a location of a cliplet; (b) modify the cliplet; (c) add a cliplet; (d) delete a cliplet.
Claim 8
Dependent Claim 23 words
The method as set forth in claim 1 , further comprising allowing the user to add text annotation to any of the cliplets.
Claim 9
Dependent Claim 22 words
The method as set forth in claim 1 , further comprising allowing a user to add text annotation to the video composition.
Claim 10
Dependent Claim 37 words
The method as set forth in claim 1 , further comprising allowing a user to add at least one of the following to the video composition: (a) a title for the video composition; (b) a credits list.
Claim 11
Dependent Claim 63 words
The method as set forth in claim 1 comprising: creating a layout of the video composition as a two-dimensional collage of cliplet windows; allowing the user to select video cliplets to place in the cliplet windows; and automatically selecting video cliplets to place in the cliplet windows if the user does not select enough video cliplets to fill each of the cliplet windows.
Claim 12
Dependent Claim 30 words
The method as set forth in claim 10 , wherein creating a layout of the video composition further comprises automatically determining a layout of the two-dimensional collage of cliplets windows.
Claim 13
Dependent Claim 34 words
The method as set forth in claim 10 , wherein creating a layout of the video composition further comprises allowing a the user to determine a layout of the two-dimensional collage of cliplets windows.
Claim 14
Dependent Claim 28 words
The method as set forth in claim 10 , further comprising allowing the user to review the video composition and change the video composition if the user desires.
Claim 15
Dependent Claim 62 words
The method as set forth in claim 1 , comprising: obtaining usage statistics by tracking a frequency of usage of the video cliplets; correlating the usage statistics with the cliplet interest ratings to adjust and train the cliplet interest ratings; generating preliminary video composition results for the user to review; and refining the preliminary video composition results if the user so desires.
Claim 16
Dependent Claim 39 words
The method as set forth in claim 14 , further comprising: displaying a layout of the video composition as a two-dimensional collage of cliplet windows; and selecting cliplets to populate the cliplet windows based on the correlated usage statistics.
Claim 17
Dependent Claim 25 words
The method as set forth in claim 1 , comprising allowing user refinement of the video composition through use of a drag and drop function.

References Cited (Backward Citations)

US6710785B1 Cited
EP0920015A2 Cited
US5956026A Cited
WO2002001548A1 Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2010-05-21 2010-11-20 2011-05-22 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2014-05-21 2014-11-20 2015-05-22 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2018-05-21 2018-11-20 2019-05-22 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag