US5821945A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for video browsing based on content and structure
Assignee: Princeton University
•
Filing: 1997-05-15
•
Granted: 1998-10-13
•
Expires: 2017-05-15
Abstract
Abstract A new technique for extracting a hierarchical decomposition of a complex video selection for browsing purposes, combines visual and temporal information to capture the important relations within a scene and between scenes in a video, thus allowing the analysis of the underlying story structure with no a priori knowledge of the content. A general model of hierarchical scene transition graph is applied to an implementation for browsing. Video shots are first identified and a collection of key frames is used to represent each video segment. These collections are then classified according to gross visual information. A platform is built on which the video is presented as directed graphs to the user, with each category of video shots represented by a node and each edge denoting a temporal relationship between categories. The analysis and processing of video is carried out directly on the compressed videos. Preliminary tests show that the narrative structure of a video selection can be effectively captured using this technique.
Inventors
- 👤 Boon-Lock Yeo
- 👤 Minerva M. Yeung
- 👤 Wayne Wolf
- 👤 Bede Liu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 10:53
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/70; G06F16/73; G06F16/732; G06F16/7328; G06F16/738; G06F16/74; G06F16/745
Claims Analysis
Total Claims: 18
Claim 1
Independent Claim
67 words
A video browser comprising: node defining means for defining a plurality of nodes, each of the plurality of nodes representing a collecting of video shots; temporal relationship defining means for defining at least one temporal relationship between at least first and second ones of the plurality of nodes; and a display for displaying graphical representations of the plurality of nodes and the at least one temporal relationship.
Claim 2
Dependent Claim
67 words
A video browser comprising: node defining means for defining a plurality of nodes, each of the plurality of nodes representing a collecting of video shots; temporal relationship defining means for defining at least one temporal relationship between at least first and second ones of the plurality of nodes; and a display for displaying graphical representations of the plurality of nodes and the at least one temporal relationship.
Claim 3
Dependent Claim
29 words
The video browser of claim 1, wherein the video shots of each of the plurality of nodes are interrelated by at least one of color, spatial correlation and shape.
Claim 4
Dependent Claim
22 words
The video browser of claim 1, wherein the video shots of each of the plurality of nodes are arranged in temporal order.
Claim 5
Dependent Claim
17 words
The video browser of claim. 1, wherein the graphical representation of the temporal relationship is an edge.
Claim 6
Dependent Claim
30 words
The video browser of claim 1, wherein the graphical representations of the plurality of nodes and the at least one temporal relationship are displayed as a hierarchical scene transition graph.
Claim 7
Dependent Claim
30 words
The video browser of claim 5, wherein the hierarchical scene transition graph includes a plurality of levels and wherein each of the levels can be constructed according to different criteria.
Claim 8
Dependent Claim
27 words
The video browser of claim 1, further comprising means for grouping video shots of at least two of the plurality of nodes to form an additional node.
Claim 9
Dependent Claim
27 words
The video browser of claim 1, further comprising means for ungrouping video shots from at least one of the plurality of nodes to form an additional node.
Claim 10
Independent Claim
64 words
A method for presenting video shots for browsing, comprising the steps of: defining a plurality of nodes, each of the plurality of nodes representing a collection of the video shots; defining at least one temporal relationship between at least first and second ones of the plurality of nodes; and displaying graphical representations of the plurality of nodes and the at least one temporal relationship.
Claim 11
Independent Claim
64 words
A method for presenting video shots for browsing, comprising the steps of: defining a plurality of nodes, each of the plurality of nodes representing a collection of the video shots; defining at least one temporal relationship between at least first and second ones of the plurality of nodes; and displaying graphical representations of the plurality of nodes and the at least one temporal relationship.
Claim 12
Dependent Claim
28 words
The method of claim 9, wherein the video shots of each of the plurality of nodes are interrelated by at least one of color, spatial correlation, and shape.
Claim 13
Dependent Claim
21 words
The method of claim 9, wherein the video shots of each of the plurality of nodes are arranged in temporal order.
Claim 14
Dependent Claim
16 words
The method of claim 9, wherein the graphical representation(s) of the temporal relationship is an edge.
Claim 15
Dependent Claim
29 words
The method of claim 9, wherein the graphical representations of the plurality of nodes and the at least one temporal relationship are displayed as a hierarchical scene transition graph.
Claim 16
Dependent Claim
29 words
The method of claim 13, wherein the hierarchical scene transition graph includes a plurality of levels and wherein each of the levels can be constructed according to different criteria.
Claim 17
Dependent Claim
27 words
The method of claim 9, further comprising the step of grouping video shots of at least two of the plurality of nodes to form an additional node.
Claim 18
Dependent Claim
27 words
The method of claim 9, further comprising the step of ungrouping video shots from at least one of the plurality of nodes to form an additional node.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-10-12 | 2002-04-13 | 2002-10-13 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-10-12 | 2006-04-13 | 2006-10-13 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-10-12 | 2010-04-13 | 2010-10-13 | $7700.00 | Window Closed / Lapsed |