US7082572B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Methods and apparatus for interactive map-based analysis of digital video content
Assignee: Leland Stanford Junior University
•
Filing: 2002-12-30
•
Granted: 2006-07-25
•
Expires: 2022-12-30
Abstract
Abstract The present invention provides electronic methods and apparatus for interactively authoring, sharing and analyzing digital video content. Methods for authoring include displaying visual data, defining each traversal as a time-based sequence of frames and annotating and storing a record of the traversal and its associated audio records. Defining the traversal includes interactively panning the visual data by positioning an overlay window relative to the visual data and zooming in or out by resizing the overlay window. In alternative embodiments, the visual data may be displayed in a rectangular layout or a cylindrical layout. The methods are practiced using an integrated graphical interface, including an overview region displaying the visual data, a detail region displaying current data within the overlay window, and a worksheet region displaying a list of previously stored annotated traversal records. In a further aspect, the worksheet region list of annotated traversal records is published in a web document accessible via network using a standard HTML browser, and further annotations may be added by a community of network users. Analytical methods are also provided in which data markers corresponding to traversal records are plotted against an interactive abstract map enabling users to shift between levels of abstraction in exploring the video record.
Inventors
- 👤 Roy D. Pea
- 👤 Michael I. Mills
- 👤 Eric Hoffert
- 👤 Joseph H. Rosen
- 👤 Kenneth Dauber
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 09:12
CPC Classifications
G; G11; G11B; G11B27/00; G11B27/02; G11B27/031; G11B27/034; G09; G09C; G09C5/00; G09G; G09G5/00; G11B27/10; G11B27/102; G11B27/105; H; H04; H04N; H04N21/00; H04N21/40; H04N21/43; H04N21/431; H04N5/00; H04N5/76; H04N5/91
Claims Analysis
Total Claims: 16
Claim 1
Independent Claim
122 words
An interactive, electronic method for exploring and analyzing visual data using a plurality of traversal records, the method comprising: displaying an abstract map of the visual data, where each of the traversal records comprising a time-based sequence of frames, each frame being a spatial subset of the visual data, wherein the abstract map comprises an outline of a scene from the visual data, wherein the scene outline is automatically generated from the visual data using an edge detection algorithm; plotting a plurality of markers, each of said markers associated with one of said traversal records, in a corresponding plurality of locations on the map; and playing back the corresponding traversal in response to interactive selection of a desired one of the markers.
Claim 2
Dependent Claim
122 words
An interactive, electronic method for exploring and analyzing visual data using a plurality of traversal records, the method comprising: displaying an abstract map of the visual data, where each of the traversal records comprising a time-based sequence of frames, each frame being a spatial subset of the visual data, wherein the abstract map comprises an outline of a scene from the visual data, wherein the scene outline is automatically generated from the visual data using an edge detection algorithm; plotting a plurality of markers, each of said markers associated with one of said traversal records, in a corresponding plurality of locations on the map; and playing back the corresponding traversal in response to interactive selection of a desired one of the markers.
Claim 3
Dependent Claim
26 words
The method of claim 1 , wherein the abstract map comprises a graph of one or more annotation data values specified for the stored traversal records.
Claim 4
Dependent Claim
19 words
The method of claim 1 , wherein each of the markers comprises a thumbnail image of the associated record.
Claim 5
Dependent Claim
21 words
The method of claim 1 , wherein each of the markers denotes an annotation value specified for the corresponding traversal record.
Claim 6
Dependent Claim
45 words
The method of claim 1 , wherein said method is performed using a graphical user interface, said graphical interface comprising a plurality of computer display regions including a map region displaying the abstract map and plotted markers, and a playback region displaying the desired traversal.
Claim 7
Dependent Claim
25 words
The method of claim 5 , wherein the graphical interface further includes a worksheet region displaying a list of the traversal records and associated annotations.
Claim 8
Dependent Claim
43 words
The method of claim 6 , further comprising interactively selecting a spatial area of interest within the abstract map, and displaying within the worksheet region a filtered list of those traversal records corresponding to the markers located within the spatial area of interest.
Claim 9
Dependent Claim
128 words
An interactive, electronic apparatus for exploring and analyzing visual data using a plurality of traversal records, the apparatus comprising: means for displaying an abstract map of the visual data, where each of the traversal records comprising a time-based sequence of frames, each frame being a spatial subset of the visual data, wherein the abstract map comprises an outline of a scene from the visual data, wherein the scene outline is automatically generated from the visual data using an edge detection algorithm; means for plotting a plurality of markers, each of said markers associated with one of said traversal records, in a corresponding plurality of locations on the map; and means for playing back the corresponding traversal in response to interactive selection of a desired one of the markers.
Claim 10
Dependent Claim
128 words
An interactive, electronic apparatus for exploring and analyzing visual data using a plurality of traversal records, the apparatus comprising: means for displaying an abstract map of the visual data, where each of the traversal records comprising a time-based sequence of frames, each frame being a spatial subset of the visual data, wherein the abstract map comprises an outline of a scene from the visual data, wherein the scene outline is automatically generated from the visual data using an edge detection algorithm; means for plotting a plurality of markers, each of said markers associated with one of said traversal records, in a corresponding plurality of locations on the map; and means for playing back the corresponding traversal in response to interactive selection of a desired one of the markers.
Claim 11
Dependent Claim
26 words
The apparatus of claim 8 , wherein the abstract map comprises a graph of one or more annotation data values specified for the stored traversal records.
Claim 12
Dependent Claim
19 words
The apparatus of claim 8 , wherein each of the markers comprises a thumbnail image of the associated record.
Claim 13
Dependent Claim
21 words
The apparatus of claim 8 , wherein each of the markers denotes an annotation value specified for the corresponding traversal record.
Claim 14
Dependent Claim
52 words
The apparatus of claim 8 , wherein said means for displaying, plotting, and playing back are included in an integrated graphical user interface, said graphical interface comprising a plurality of computer display regions including a map region displaying the abstract map and plotted markers, and a playback region displaying the desired traversal.
Claim 15
Dependent Claim
25 words
The apparatus of claim 12 , wherein the graphical interface further includes a worksheet region displaying a list of the traversal records and associated annotations.
Claim 16
Dependent Claim
44 words
The apparatus of claim 13 , further comprising interactively selecting a spatial area of interest within the abstract map, and displaying within the worksheet region a filtered list of those traversal records corresponding to the markers located with in the spatial area of interest.
References Cited (Backward Citations)
US6121966A
Cited
US5600775A
Cited
US5920317A
Cited
US6337708B1
Cited
US6226655B1
Cited
US6006241A
Cited
US6449653B2
Cited
US6243091B1
Cited
US6085226A
Cited
US6285365B1
Cited
US6369818B1
Cited
US20040148563A1
Cited
US20020194197A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-07-24 | 2010-01-23 | 2010-07-25 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-07-24 | 2014-01-23 | 2014-07-25 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-07-24 | 2018-01-23 | 2018-07-25 | $7700.00 | Window Closed / Lapsed |