Patent US6792434B2 successfully refreshed from Google Patents.
US6792434B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Content-based visualization and user-modeling for interactive browsing and retrieval in multimedia databases
Assignee: Mitsubishi Electric Research Laboratories Inc
•
Filing: 2001-04-20
•
Granted: 2004-09-14
•
Expires: 2021-04-20
Abstract
Abstract A method for visualizing multimedia objects assigns a feature vector to each multimedia object. The feature vector of each multimedia object is reduced to a location vector having a dimensionality of a display device. A cost function is evaluated to determine an optimal location vector for each multimedia object, and each multimedia object is displayed on a display device according to the optimal location vector. The reducing can use principle component analysis. In addition, a relevance score can be determined for each displayed multimedia object, and the multimedia objects can than be visually enhanced according to the relevance score.
Inventors
- 👤 Baback Moghaddam
- 👤 Qi Tian
- 👤 Xiang S. Zhou
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-26 16:19
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/40; G06F16/44; G06T; G06T11/00; G06T11/20; G06T11/26; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99941; Y10S707/99943; Y10S707/99944; Y10S707/99945; Y10S707/99948
Claims Analysis
Total Claims: 20
Claim 1
Independent Claim
205 words
A method for visualizing a plurality of stored multimedia objects on a display device: placing a set of user selected multimedia objects at user selected locations on the display device; assigning a feature vector to each user selected multimedia object and stored multimedia object; reducing the feature vector to a location vector to a location vector having a dimensionality of the display device; evaluating a cost function to determine an optimal location vector for each multimedia object, and an optimal size for each multimedia object, wherein the cost function maximizes a total visibility of the plurality of stored multimedia objects and minimizes a total deviation between the location vectors and the optimal location vectors, and wherein the cost function J is a linear combination J of a first function F(p) and second cost function G(p) J=F ( p )+λ· S·G ( p ) where the first cost function maximizes the total visibility, and the second cost function minimizes the total deviation, S is a scaling factor, and λ is a weight; and displaying each stored multimedia object on a display device according to the optimal location vector and the optimal size and a similarity to the user selected multimedia objects placed on the display device.
Claim 2
Independent Claim
205 words
A method for visualizing a plurality of stored multimedia objects on a display device: placing a set of user selected multimedia objects at user selected locations on the display device; assigning a feature vector to each user selected multimedia object and stored multimedia object; reducing the feature vector to a location vector to a location vector having a dimensionality of the display device; evaluating a cost function to determine an optimal location vector for each multimedia object, and an optimal size for each multimedia object, wherein the cost function maximizes a total visibility of the plurality of stored multimedia objects and minimizes a total deviation between the location vectors and the optimal location vectors, and wherein the cost function J is a linear combination J of a first function F(p) and second cost function G(p) J=F ( p )+λ· S·G ( p ) where the first cost function maximizes the total visibility, and the second cost function minimizes the total deviation, S is a scaling factor, and λ is a weight; and displaying each stored multimedia object on a display device according to the optimal location vector and the optimal size and a similarity to the user selected multimedia objects placed on the display device.
Claim 3
Dependent Claim
12 words
The method of claim 1 wherein the feature vector includes visual features.
Claim 4
Dependent Claim
12 words
The method of claim 1 wherein the feature vector includes semantic features.
Claim 5
Dependent Claim
12 words
The method of claim 1 wherein the feature vector includes audio features.
Claim 6
Dependent Claim
12 words
The method of claim 1 wherein the feature vector includes motion features.
Claim 7
Dependent Claim
15 words
The method of claim 1 wherein the feature vector includes color, texture, and structure features.
Claim 8
Dependent Claim
19 words
The method of claim 1 wherein the feature vectors include ceptrum, temporal trajectories, pitch, and zero crossing rate features.
Claim 9
Dependent Claim
12 words
The method of claim 1 wherein the location vector uses Cartesian coordinates.
Claim 10
Dependent Claim
12 words
The method of claim 1 wherein the location vector uses polar coordinates.
Claim 11
Dependent Claim
20 words
The method of claim 9 further comprising: reducing a size of particular stored multimedia objects to maximize the total visibility.
Claim 12
Dependent Claim
16 words
The method of claim 10 wherein the reduced size is greater than a threshold minimum size.
Claim 13
Dependent Claim
42 words
The method of claim 1 further comprising: determining a weighting vector from the set of user selected multimedia objects and the user selected location on the display device; and weighting each feature vector by the weighting vector before reducing the feature vector.
Claim 14
Dependent Claim
39 words
The method of claim 13 further comprising: applying an affine transform to the locations before displaying each stored multimedia object on the display device according to the optimal location vector and the user selected locations on the display device.
Claim 15
Dependent Claim
16 words
The method of claim 13 further comprising: applying a non-linear transformation to the affine transformed locations.
Claim 16
Dependent Claim
27 words
The method of claim 1 further comprising: determining a relevance score for each displayed multimedia object; and enhancing each displayed multimedia object according to the relevance score.
Claim 17
Dependent Claim
23 words
The method of claim 15 wherein a particular displayed multimedia object is enhanced by increasing a brightness of the particular displayed multimedia object.
Claim 18
Dependent Claim
23 words
The method of claim 15 wherein a particular displayed multimedia object is enhanced by increasing a contrast of the particular displayed multimedia object.
Claim 19
Dependent Claim
23 words
The method of claim 1 wherein principle component analysis is applied to each feature vector to reduce the dimensionality of the feature vector.
Claim 20
Dependent Claim
80 words
The method of claim 1 further comprising: providing a clustering of the user selected multimedia objects placed by the user on the display device; extracting as a weighting vector from the clustering of the user selected multimedia objects; and displaying each stored multimedia object on the display device according to the optimal location vector and the optimal size, and the weighting vector to match the clustering of the user selected multimedia objects placed by the user on the display device.
References Cited (Backward Citations)
US5983251A
Cited
US6173275B1
Cited
US5839103A
Cited
US5915250A
Cited
US5918223A
Cited
US6243492B1
Cited
US6597818B2
Cited
US5987456A
Cited
US6240423B1
Cited
US6400846B1
Cited
US6608923B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-09-14 | 2008-03-15 | 2008-09-14 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-09-14 | 2012-03-15 | 2012-09-14 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-09-14 | 2016-03-15 | 2016-09-14 | $7700.00 | Window Closed / Lapsed |