Patent US6408293B1 successfully refreshed from Google Patents.
US6408293B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Interactive framework for understanding user's perception of multimedia data
Assignee: PHONENICIA INNOVATIONS SUBSIDIARY OF PENDRELL TECHNOLOGIES LLC LLC
•
Filing: 1999-06-09
•
Granted: 2002-06-18
•
Expires: 2019-06-09
Abstract
Abstract A methodology of highly interactive intra-object relevance feedback is used to retrieve multimedia data from a database. The query object could consist of one or more images, images derived from video, a video sequence, or an audio clip. The query is adjusted using the information fed-back by the user about the relevance of previously extracted part(s) from the object itself, such that the adjusted query is a better approximation to the user's perception. The information fed-back by the user during intra-query modification is used for intra-object learning of the user's perception. The refined query is subsequently used for inter-object relevance feedback where data is retrieved from the database based on parameters learnt by intra-query object feedback mechanism, and the user provides feedback by ranking the retrieved objects in order of their relevance to him or her. In the system according to the invention, inter-object learning of user's perception is expedited by utilizing the learnt parameters in the intra-object relevance feedback. Furthermore, the methodology of the invention allows for building refined queries based on part(s) or sub-sequence(s) of the query object rather than the entire object itself, thereby reducing the number of irrelevant objects, retrieved from the database. The methodology allows synthesis and modification of the input query object itself in the event a query object is not directly available, and, also to learn the user's perception.
Inventors
- 👤 Gaurav Aggarwal
- 👤 Pradeep Kumar Dubey
- 👤 Sugata Ghosal
- 👤 Ashutosh Kulshreshtha
- 👤 Tumkur Venkatanarayana Rao Ravi
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-01 23:26
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/50; G06F16/58; G06F16/583; G06F16/5838; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99935; Y10S707/99941; Y10S707/99943
Claims Analysis
Total Claims: 12
Claim 1
Independent Claim
112 words
A computer implemented method embodying an interactive framework for understanding a user's perception of multimedia data for the retrieval of data from a database comprising the steps of: (a) receiving a user's specification of area(s) or portion(s) of interest as part of the user's query object, (b) tentatively over-segmenting at least a part of the query object, (c) merging or splitting of segments specified by the user, (d) learning the user's perception of area(s) or portion(s) of interest selected from the group consisting of color, texture, shape, time sequence, audio mixture, and topological arrangement of segments, and (e) extracting from the database semantic object(s) using the segments learned in said learning step.
Claim 2
Dependent Claim
112 words
A computer implemented method embodying an interactive framework for understanding a user's perception of multimedia data for the retrieval of data from a database comprising the steps of: (a) receiving a user's specification of area(s) or portion(s) of interest as part of the user's query object, (b) tentatively over-segmenting at least a part of the query object, (c) merging or splitting of segments specified by the user, (d) learning the user's perception of area(s) or portion(s) of interest selected from the group consisting of color, texture, shape, time sequence, audio mixture, and topological arrangement of segments, and (e) extracting from the database semantic object(s) using the segments learned in said learning step.
Claim 3
Dependent Claim
34 words
The method according to claim 1 , wherein the query object is defined by a set of segments characterized by at least one of a feature vector, a shape description, or a similarity measure.
Claim 4
Dependent Claim
30 words
The method according to claim 1 , wherein the user's specification includes at least one of color, texture, shape, audio frequency, motion or region of interest of the query object.
Claim 5
Dependent Claim
25 words
The method according to claim 1 , wherein the query object is over-segmented by at least one of color, texture, shape, audio frequency, or motion.
Claim 6
Dependent Claim
53 words
The computer implemented method of claim 1 , wherein the step of inter-object processing comprises the steps of: (a) searching the database for similar query object(s) using learned parameters from intra-query object processing; (b) receiving the user's ranking of the retrieved objects as relevant or irrelevant data; and (c) understanding the user's perception.
Claim 7
Dependent Claim
149 words
A computer program product comprising a computer usable medium having computer readable program code embodied in the medium for embodying an interactive framework for understanding a user's perception of multimedia data for the retrieval of data from a database, the computer program product including: first computer program code for receiving a user's specification of area(s) or portion(s) of interest as part of the user's query object; second computer program code for tentatively over-segmenting at least a part of the query object; third computer program code for merging or splitting of segments specified by the user; fourth computer program code for learning the user's perception of area(s) or portion(s) of interest selected from the group consisting of color, texture, shape, time sequence, audio mixture, and topological arrangement of segments; and fifth computer program code for extracting from the database semantic object(s) using the segments learned by said fourth computer program.
Claim 8
Dependent Claim
149 words
A computer program product comprising a computer usable medium having computer readable program code embodied in the medium for embodying an interactive framework for understanding a user's perception of multimedia data for the retrieval of data from a database, the computer program product including: first computer program code for receiving a user's specification of area(s) or portion(s) of interest as part of the user's query object; second computer program code for tentatively over-segmenting at least a part of the query object; third computer program code for merging or splitting of segments specified by the user; fourth computer program code for learning the user's perception of area(s) or portion(s) of interest selected from the group consisting of color, texture, shape, time sequence, audio mixture, and topological arrangement of segments; and fifth computer program code for extracting from the database semantic object(s) using the segments learned by said fourth computer program.
Claim 9
Dependent Claim
64 words
A computer program product comprising according to claim 6 , wherein the fifth computer program code comprises: sixth computer program code for searching the database for similar query object(s) using learned parameters from intra-query object processing; seventh computer program code for receiving the user's ranking of the retrieved objects as relevant or irrelevant data; and eighth computer program code for understanding the user's perception.
Claim 10
Independent Claim
113 words
A system for embodying an interactive framework for understanding a user's perception of multimedia data for the retrieval of data from a database comprising: means for receiving a user's specification of area(s) or portion(s) of interest as part of the user's query object; means for tentatively over-segmenting at least a part of the query object; means for merging or splitting of segments specified by the user; means for learning the user's perception of area(s) or portion(s) of interest selected from the group consisting of color, texture, shape, time sequence, audio mixture, and topological arrangement of segments; and means for extracting from the database semantic object(s) using the segments learned by said learning means.
Claim 11
Independent Claim
113 words
A system for embodying an interactive framework for understanding a user's perception of multimedia data for the retrieval of data from a database comprising: means for receiving a user's specification of area(s) or portion(s) of interest as part of the user's query object; means for tentatively over-segmenting at least a part of the query object; means for merging or splitting of segments specified by the user; means for learning the user's perception of area(s) or portion(s) of interest selected from the group consisting of color, texture, shape, time sequence, audio mixture, and topological arrangement of segments; and means for extracting from the database semantic object(s) using the segments learned by said learning means.
Claim 12
Dependent Claim
76 words
A system for embodying an interactive framework for understanding a user's perception of multimedia data for the retrieval of data from a database comprising according to claim 8 , wherein the means for extracting comprises: (a) means for searching the database for similar query object(s) using learned parameters from intra-query object processing; (b) means for receiving the user's ranking of the retrieved objects as relevant or irrelevant data; and (c) means for understanding the user's perception.
References Cited (Backward Citations)
US5802361A
Cited
US6181818B1
Cited
US6246804B1
Cited
US5893095A
Cited
US5913205A
Cited
US5899999A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-06-17 | 2005-12-17 | 2006-06-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-06-17 | 2009-12-17 | 2010-06-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-06-17 | 2013-12-17 | 2014-06-18 | $7700.00 | Window Closed / Lapsed |