US7263671B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Techniques for annotating multimedia information
Assignee: Ricoh Co Ltd
•
Filing: 2001-11-19
•
Granted: 2007-08-28
•
Expires: 2021-11-19
Abstract
Abstract The present invention provides techniques for generating a printable representation of multimedia information that can be printed on a paper medium to provide a paper-based interface for the multimedia information. The printable representation for the multimedia information is annotated to identify locations of information in the multimedia information that may be of interest to a user. A multimedia paper document generated by printing the annotated printable representation on a paper medium displays the annotations. The annotations provide visual indications of information relevant to the user.
Inventors
- 👤 Jonathan J. Hull
- 👤 Jamey Graham
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 04:30
CPC Classifications
G; G06; G06F; G06F40/00; G06F40/10; G06F40/166; G06F40/169; G06F40/186
Claims Analysis
Total Claims: 30
Claim 1
Independent Claim
102 words
A computer-implemented method of generating a paper document for a electronically stored multimedia document storing multimedia information, the multimedia information including video information, the method comprising: accepting user input identifying a first concept of interest; analyzing the multimedia information stored by the multimedia document to identify, absent direct human interaction, information relevant to the first concept of interest; and printing the multimedia information on a paper medium to generate the paper document comprising one or more printed pages, wherein information that is identified to be relevant to the first concept of interest is annotated when printed on the one or more pages.
Claim 2
Dependent Claim
102 words
A computer-implemented method of generating a paper document for a electronically stored multimedia document storing multimedia information, the multimedia information including video information, the method comprising: accepting user input identifying a first concept of interest; analyzing the multimedia information stored by the multimedia document to identify, absent direct human interaction, information relevant to the first concept of interest; and printing the multimedia information on a paper medium to generate the paper document comprising one or more printed pages, wherein information that is identified to be relevant to the first concept of interest is annotated when printed on the one or more pages.
Claim 3
Dependent Claim
21 words
The method of claim 1 wherein the user input identifying the first concept of interest is stored in a user profile.
Claim 4
Dependent Claim
45 words
The method of claim 1 further comprising: printing a relevance indicator on at least one page of the one or more pages, the relevance indicator indicating a degree of relevance of the multimedia information stored by the multimedia document to the first concept of interest.
Claim 5
Dependent Claim
73 words
The method of claim 1 further comprising: accepting user input identifying a second concept of interest; analyzing the multimedia information stored by the multimedia document to identify information relevant to the second concept of interest; and printing the multimedia information on the one or more printed pages such that the information that is identified to be relevant to the second concept of interest is annotated when printed on the one or more pages.
Claim 6
Dependent Claim
76 words
The method of claim 4 wherein the information printed on the one or more pages that is identified to be relevant to the first topic of interest by analyzing the multimedia information is annotated using a first style and the information printed on the one or more pages that is identified to be relevant to the second topic of interest by analyzing the multimedia information is annotated using a second style different from the first style.
Claim 7
Dependent Claim
96 words
The method of claim 1 wherein the multimedia information comprises audio information, and wherein: analyzing the multimedia information comprises: generating a text transcript for the audio information; and analyzing the text transcript to identify information in the text transcript that is relevant to the first concept of interest; and printing the multimedia information on the paper medium comprises: printing the text transcript on the one or more pages such that the information in the text transcript identified to be relevant to the first concept of interest is annotated when printed on the one or more pages.
Claim 8
Dependent Claim
101 words
The method of claim 6 wherein: accepting user input identifying the first concept of interest comprises receiving information identifying a plurality of words associated with the first concept of interest; and analyzing the text transcript comprises identifying words in the text transcript that match words in the plurality of words associated with the first concept of interest; and printing the text transcript on the one or more pages comprises annotating the one or more words in the text transcript printed on the one or more pages that matched words in the plurality of words associated with the first concept of interest.
Claim 9
Dependent Claim
84 words
The method of claim 1 wherein the multimedia information comprises closed-caption text information, and wherein: analyzing the multimedia information comprises analyzing the closed-caption text information to identify text information that is relevant to the first concept of interest; and printing the multimedia information on the paper medium comprises printing the closed-caption text on the one or more pages such that the text information printed on the one or more pages that is identified to be relevant to the first concept of interest is annotated.
Claim 10
Dependent Claim
104 words
The method of claim 8 wherein: accepting user input identifying the first concept of interest comprises receiving information identifying a plurality of words associated with the first concept of interest; analyzing the closed-caption text information comprises identifying words in the closed-caption text information that match words in the plurality of words associated with the first concept of interest; and printing the closed-caption text information on the one or more pages comprises annotating the one or more words in the closed-caption text information printed on the one or more pages that matched words in the plurality of words associated with the first concept of interest.
Claim 11
Dependent Claim
100 words
The method of claim 1 wherein: accepting user input identifying the first concept of interest comprises receiving information identifying video features associated with the first concept of interest; analyzing the multimedia information comprises: extracting a plurality of video frames from the video information; and analyzing the plurality of video frames to identify one or more video frames that comprise at least one video feature from the video features associated with the first concept of interest; and printing the multimedia information on the paper medium comprises printing the one or more video frames on the one or more pages with annotations.
Claim 12
Dependent Claim
156 words
The method of claim 1 wherein: analyzing the multimedia information stored by the multimedia document to identify information relevant to the first concept of interest comprises: generating a printable representation for the multimedia information stored by the multimedia document, the printable representation capable of being printed on a paper medium; searching the printable representation to identify one or more sections of the printable representation that comprise information relevant to the first concept of interest; and annotating the one or more sections of the printable representation identified to comprise information relevant to the first concept of interest; and printing the multimedia information on a paper medium to generate the one or more printed pages comprises printing the printable representation on the one or more pages such that the one or more sections of the printable representation identified to comprise information relevant to the first concept of interest are annotated when printed on the one or more pages.
Claim 13
Independent Claim
151 words
A system for generating a paper document for a electronically stored multimedia document storing multimedia information, the multimedia information including video information, the system comprising: a processor; and a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising: a code module for accepting user input identifying a first concept of interest; a code module for analyzing the multimedia information stored by the multimedia document to identify, absent direct human interaction, information relevant to the first concept of interest; and a code module for printing the multimedia information on a paper medium to generate one or more printed pages such that the information that is identified to be relevant to the first concept of interest is annotated when printed on the one or more pages, the one or more pages comprising one or more pages.
Claim 14
Independent Claim
151 words
A system for generating a paper document for a electronically stored multimedia document storing multimedia information, the multimedia information including video information, the system comprising: a processor; and a memory coupled to the processor, the memory configured to store a plurality of code modules for execution by the processor, the plurality of code modules comprising: a code module for accepting user input identifying a first concept of interest; a code module for analyzing the multimedia information stored by the multimedia document to identify, absent direct human interaction, information relevant to the first concept of interest; and a code module for printing the multimedia information on a paper medium to generate one or more printed pages such that the information that is identified to be relevant to the first concept of interest is annotated when printed on the one or more pages, the one or more pages comprising one or more pages.
Claim 15
Dependent Claim
21 words
The system of claim 12 wherein the user input identifying the first concept of interest is stored in a user profile.
Claim 16
Dependent Claim
56 words
The system of claim 12 , wherein the plurality of code modules further comprises: a code module for printing a relevance indicator on at least one page from the one or more pages, the relevance indicator indicating a degree of relevance of the multimedia information stored by the multimedia document to the first concept of interest.
Claim 17
Dependent Claim
92 words
The system of claim 12 , wherein the plurality of code modules further comprises: a code module for accepting user input identifying a second concept of interest; a code module for analyzing the multimedia information stored by the multimedia document to identify information relevant to the second concept of interest; and a code module for printing the multimedia information on the one or more printed pages such that the information that is identified to be relevant to the second concept of interest is annotated when printed on the one or more pages.
Claim 18
Dependent Claim
76 words
The system of claim 15 wherein the information printed on the one or more pages that is identified to be relevant to the first topic of interest by analyzing the multimedia information is annotated using a first style and the information printed on the one or more pages that is identified to be relevant to the second topic of interest by analyzing the multimedia information is annotated using a second style different from the first style.
Claim 19
Dependent Claim
116 words
The system of claim 12 wherein the multimedia information comprises audio information, and wherein: the code module for analyzing the multimedia information comprises: a code module for generating a text transcript for the audio information; and a code module for analyzing the text transcript to identify information in the text transcript that is relevant to the first concept of interest; and the code module for printing the multimedia information on the paper medium comprises: a code module for printing the text transcript on the one or more pages such that the information in the text transcript identified to be relevant to the first concept of interest is annotated when printed on the one or more pages.
Claim 20
Dependent Claim
125 words
The system of claim 17 wherein: the code module for accepting user input identifying the first concept of interest comprises a code module for receiving information identifying a plurality of words associated with the first concept of interest; and the code module for analyzing the text transcript comprises a code module for identifying words in the text transcript that match words in the plurality of words associated with the first concept of interest; and the code module for printing the text transcript on the one or more pages comprises a code module for annotating the one or more words in the text transcript printed on the one or more pages that matched words in the plurality of words associated with the first concept of interest.
Claim 21
Dependent Claim
100 words
The system of claim 12 wherein the multimedia information comprises closed-caption text information, and wherein: the code module for analyzing the multimedia information comprises a code module for analyzing the closed-caption text information to identify text information that is relevant to the first concept of interest; and the code module for printing the multimedia information on the paper medium comprises a code module for printing the closed-caption text on the one or more pages such that the text information printed on the one or more pages that is identified to be relevant to the first concept of interest is annotated.
Claim 22
Dependent Claim
128 words
The system of claim 19 wherein: the code module for accepting user input identifying the first concept of interest comprises a code module for receiving information identifying a plurality of words associated with the first concept of interest; the code module for analyzing the closed-caption text information comprises a code module for identifying words in the closed-caption text information that match words in the plurality of words associated with the first concept of interest; and the code module for printing the closed-caption text information on the one or more pages comprises a code module for annotating the one or more words in the closed-caption text information printed on the one or more pages that matched words in the plurality of words associated with the first concept of interest.
Claim 23
Dependent Claim
128 words
The system of claim 12 wherein: the code module for accepting user input identifying the first concept of interest comprises a code module for receiving information identifying video features associated with the first concept of interest; the code module for analyzing the multimedia information comprises: a code module for extracting a plurality of video frames from the video information; and a code module for analyzing the plurality of video frames to identify one or more video frames that comprise at least one video feature from the video features associated with the first concept of interest; and the code module for printing the multimedia information on the paper medium comprises a code module for printing the one or more video frames on the one or more pages with annotations.
Claim 24
Dependent Claim
180 words
The system of claim 12 wherein: the code module for analyzing the multimedia information stored by the multimedia document to identify information relevant to the first concept of interest comprises: a code module for generating a printable representation for the multimedia information stored by the multimedia document, the printable representation capable of being printed on a paper medium; a code module for searching the printable representation to identify one or more sections of the printable representation that comprise information relevant to the first concept of interest; and a code module for annotating the one or more sections of the printable representation identified to comprise information relevant to the first concept of interest; and the code module for printing the multimedia information on a paper medium to generate the one or more printed pages comprises a code module for printing the printable representation on the one or more pages such that the one or more sections of the printable representation identified to comprise information relevant to the first concept of interest are annotated when printed on the one or more pages.
Claim 25
Dependent Claim
129 words
A computer program product stored on a computer-readable storage medium for generating a paper document for a electronically stored multimedia document storing multimedia information, the multimedia information including video information, the computer program product comprising: code for accepting user input identifying a first concept of interest; code for analyzing the multimedia information stored by the multimedia document to identify, absent direct human interaction, information relevant to the first concept of interest; and code for printing the multimedia information on a paper medium to generate the paper document comprising one or more printed pages such that the information that is identified to be relevant to the first concept of interest is annotated when printed on the one or more pages, the one or more pages comprising one or more pages.
Claim 26
Dependent Claim
129 words
A computer program product stored on a computer-readable storage medium for generating a paper document for a electronically stored multimedia document storing multimedia information, the multimedia information including video information, the computer program product comprising: code for accepting user input identifying a first concept of interest; code for analyzing the multimedia information stored by the multimedia document to identify, absent direct human interaction, information relevant to the first concept of interest; and code for printing the multimedia information on a paper medium to generate the paper document comprising one or more printed pages such that the information that is identified to be relevant to the first concept of interest is annotated when printed on the one or more pages, the one or more pages comprising one or more pages.
Claim 27
Dependent Claim
110 words
The computer program product of claim 23 wherein the multimedia information comprises audio information, and wherein: the code for analyzing the multimedia information comprises: code for generating a text transcript for the audio information; and code for analyzing the text transcript to identify information in the text transcript that is relevant to the first concept of interest; and the code for printing the multimedia information on the paper medium comprises: code for printing the text transcript on the one or more pages such that the information in the text transcript identified to be relevant to the first concept of interest is annotated when printed on the one or more pages.
Claim 28
Dependent Claim
96 words
The computer program product of claim 23 wherein the multimedia information comprises closed-caption text information, and wherein: the code for analyzing the multimedia information comprises code for analyzing the closed-caption text information to identify text information that is relevant to the first concept of interest; and the code for printing the multimedia information on the paper medium comprises code for printing the closed-caption text on the one or more pages such that the text information printed on the one or more pages that is identified to be relevant to the first concept of interest is annotated.
Claim 29
Dependent Claim
117 words
The computer program product of claim 23 wherein: the code for accepting user input identifying the first concept of interest comprises receiving information identifying video features associated with the first concept of interest; the code for analyzing the multimedia information comprises: code for extracting a plurality of video frames from the video information; and code for analyzing the plurality of video frames to identify one or more video frames that comprise at least one video feature from the video features associated with the first concept of interest; and the code for printing the multimedia information on the paper medium comprises code for printing the one or more video frames on the one or more pages with annotations.
Claim 30
Dependent Claim
172 words
The computer program product of claim 23 wherein: the code for analyzing the multimedia information stored by the multimedia document to identify information relevant to the first concept of interest comprises: code for generating a printable representation for the multimedia information stored by the multimedia document, the printable representation capable of being printed on a paper medium; code for searching the printable representation to identify one or more sections of the printable representation that comprise information relevant to the first concept of interest; and code for annotating the one or more sections of the printable representation identified to comprise information relevant to the first concept of interest; and the code for printing the multimedia information on a paper medium to generate the one or more printed pages comprises code for printing the printable representation on the one or more pages such that the one or more sections of the printable representation identified to comprise information relevant to the first concept of interest are annotated when printed on the one or more pages.
References Cited (Backward Citations)
US4417239A
Cited
US4481412A
Cited
GB2137788A
Cited
GB2156118A
Cited
EP0248403A2
Cited
US4823303A
Cited
US5442795A
Cited
US5680636A
Cited
US5250787A
Cited
US5382776A
Cited
EP0378848A2
Cited
GB2234609A
Cited
US5258880A
Cited
US6636869B1
Cited
US6061758A
Cited
US5479600A
Cited
JPH0421165A
Cited
US5153831A
Cited
EP0459174B1
Cited
US5761655A
Cited
US5309359A
Cited
US5404295A
Cited
US5418948A
Cited
US5349658A
Cited
US5748805A
Cited
US5999173A
Cited
US5467288A
Cited
US20020199149A1
Cited
USRE36801E
Cited
US5596700A
Cited
US5638543A
Cited
US5384703A
Cited
US5481666A
Cited
US5485554A
Cited
US5809318A
Cited
US5898709A
Cited
GB2290898A
Cited
US5600775A
Cited
US5675752A
Cited
US5758037A
Cited
US6094648A
Cited
US5946678A
Cited
US5694559A
Cited
JPH08297677A
Cited
EP0737927A2
Cited
US6182090B1
Cited
US5898166A
Cited
US5870770A
Cited
US5978773A
Cited
US6199048B1
Cited
US5778397A
Cited
US5838317A
Cited
US20010005203A1
Cited
US6005562A
Cited
EP0762297A2
Cited
US5860074A
Cited
US5819301A
Cited
US5737599A
Cited
US5781785A
Cited
US5857185A
Cited
US5706097A
Cited
US5950187A
Cited
US5894333A
Cited
EP0788064A2
Cited
EP0788063A2
Cited
US5832474A
Cited
US5873107A
Cited
US5721897A
Cited
EP0802492A1
Cited
US5933841A
Cited
US5745756A
Cited
US6098082A
Cited
US5751283A
Cited
US6021403A
Cited
US20040071441A1
Cited
US6151059A
Cited
US6160633A
Cited
US5895476A
Cited
US6026409A
Cited
US5986692A
Cited
US5892536A
Cited
US5790114A
Cited
US5943679A
Cited
US6108656A
Cited
US5933829A
Cited
US6006218A
Cited
US6028601A
Cited
US6596031B1
Cited
US6211869B1
Cited
US5784616A
Cited
US6434561B1
Cited
US6125229A
Cited
US5987454A
Cited
US6567980B1
Cited
US6518986B1
Cited
US20020059342A1
Cited
US6055542A
Cited
US6101503A
Cited
US6760541B1
Cited
US20040247298A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2010-08-27 | 2011-02-26 | 2011-08-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2014-08-27 | 2015-02-26 | 2015-08-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2018-08-27 | 2019-02-26 | 2019-08-28 | $7700.00 | Window Closed / Lapsed |