Multimedia-based reporting system with recording and playback of dynamic annotation

Claim 2

A multimedia-based reporting system comprising: a command interpreter for receiving user command inputs; an attach media handler connected to said command interpreter; an annotation input interpreter for receiving user annotation inputs; and, a dynamic annotation handler connected to said annotation input interpreter wherein said dynamic annotation handler comprises: an adaptive synchronizer for synchronizing actions and voice; and continuous multichannel presentation means.

Claim 3

A multimedia-based reporting system as claimed in claim 1 further comprising: a print report handler connected to said command interpreter; a save report handler connected to said command interpreter; and, an annotation on annotation handler connected to said annotation input interpreter.

Claim 4

A multimedia-based reporting system as claimed in claim 2 wherein said annotation on annotation handler comprises: display means for displaying segmented annotations using markers; user selection means to allow said user to select a segment; record means to record said segment; and, playback means to playback said segment.

Claim 5

A multimedia-based reporting system as claimed in claim 1 further comprising: a mail report handler connected to said command interpreter; an open report handler connected to said command interpreter; a static annotation handler connected to said annotation input interpreter; and an annotation on annotation handler connected to said annotation input interpreter.

Claim 6

A multimedia-based reporting system as claimed in claim 4 further comprising: a delete current report handler connected to said command interpreter; and, a report viewer for displaying the content of a report.

Claim 7

A multimedia-based reporting system as claimed in claim 1 wherein said dynamic annotation handler further comprises: recording means; and, playback means.

Claim 8

A multimedia-based reporting system as claimed in claim 6 wherein said recording means comprises: audio recorder means for receiving voice and for converting said voice into audio signals; silence detector means connected to said audio recorder means for receiving said audio signals; compression means connected to said silence detector means for compressing said audio signals; key stroke/mouse movement means for identifying typing or movement of a mouse; event generation means connected to said key stroke/mouse movement means for generating events created by said typing or movement of said mouse; filter means connected to said event generation means for filtering said events; annotation related event means connected to said filter means for receiving filtered events and for providing event-name, time, parameters; and, annotation file means connected to said compression means for receiving compressed audio signals and connected to said annotation related event means for receiving said event-name, time, parameters.

Claim 9

A multimedia-based reporting system as claimed in claim 7 wherein said filter means comprises: a first decision means to determine whether a new -- event is equal to a time sliced event; a second decision means to determine whether a prev -- event is equal to said time sliced event; recording means for recording said new -- event; a third decision means to determine whether dist(prev -- event, new -- event) is less than a threshold; and, means for not recording said new -- event.

Claim 10

A multimedia-based reporting system as claimed in claim 1 wherein said adaptive synchronizer comprises: annotation scheduler means for receiving information from action data and for scheduling each interval of an annotation schedule; audio device interface means connected to said annotation scheduler; and, action execution means connected to said annotation scheduler means for receiving filtered actions from said annotation scheduler means and for providing feedback of CPU load to said annotation scheduler means.

Claim 13

A method of preparing multimedia based reports as claimed in claim 10 further comprising the steps of: printing said report; saving said report in an external media storage; and, performing annotation on annotation.

Claim 14

A method of preparing multimedia based reports as claimed in claim 11 further comprising the steps of: mailing said report; and, displaying said report.

Claim 15

A method of preparing multimedia based reports as claimed in claim 11 wherein performing annotation on annotation comprises the steps of: displaying segmented annotations using markers; allowing a user to select a segment; annotating on said segment; and, playing back said segment or related segments of said segment.

Claim 16

A method of preparing multimedia based reports as claimed in claim 11 wherein performing dynamic annotation further comprises the steps of: recording; and, playing back.

Claim 17

A method of preparing multimedia based reports as claimed in claim 14 wherein recording comprises the steps of: utilizing audio recorder means for receiving voice and for converting said voice into audio signals; utilizing silence detector means connected to said audio recorder means for receiving said audio signals; compressing said audio signals; identifying typing or movement of a mouse; generating events created by said typing or movement of said mouse; filtering said events; utilizing annotation related event means for receiving filtered events and for providing event-name, time, parameters; and, utilizing annotation file means for receiving compressed audio signals and for receiving said event-name, time, parameters.

Claim 18

A method of preparing multimedia based reports as claimed in claim 15 wherein filtering comprises the steps of: determining whether a new -- event is a time-sliced event; determining whether a prev -- event is said time-sliced event; recording said new -- event if said new -- event is not said time-sliced event; determining whether dist(prev -- event, new -- event) is less than a threshold; recording said new -- event if said new -- event and said prev -- event are time-sliced events and if dist(prev -- event, new -- event) is not less than said threshold; and, not recording said new -- event if dist(prev -- event, new -- event) is less than said threshold.

Claim 19

A method of preparing multimedia based reports as claimed in claim 10 wherein utilizing an adaptive synchronizer comprises the steps of: utilizing annotation scheduler means for receiving information from action data and for scheduling each interval of an annotation schedule; utilizing audio device interface means connected to said annotation scheduler; and, utilizing action execution means connected to said annotation scheduler means for receiving filtered actions from said annotation scheduler means and for providing feedback of CPU load to said annotation scheduler means.

Claim 20

A multimedia-based reporting system comprising: a command interpreter for receiving user command inputs; an attach media handler connected to said command interpreter and a multimedia report for receiving external media from an external media source; a mail report handler connected to said command interpreter and said multimedia report; a print report handler connected to said command interpreter and said multimedia report; a save report handler connected to said command interpreter and said multimedia report for saving said multimedia report to an external media storage; an open report handler connected to said command interpreter and said multimedia report for receiving external reports from an external report source; an annotation input interpreter for receiving user annotation inputs; a static annotation handler connected to said annotation input interpreter and said multimedia report; an annotation on annotation handler connected to said annotation input interpreter and said multimedia report; a dynamic annotation handler connected to said annotation input interpreter and said multimedia report; and, a report viewer for displaying content of said multimedia report wherein said dynamic annotation handler comprises: adaptive synchronization means for synchronizing actions and voice; and continuous multichannel presentation means.

Claim 21

A multimedia-based reporting system comprising: a command interpreter for receiving user command inputs; an attach media handler connected to said command interpreter and a multimedia report for receiving external media from an external media source; a mail report handler connected to said command interpreter and said multimedia report; a print report handler connected to said command interpreter and said multimedia report; a save report handler connected to said command interpreter and said multimedia report for saving said multimedia report to an external media storage; an open report handler connected to said command interpreter and said multimedia report for receiving external reports from an external report source; an annotation input interpreter for receiving user annotation inputs; a static annotation handler connected to said annotation input interpreter and said multimedia report; an annotation on annotation handler connected to said annotation input interpreter and said multimedia report; a dynamic annotation handler connected to said annotation input interpreter and said multimedia report; and, a report viewer for displaying content of said multimedia report wherein said dynamic annotation handler comprises: adaptive synchronization means for synchronizing actions and voice; and continuous multichannel presentation means.