Patent US6549915B2 successfully refreshed from Google Patents.
US6549915B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Storing and recalling information to augment human memories
Assignee: Microsoft Technology Licensing LLC
•
Filing: 2001-06-06
•
Granted: 2003-04-15
•
Expires: 2021-06-06
Abstract
Abstract A system for computer-based storing of information about a current state so that later recall of the information can augment human memories. In particular, when information about a current event of interest is to be stored, a variety of current state information of different types (e.g., video, audio, and textual information) about the environment and about a user can be acquired via sensors and other input devices. The variety of state information can then be associated together as a group and stored for later retrieval. Other information can also be associated with the group, such as one or more recall tags that facilitate later retrieval of the group, or one or more annotations to provide contextual information when the other state information is later retrieved and presented to the user. When information about a past event is to be recalled, one or more identifying recall tags can be received that are used to identify one or more state information groups that match the identifying tags. Some or all of the previously-acquired state information for the identified state information groups can then be presented to the user on appropriate output devices. Other information, such as annotations, can also be presented to the user in order to describe the state information and thus assist the user's recollection of the previous state when the information was stored.
Inventors
- 👤 Kenneth H. Abbott, III
- 👤 Dan Newell
- 👤 James O. Robarts
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-01 11:30
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/90; G06F16/907; G06F16/40; G06F16/48; G06F16/487; Y; Y10; Y10S; Y10S707/00; Y10S707/99941; Y10S707/99944; Y10S707/99945; Y10S707/99948
Claims Analysis
Total Claims: 33
Claim 1
Independent Claim
227 words
A method in a computer for assisting a user to recall information about an environment of the user at a previous time, the computer having a plurality of stored groups of information each describing an environment of the user at a previous time and each having an associated recall tag to assist in retrieval of that stored group of information, each stored group of information including descriptive information about the environment and information recorded from the environment at the previous time by at least one computer input device, the method comprising: receiving an indication of a recall tag for use in retrieval of a stored group of information, the indication received by an executing State Recall Module; determining whether one of the stored groups of information has an associated recall tag matching the indicated recall tag, the determining performed under control of the State Recall Module; and when one of the stored groups of information is determined to have a matching recall tag, assisting the user to recall information about the environment at the previous time when the stored information for the determined one group of information was recorded by, under the control of the State Recall Module, presenting to the user the recorded information from the determined one group of information; and presenting to the user the descriptive information from the determined one group of information.
Claim 2
Independent Claim
227 words
A method in a computer for assisting a user to recall information about an environment of the user at a previous time, the computer having a plurality of stored groups of information each describing an environment of the user at a previous time and each having an associated recall tag to assist in retrieval of that stored group of information, each stored group of information including descriptive information about the environment and information recorded from the environment at the previous time by at least one computer input device, the method comprising: receiving an indication of a recall tag for use in retrieval of a stored group of information, the indication received by an executing State Recall Module; determining whether one of the stored groups of information has an associated recall tag matching the indicated recall tag, the determining performed under control of the State Recall Module; and when one of the stored groups of information is determined to have a matching recall tag, assisting the user to recall information about the environment at the previous time when the stored information for the determined one group of information was recorded by, under the control of the State Recall Module, presenting to the user the recorded information from the determined one group of information; and presenting to the user the descriptive information from the determined one group of information.
Claim 3
Dependent Claim
16 words
The method of claim 1 wherein the indication of the tag is received from the user.
Claim 4
Dependent Claim
17 words
The method of claim 1 wherein the indication of the tag is generated automatically without human intervention.
Claim 5
Dependent Claim
34 words
The method of claim 1 including, before the receiving of the indication of the tag, generating a stored group of information about a current state of the environment in response to a received indication.
Claim 6
Dependent Claim
11 words
The method of claim 1 wherein the tag is textual information.
Claim 7
Dependent Claim
11 words
The method of claim 1 wherein the tag is audio information.
Claim 8
Dependent Claim
11 words
The method of claim 1 wherein the tag is video information.
Claim 9
Dependent Claim
33 words
The method of claim 1 wherein the determined group of information includes sensed information about a state of the user at the previous time when the information was recorded for the determined group.
Claim 10
Independent Claim
185 words
A method in a computer for assisting a user in recalling a previous state, the computer having a plurality of stored state fragments each describing a previous time and having an associated topic related to the described previous time, each state fragment including information recorded at the previous time for that state fragment by at least one computer input sensor and descriptive information about the recorded information, the method comprising: receiving from the user an indication of a topic related to a previous time, the indication received by a State Recall Module of the computer; determining whether one of the stored state fragments has an associated topic matching the indicated topic, the determining performed by the State Recall Module; and when one of the stored state fragments is determined to have a matching associated topic, assisting the user to recall information about the previous time described by the determined one state fragment by, under control of the State Recall Module, presenting to the user the recorded information of the one state fragment; and presenting to the user the descriptive information of the one state fragment.
Claim 11
Independent Claim
185 words
A method in a computer for assisting a user in recalling a previous state, the computer having a plurality of stored state fragments each describing a previous time and having an associated topic related to the described previous time, each state fragment including information recorded at the previous time for that state fragment by at least one computer input sensor and descriptive information about the recorded information, the method comprising: receiving from the user an indication of a topic related to a previous time, the indication received by a State Recall Module of the computer; determining whether one of the stored state fragments has an associated topic matching the indicated topic, the determining performed by the State Recall Module; and when one of the stored state fragments is determined to have a matching associated topic, assisting the user to recall information about the previous time described by the determined one state fragment by, under control of the State Recall Module, presenting to the user the recorded information of the one state fragment; and presenting to the user the descriptive information of the one state fragment.
Claim 12
Dependent Claim
29 words
The method of claim 9 including, before the receiving of the indication of the topic, generating the one state fragment in response to an indication received from the user.
Claim 13
Dependent Claim
29 words
The method of claim 9 wherein the one state fragment includes sensed information about an environment of the user at the previous time described by the one state fragment.
Claim 14
Dependent Claim
28 words
The method of claim 9 wherein the one state fragment includes information about a state of the computer at the previous time described by the one state fragment.
Claim 15
Independent Claim
177 words
A method in a computer for assisting a user in recalling a past state, the computer having a plurality of stored state fragments each describing a previous time, each state fragment having information recorded at the previous time for that state fragment by at least one computer input sensor and having an associated topic related to the recorded information, the method comprising: monitoring the user to collect a group of information about a current state of the user; monitoring an environment of the user to collect a group of information about a current state of the environment; and without user intervention, determining based on the collected groups of information a topic of interest to the user, the determining performed by an executing User Modeling Module; and assisting the user in recalling a past state having information related to the determined topic by, under control of an executing State Recall Module, identifying a stored state fragment with an associated topic that matches the determined topic; and presenting to the user the recorded information of the identified state fragment.
Claim 16
Independent Claim
177 words
A method in a computer for assisting a user in recalling a past state, the computer having a plurality of stored state fragments each describing a previous time, each state fragment having information recorded at the previous time for that state fragment by at least one computer input sensor and having an associated topic related to the recorded information, the method comprising: monitoring the user to collect a group of information about a current state of the user; monitoring an environment of the user to collect a group of information about a current state of the environment; and without user intervention, determining based on the collected groups of information a topic of interest to the user, the determining performed by an executing User Modeling Module; and assisting the user in recalling a past state having information related to the determined topic by, under control of an executing State Recall Module, identifying a stored state fragment with an associated topic that matches the determined topic; and presenting to the user the recorded information of the identified state fragment.
Claim 17
Dependent Claim
29 words
The method of claim 13 including, before the identifying of the stored state fragment, generating the stored state fragment in response to an indication generated automatically without user intervention.
Claim 18
Dependent Claim
28 words
The method of claim 13 wherein the identified state fragment includes information about a state of the computer at the previous time described by the identified state fragment.
Claim 19
Dependent Claim
32 words
The method of claim 13 wherein the identified state fragment additionally has descriptive information about the recorded information, and including presenting to the user the descriptive information of the identified state fragment.
Claim 20
Independent Claim
196 words
A method in a computer for assisting a user in recalling a previous state, the computer having a plurality of stored groups of information each describing a previous state and each having a recall tag, each group of information having information recorded from an environment external to the user by at least one computer input device and having information recorded from the user by at least one computer input device, the method comprising: receiving an indication of a recall tag for use in retrieval of a stored group of information, the indication received by an executing State Recall Module; determining whether one of the stored groups of information has a recall tag matching the indicated recall tag, the determining performed under control of the State Recall Module; and when one of the stored groups of information is determined to have a matching recall tag, assisting the user in recalling the previous state described by the one group of information by, under control of the State Recall Module, presenting to the user the recorded environment information from the one group of information; and presenting to the user the recorded user information from the one group of information.
Claim 21
Independent Claim
196 words
A method in a computer for assisting a user in recalling a previous state, the computer having a plurality of stored groups of information each describing a previous state and each having a recall tag, each group of information having information recorded from an environment external to the user by at least one computer input device and having information recorded from the user by at least one computer input device, the method comprising: receiving an indication of a recall tag for use in retrieval of a stored group of information, the indication received by an executing State Recall Module; determining whether one of the stored groups of information has a recall tag matching the indicated recall tag, the determining performed under control of the State Recall Module; and when one of the stored groups of information is determined to have a matching recall tag, assisting the user in recalling the previous state described by the one group of information by, under control of the State Recall Module, presenting to the user the recorded environment information from the one group of information; and presenting to the user the recorded user information from the one group of information.
Claim 22
Dependent Claim
18 words
The method of claim 17 wherein the recorded information from the user includes sensed information about the user.
Claim 23
Dependent Claim
18 words
The method of claim 17 wherein the recorded information from the user includes information input by the user.
Claim 24
Dependent Claim
24 words
The method of claim 17 wherein the one stored group of information additionally has an annotation, and including presenting to the user the annotation.
Claim 25
Dependent Claim
211 words
A computer-readable medium whose contents cause a computer to provide information to a user about an environment of the user at a previous time, the computer having a plurality of stored groups of information each describing an environment of the user at a previous time and each having an associated recall tag, each group of information having descriptive information about the environment and having information recorded from the environment at the previous time by at least one computer input device, by performing a method comprising: receiving an indication of a recall tag related to a previous time, the indication received by a State Recall Module of the computer; determining whether one of the stored groups of information has an associated recall tag matching the indicated recall tag, the determining performed under control of the State Recall Module; and when one of the stored groups of information is determined to have a matching recall tag, providing information to the user about the environment at the previous time described by the determined one group of information by, under control of the State Recall Module, presenting to the user the recorded information from the determined one group of information; and presenting to the user the descriptive information from the determined one group of information.
Claim 26
Dependent Claim
211 words
A computer-readable medium whose contents cause a computer to provide information to a user about an environment of the user at a previous time, the computer having a plurality of stored groups of information each describing an environment of the user at a previous time and each having an associated recall tag, each group of information having descriptive information about the environment and having information recorded from the environment at the previous time by at least one computer input device, by performing a method comprising: receiving an indication of a recall tag related to a previous time, the indication received by a State Recall Module of the computer; determining whether one of the stored groups of information has an associated recall tag matching the indicated recall tag, the determining performed under control of the State Recall Module; and when one of the stored groups of information is determined to have a matching recall tag, providing information to the user about the environment at the previous time described by the determined one group of information by, under control of the State Recall Module, presenting to the user the recorded information from the determined one group of information; and presenting to the user the descriptive information from the determined one group of information.
Claim 27
Dependent Claim
12 words
The computer-readable medium of claim 21 wherein the tag is audio information.
Claim 28
Dependent Claim
12 words
The computer-readable medium of claim 21 wherein the tag is video information.
Claim 29
Dependent Claim
32 words
The computer-readable medium of claim 21 wherein the determined group of information includes sensed information about the user at the previous time when information was recorded for the determined group of information.
Claim 30
Dependent Claim
34 words
The computer-readable medium of claim 21 wherein the determined group of information includes information about a state of the computer at the previous time when information was recorded for the determined group of information.
Claim 31
Dependent Claim
180 words
A computer system for reminding a user of a prior environment external to the user, comprising: a storage means having a plurality of stored groups of information each describing an environment of the user at a previous time and each having an associated recall tag to assist in retrieval of that stored group of information, each group of information having descriptive information about the environment and having information recorded from the environment at the previous time by at least one computer input device; and a state recall module that receives an indication of a recall tag, that determines whether one of the stored groups of information has an associated recall tag matching the indicated recall tag, and that, when one of the stored groups of information is determined to have a matching recall tag, reminds the user of the environment at the previous time described by the determined group of information by presenting to the user the recorded information from the determined group of information and by presenting to the user the descriptive information from the determined group of information.
Claim 32
Dependent Claim
180 words
A computer system for reminding a user of a prior environment external to the user, comprising: a storage means having a plurality of stored groups of information each describing an environment of the user at a previous time and each having an associated recall tag to assist in retrieval of that stored group of information, each group of information having descriptive information about the environment and having information recorded from the environment at the previous time by at least one computer input device; and a state recall module that receives an indication of a recall tag, that determines whether one of the stored groups of information has an associated recall tag matching the indicated recall tag, and that, when one of the stored groups of information is determined to have a matching recall tag, reminds the user of the environment at the previous time described by the determined group of information by presenting to the user the recorded information from the determined group of information and by presenting to the user the descriptive information from the determined group of information.
Claim 33
Dependent Claim
53 words
The computer system of claim 26 including a user modeling module that monitors the user and an environment of the user to collect a group of information about a current state, and that determines based on the monitoring when to augment the memory of the user about the environment at a previous time.
References Cited (Backward Citations)
US5227614A
Cited
US4916441A
Cited
US5201034A
Cited
US5506580A
Cited
WO1990008361A1
Cited
US5032083A
Cited
US5214757A
Cited
US5983335A
Cited
US5781913A
Cited
US5568645A
Cited
US5208449A
Cited
JPH05260188A
Cited
US6108197A
Cited
US5335276A
Cited
US5416730A
Cited
US5493692A
Cited
US5555376A
Cited
US5611050A
Cited
US5812865A
Cited
US6064943A
Cited
US5470233A
Cited
EP0823813A2
Cited
US5646629A
Cited
US5559520A
Cited
US5959611A
Cited
US5642303A
Cited
US5873070A
Cited
WO1997003434A1
Cited
JPH0991112A
Cited
US5878274A
Cited
US5726660A
Cited
US5948041A
Cited
US5910799A
Cited
US5790974A
Cited
US6047301A
Cited
US5719744A
Cited
US5938721A
Cited
US5902347A
Cited
US5798733A
Cited
WO1998047084A1
Cited
US5991687A
Cited
WO1999017228A1
Cited
US6294953B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-04-14 | 2006-10-14 | 2007-04-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-04-14 | 2010-10-14 | 2011-04-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-04-14 | 2014-10-14 | 2015-04-15 | $7700.00 | Window Closed / Lapsed |