US5774841A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Real-time reconfigurable adaptive speech recognition command and control apparatus and method
Assignee: National Aeronautics and Space Administration
•
Filing: 1995-09-20
•
Granted: 1998-06-30
•
Expires: 2015-09-20
Abstract
Abstract An adaptive speech recognition and control system and method for controlling various mechanisms and systems in response to spoken instructions and in which spoken commands are effective to direct the system into appropriate memory nodes, and to respective appropriate memory templates corresponding to the voiced command. Spoken commands from any of a group of operators for which the system is trained may be identified, and voice templates are updated as required in response to changes in pronunciation and voice characteristics over time of any of the operators for which the system is trained. Provisions are made for both near-real-time retraining of the system with respect to individual terms which are determined not be positively identified, and for an overall system training and updating process in which recognition of each command and vocabulary term is checked, and in which the memory templates are retrained if necessary for respective commands or vocabulary terms with respect to an operator currently using the system. In one embodiment, the system includes input circuitry connected to a microphone and including signal processing and control sections for sensing the level of vocabulary recognition over a given period and, if recognition performance falls below a given level, processing audio-derived signals for enhancing recognition performance of the system.
Inventors
- 👤 George A. Salazar
- 👤 Dena S. Haynes
- 👤 Marc J. Sommers
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 16:03
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/06; G10L15/065; G10L15/22; G10L15/063; G10L2015/0631; G10L2015/0635; G10L2015/223
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
183 words
An adaptive speech recognition and control system, comprising: a speech recognition circuit section including memory means for storing a plurality of vocabulary subsets, each of the plurality of vocabulary subsets identified by a node, each subset comprising a plurality of voice templates; a microphone; analog circuitry associated with the microphone for processing voice commands spoken into the microphone and conducting the processed signals to the speech recognition circuitry; processing means associated with the speech recognition circuitry for causing the speech recognition circuit section to user-selectively transition to a node which opens a memory section storing a selected vocabulary subset, corresponding to a spoken transitional command, in response to a predetermined transitional command being spoken into the microphone by an operator, and for subsequently causing the speech recognition circuitry to search the voice templates stored in the selected subset upon a vocabulary term subsequently being spoken while the speech recognition circuit is transitioned to the node corresponding to the selected vocabulary subset, and for determining, within a degree of certainty, whether the vocabulary term matches one of the voice templates in the selected subset.
Claim 2
Dependent Claim
183 words
An adaptive speech recognition and control system, comprising: a speech recognition circuit section including memory means for storing a plurality of vocabulary subsets, each of the plurality of vocabulary subsets identified by a node, each subset comprising a plurality of voice templates; a microphone; analog circuitry associated with the microphone for processing voice commands spoken into the microphone and conducting the processed signals to the speech recognition circuitry; processing means associated with the speech recognition circuitry for causing the speech recognition circuit section to user-selectively transition to a node which opens a memory section storing a selected vocabulary subset, corresponding to a spoken transitional command, in response to a predetermined transitional command being spoken into the microphone by an operator, and for subsequently causing the speech recognition circuitry to search the voice templates stored in the selected subset upon a vocabulary term subsequently being spoken while the speech recognition circuit is transitioned to the node corresponding to the selected vocabulary subset, and for determining, within a degree of certainty, whether the vocabulary term matches one of the voice templates in the selected subset.
Claim 3
Dependent Claim
110 words
The system of claim 1, wherein the analog circuitry comprises first and second, serially connected gain adjustment circuits, and wherein the processing means further comprises recognition feedback means for determining whether a plurality of successively processed vocabulary terms have been matched to respective voice templates with an acceptable level of probability or an unacceptable level of probability, and, if an unacceptable level of probability is sensed after a predetermined number of verbal commnands, for varying the operation of at least one of the gain adjustment circuits for modifying the signals fed to the speech recognition circuitry to increase the percentage of recognition within acceptable probability levels of spoken vocabulary terms.
Claim 4
Dependent Claim
75 words
The system of claim 2, wherein the first gain adjustment circuit comprises a voltage controlled analog switching circuit, and wherein the second gain adjustment circuit comprises a programmable, digitally controlled gain amplifier, and wherein the processing means comprises means for enabling the first gain adjustment circuit of the analog switching circuit upon an unacceptable level of speech recognition occurring and, if an unacceptable level of speech recognition continues, for digitally adjusting the programmable gain amplifier.
Claim 5
Dependent Claim
81 words
The system of claim 2, wherein the processing means comprising means for enabling and adjusting the gain of the first gain adjustment circuit in response to a series of spoken vocabulary terms of low mean volume level but within an acceptable, limited range of volume levels, and alternatively, for adjusting the gain of the second gain adjustment circuit in response to a series of spoken vocabulary terms of acceptable average volume level but of an undesirable wide range of volume levels.
Claim 6
Dependent Claim
33 words
The system of claim 1, further comprising means for indicating to the operator the vocabulary term of the voice template selected by the speech recognition circuit section as matching a spoken vocabulary term.
Claim 7
Dependent Claim
37 words
The system of claim 5, further comprising audible and visible means for indicating to the operator that the speech recognition circuit section has transitioned to a node, identified to the operator, in response to a transitional command.
Claim 8
Dependent Claim
33 words
The system of claim 1, further comprising means for storing selected vocabulary terms as voice templates and for subsequently retraining the voice templates in accordance with the current speech patterns of an operator.
Claim 9
Dependent Claim
99 words
The system of claim 7, wherein the means for retraining the voice templates comprises means for successively displaying vocabulary terms stored in the memory for prompting the operator to speak the respective terms and for comparing voice characteristics associated with respective vocabulary terms spoken by the operator, in response to the displayed terms, with the speech patterns stored in the respective sequentially activated voice templates, and for reprogramming respective voice templates upon determining that their stored speech patterns do not correspond, within acceptable limits, with the current voice pattern of the operator as a selected vocabulary term is spoken.
Claim 10
Dependent Claim
34 words
The system of claim 7, wherein the speech patterns stored within respective voice templates encompass a range of permissible voice patterns corresponding to voice patterns associated with speech characteristics of a plurality of operators.
Claim 11
Dependent Claim
57 words
The system of claim 7, wherein the system is operative, in accordance with the voice training and retraining process, in either of a training mode, or an operative mode, and wherein the system further compromises means for retraining the voice templates during the operative mode in response to a non-recognized vocabulary term spoken during the operative mode.
Claim 12
Dependent Claim
70 words
The system of claim 7, wherein the system includes a local RAM memory associated with the speech recognizer circuit and a vocabulary memory, and wherein updating changes are stored in voice templates stored in the local RAM memory, further comprising means for downloading the updated voiceprints to the vocabulary memory, and for downloading the voiceprints stored in the vocabulary memory into the local RAM memory during activation of the system.
Claim 13
Dependent Claim
64 words
The system of claim 7, further comprising a commanded system controlled by the voice command system and an output section connected to the system controlled by the voice command system, and wherein, in its operative mode, the speech recognition and control system comprises means for transmitting command signals, corresponding with verbal commands spoken by the operator, from the output section to the controlled system.
Claim 14
Dependent Claim
34 words
The system of claim 12, wherein the controlled system comprises a robotic system, and wherein the voice command system comprises means for controlling the robotic system in response to verbal commands of the operator.
Claim 15
Dependent Claim
58 words
The system of claim 7, wherein the system includes voiceprint training means for training the voice templates, within a user adjustable threshold of voice recognition, in accordance with spoken terms and, in the event, after an initial cycle of training, the voiceprint still does not match the spoken term, for forcing a retraining change in the voice template.
Claim 16
Dependent Claim
48 words
The system of claim 7, wherein the means for retraining the voiceprints comprises means for comparing the history of speech characteristics of an operator with respect to each vocabulary term and, during retraining of the voice template, integrating the newly entered voice characteristics with previously stored voice characteristics.
Claim 17
Dependent Claim
28 words
The apparatus of claim 1, further comprising input output circuitry including switching means operable by an operator for controlling the system independently of the voice activated circuit portions.
Claim 18
Dependent Claim
24 words
The apparatus of claim 16, wherein the switching means comprises means for node selection, and for permitting independent operator control of the processor node.
Claim 19
Dependent Claim
139 words
A speech recognition method comprising the steps of: storing a plurality of vocabulary subsets in a memory of a speech recognition apparatus, each vocabulary subset comprising a plurality of voice templates, and each vocabulary subset identified by a node; receiving a speech signal in an analog section of the speech recognition apparatus, the speech signal comprising a command term and a vocabulary term; digitizing the received speech signal to a digital form; processing the digitized speech signal, causing the speech recognition apparatus to transition to a node which opens a memory section storing a selected vocabulary subset, corresponding to the command term; searching the voice templates stored in the selected subset for a match with the vocabulary term; and determining, within a level of probability, whether the vocabulary term matches one of the voice templates in the selected subset.
Claim 20
Dependent Claim
139 words
A speech recognition method comprising the steps of: storing a plurality of vocabulary subsets in a memory of a speech recognition apparatus, each vocabulary subset comprising a plurality of voice templates, and each vocabulary subset identified by a node; receiving a speech signal in an analog section of the speech recognition apparatus, the speech signal comprising a command term and a vocabulary term; digitizing the received speech signal to a digital form; processing the digitized speech signal, causing the speech recognition apparatus to transition to a node which opens a memory section storing a selected vocabulary subset, corresponding to the command term; searching the voice templates stored in the selected subset for a match with the vocabulary term; and determining, within a level of probability, whether the vocabulary term matches one of the voice templates in the selected subset.
Claim 21
Dependent Claim
78 words
The method of claim 18, further comprising the steps of: determining whether a plurality of successively processed vocabulary terms have been matched to respective voice templates with an acceptable level of probability or an unacceptable level of probability, and, if an unacceptable level of probability is determined after a predetermined number of command terms, modifying the speech signal fed to the speech recognition apparatus to increase the percentage of recognition within acceptable probability levels of spoken vocabulary terms.
Claim 22
Dependent Claim
28 words
The method of claim 19, wherein the step of modifying the speech signal fed to the speech recognition apparatus is performed by digitally adjusting a programmable gain amplifier.
References Cited (Backward Citations)
US4471683A
Cited
US4720802A
Cited
US4780906A
Cited
US4747143A
Cited
US4737976A
Cited
US4725956A
Cited
US4783803A
Cited
US4912766A
Cited
US4866778A
Cited
US4829576A
Cited
US5027406A
Cited
US5086385A
Cited
US5046099A
Cited
US5036539A
Cited
US5125023A
Cited
US5161245A
Cited
US5182641A
Cited
US5189709A
Cited
US5475792A
Cited
US5428707A
Cited
US5544654A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-06-29 | 2001-12-29 | 2002-06-30 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-06-29 | 2005-12-29 | 2006-06-30 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-06-29 | 2009-12-29 | 2010-06-30 | $7700.00 | Window Closed / Lapsed |