Patent US5937385A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5937385A Expired / Lapsed US ⏱️ 0.0 years remaining

Method and apparatus for creating speech recognition grammars constrained by counter examples

Assignee: International Business Machines Corp
•
Filing: 1997-10-20
•
Granted: 1999-08-10
•
Expires: 2017-10-20
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract An automated system generates and revises grammars for speech recognizers in a speech recognition system. Given an initial grammar, expressed in terms of non-terminals in Backus-Naur Form (BNF) notation, a sentence generator generates a list of all sentences accepted by the grammar. From this list, a corpus of inappropriate or irrelevant sentences which are accepted by the grammar (counter-examples) is identified. A grammar revisor program uses the original grammar and the list of counter examples, to generate a pruned list from which a revised grammar is generated. The revision process is iterated several times either concatenating or merging pairs of non-terminals until the revised grammar is deemed satisfactory in that it accepts as legal only relevant sentences. The revised grammar is used by the speech recognizer, thus reducing errors in the overall system.

Inventors

  • 👤 Wlodek Wlodzimierz Zadrozny
  • 👤 Nandakishore Kambhatla

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-01 17:44
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/18; G10L15/183; G10L15/19; G10L15/193

Claims Analysis

Total Claims: 27
Claim 1
Independent Claim 135 words
A system for creating grammars for a speech recognition application, comprising: speech grammar repository means for receiving an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; sentence generator means for generating a list of possible sentences according to said initial grammar rules; counter-example generator means for analyzing said list of possible sentences and generating a list of counter example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; and a grammar revisor means, receiving said initial grammar rules and said list of counter example sentences, for generating from said initial grammar rules and said list of counter example sentences a revised grammar, wherein said counter example sentences are illegal in said revised grammar.
Claim 2
Independent Claim 135 words
A system for creating grammars for a speech recognition application, comprising: speech grammar repository means for receiving an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; sentence generator means for generating a list of possible sentences according to said initial grammar rules; counter-example generator means for analyzing said list of possible sentences and generating a list of counter example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; and a grammar revisor means, receiving said initial grammar rules and said list of counter example sentences, for generating from said initial grammar rules and said list of counter example sentences a revised grammar, wherein said counter example sentences are illegal in said revised grammar.
Claim 3
Dependent Claim 55 words
A system for creating grammars for a speech recognition application as recited in claim 1 wherein said grammar revisor means comprises: counter-example remover means for removing said counter example sentences from said list of possible sentences and outputting a pruned list; and a grammar generator means, receiving said pruned list and outputting said revised grammar.
Claim 4
Independent Claim 272 words
A system for creating grammars for a speech recognition application, comprising: speech grammar repository means for receiving an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; sentence generator means for generating a list of possible sentences according to said initial grammar rules; counter-example generator for analyzing said list of possible sentences and generating a list of counter example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; and a grammar revisor means, receiving said initial grammar rules and said list of counter example sentences, for generating therefrom a revised grammar wherein said counter example sentences are illegal for said speech recognition application, wherein said grammar revisor means comprises: counter-example remover means for removing said counter-example sentences from said list of possible sentences and outputting a pruned list; and a grammar generator means, receiving said pruned list and outputting said revised grammar, wherein said counter example sentences are illegal for said speech recognition application, wherein said grammar generator means comprises: means for generating a unique non-terminal for each word in said pruned list; means for computing a base optimization criterion value based on properties of words in said pruned list for said initial grammar; means for concatenating a pair of non-terminals and computing a first resultant optimization criterion value; means for merging said pair of non-terminals and computing the second resultant value of said optimization criterion; and means for adding a new grammar rule to said initial grammar in accordance with an optimal of said first and second optimization criterion values.
Claim 5
Independent Claim 272 words
A system for creating grammars for a speech recognition application, comprising: speech grammar repository means for receiving an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; sentence generator means for generating a list of possible sentences according to said initial grammar rules; counter-example generator for analyzing said list of possible sentences and generating a list of counter example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; and a grammar revisor means, receiving said initial grammar rules and said list of counter example sentences, for generating therefrom a revised grammar wherein said counter example sentences are illegal for said speech recognition application, wherein said grammar revisor means comprises: counter-example remover means for removing said counter-example sentences from said list of possible sentences and outputting a pruned list; and a grammar generator means, receiving said pruned list and outputting said revised grammar, wherein said counter example sentences are illegal for said speech recognition application, wherein said grammar generator means comprises: means for generating a unique non-terminal for each word in said pruned list; means for computing a base optimization criterion value based on properties of words in said pruned list for said initial grammar; means for concatenating a pair of non-terminals and computing a first resultant optimization criterion value; means for merging said pair of non-terminals and computing the second resultant value of said optimization criterion; and means for adding a new grammar rule to said initial grammar in accordance with an optimal of said first and second optimization criterion values.
Claim 6
Dependent Claim 25 words
A system for creating grammars for a speech recognition application as recited in claim 3 wherein said optimization criterion is description length of the grammar.
Claim 7
Dependent Claim 26 words
A system for creating grammars for a speech recognition application as recited in claim 4 wherein said initial grammar is expressed in Backus-Naur Form (BNF) notation.
Claim 8
Independent Claim 312 words
A system for creating grammars for a speech recognition application, comprising: speech grammar repository means for receiving an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; sentence generator means for generating a list of possible sentences according to said initial grammar rules; counter-example generator for analyzing said list of possible sentences and generating a list of counter example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; and a grammar revisor means, receiving said initial grammar rules and said list of counter example sentences, for generating therefrom a revised grammar wherein said counter example sentences are illegal for said speech recognition application, wherein said grammar revisor means comprises: counter-example remover means for removing said counter-example sentences from said list of possible sentences and outputting a pruned list; and a grammar generator means, receiving said pruned list and outputting said revised grammar, wherein said counter example sentences are illegal for said speech recognition application, wherein said grammar generator means comprises: means for generating a unique non-terminal for each word in said pruned list; means for computing a base value of an optimization criterion based on properties of the words in said pruned list for said initial grammar; means for concatenating a pair of said non-terminals and computing a resultant value of said optimization criterion and for adding a new rule for said concatenated pair to said initial grammar if said value of criterion is more optimal than said base value of said optimization criterion; and means for merging said pair of said non-terminals and computing a resultant value of said criterion and for adding a new rule for said merged pair to said initial grammar if said resultant value of optimization criterion is more optimal than said base value of criterion.
Claim 9
Independent Claim 312 words
A system for creating grammars for a speech recognition application, comprising: speech grammar repository means for receiving an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; sentence generator means for generating a list of possible sentences according to said initial grammar rules; counter-example generator for analyzing said list of possible sentences and generating a list of counter example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; and a grammar revisor means, receiving said initial grammar rules and said list of counter example sentences, for generating therefrom a revised grammar wherein said counter example sentences are illegal for said speech recognition application, wherein said grammar revisor means comprises: counter-example remover means for removing said counter-example sentences from said list of possible sentences and outputting a pruned list; and a grammar generator means, receiving said pruned list and outputting said revised grammar, wherein said counter example sentences are illegal for said speech recognition application, wherein said grammar generator means comprises: means for generating a unique non-terminal for each word in said pruned list; means for computing a base value of an optimization criterion based on properties of the words in said pruned list for said initial grammar; means for concatenating a pair of said non-terminals and computing a resultant value of said optimization criterion and for adding a new rule for said concatenated pair to said initial grammar if said value of criterion is more optimal than said base value of said optimization criterion; and means for merging said pair of said non-terminals and computing a resultant value of said criterion and for adding a new rule for said merged pair to said initial grammar if said resultant value of optimization criterion is more optimal than said base value of criterion.
Claim 10
Dependent Claim 24 words
A system for creating grammars for a speech recognition application as recited in claim 6 wherein said criterion is description length of the grammar.
Claim 11
Independent Claim 25 words
A system for creating grammars for a speech recognition application as recited in 7 wherein said initial grammar is expressed in Backus-Naur Form (BNF) notation.
Claim 12
Independent Claim 25 words
A system for creating grammars for a speech recognition application as recited in 7 wherein said initial grammar is expressed in Backus-Naur Form (BNF) notation.
Claim 13
Independent Claim 92 words
A method for modifying grammars for a speech recognition application, comprising steps of: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; and generating from said initial grammar rules and said counter-example sentences a revised grammar wherein said counter example sentences are illegal.
Claim 14
Independent Claim 92 words
A method for modifying grammars for a speech recognition application, comprising steps of: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; and generating from said initial grammar rules and said counter-example sentences a revised grammar wherein said counter example sentences are illegal.
Claim 15
Dependent Claim 55 words
A method for modifying grammars for a speech recognition application as recited in claim 9 further comprising steps of: removing said counter-example sentences from said list of possible sentences and outputting a pruned list; and revising said initial grammar with said pruned list and outputting a revised grammar wherein said counter example sentences are illegal.
Claim 16
Independent Claim 208 words
A method for modifying grammars for a speech recognition application comprising the steps: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; generating from said initial grammar rules a revised grammar wherein said counter example sentences are illegal; removing said counter-example sentences from said list of possible sentences and outputting a pruned list; revising said initial grammar with said pruned list and outputting a revised grammar wherein said counter example sentences are illegal; generating a unique non-terminal for each word in said pruned list; computing the base value of an optimization criterion based on properties of the words in said pruned list for said initial grammar; concatenating a pair of said non-terminals and computing a first resultant value of said optimization criterion; merging said pair of non-terminals and computing a second resultant value of said optimization criterion; and adding a new grammar rule to said initial grammar in accordance with an optimal of said first and second resultant value.
Claim 17
Independent Claim 208 words
A method for modifying grammars for a speech recognition application comprising the steps: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; generating from said initial grammar rules a revised grammar wherein said counter example sentences are illegal; removing said counter-example sentences from said list of possible sentences and outputting a pruned list; revising said initial grammar with said pruned list and outputting a revised grammar wherein said counter example sentences are illegal; generating a unique non-terminal for each word in said pruned list; computing the base value of an optimization criterion based on properties of the words in said pruned list for said initial grammar; concatenating a pair of said non-terminals and computing a first resultant value of said optimization criterion; merging said pair of non-terminals and computing a second resultant value of said optimization criterion; and adding a new grammar rule to said initial grammar in accordance with an optimal of said first and second resultant value.
Claim 18
Dependent Claim 25 words
A method for modifying grammars for a speech recognition application as recited in claim 11, wherein said optimization criterion is description length of the grammar.
Claim 19
Dependent Claim 29 words
A method for modifying grammars for a speech recognition application as recited in claim 12 further comprising the step of expressing said initial grammar in Backus-Naur Form (BNF) notation.
Claim 20
Independent Claim 247 words
A method for modifying grammars for a speech recognition application comprising the steps of: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; generating from said initial grammar rules a revised grammar wherein said counter example sentences are illegal; removing said counter-example sentences from said list of possible sentences and outputting a pruned list; revising said initial grammar with said pruned list and outputting a revised grammar wherein said counter example sentences are illegal; generating a unique non-terminal for each word in said pruned list; computing a base value of an optimization criterion based on properties of the words in said pruned list for said initial grammar; concatenating a pair of said non-terminals and computing a resultant value of said criterion and adding a new rule for said concatenated pair to said initial grammar if said resultant value of optimization criterion is more optimal than said base value of optimization criterion; and merging said pair of said non-terminals and computing a resultant value of said optimization criterion and adding a new rule for said merged pair to said initial grammar if said resultant value of said optimization criterion is more optimal than said base value of optimization criterion.
Claim 21
Independent Claim 247 words
A method for modifying grammars for a speech recognition application comprising the steps of: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; generating from said initial grammar rules a revised grammar wherein said counter example sentences are illegal; removing said counter-example sentences from said list of possible sentences and outputting a pruned list; revising said initial grammar with said pruned list and outputting a revised grammar wherein said counter example sentences are illegal; generating a unique non-terminal for each word in said pruned list; computing a base value of an optimization criterion based on properties of the words in said pruned list for said initial grammar; concatenating a pair of said non-terminals and computing a resultant value of said criterion and adding a new rule for said concatenated pair to said initial grammar if said resultant value of optimization criterion is more optimal than said base value of optimization criterion; and merging said pair of said non-terminals and computing a resultant value of said optimization criterion and adding a new rule for said merged pair to said initial grammar if said resultant value of said optimization criterion is more optimal than said base value of optimization criterion.
Claim 22
Dependent Claim 24 words
A method for modifying grammars for a speech recognition application as recited in claim 14, wherein said criterion is description length of the grammar.
Claim 23
Dependent Claim 29 words
A method for modifying grammars for a speech recognition application as recited in claim 14 further comprising the step of expressing said initial grammar in Backus-Naur Form (BNF) notation.
Claim 24
Independent Claim 157 words
A method for modifying grammars for a speech recognition application comprising the steps of: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; generating from said initial grammar rules a revised grammar wherein said counter example sentences are illegal; generating a parse tree comprising a plurality of non-terminals for each of said sentences in said list of counter-example sentences; adding a new non-terminal for each non-terminal in said parse tree which generates each phrase that said non-terminal generates but excludes phrases in said list of counter-example sentences; and modifying a START non-terminal in said parse tree wherein said START non-terminal excludes sentences in said list of counter-example sentences.
Claim 25
Independent Claim 157 words
A method for modifying grammars for a speech recognition application comprising the steps of: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; generating from said initial grammar rules a revised grammar wherein said counter example sentences are illegal; generating a parse tree comprising a plurality of non-terminals for each of said sentences in said list of counter-example sentences; adding a new non-terminal for each non-terminal in said parse tree which generates each phrase that said non-terminal generates but excludes phrases in said list of counter-example sentences; and modifying a START non-terminal in said parse tree wherein said START non-terminal excludes sentences in said list of counter-example sentences.
Claim 26
Independent Claim 201 words
A method for modifying grammars for a speech recognition application comprising the steps of: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; generating from said initial grammar rules a revised grammar wherein said counter example sentences are illegal; generating a parse tree comprising a plurality of non-terminals <N> for each of said sentences in said list of counter-example sentences; for each non-terminal <N > in said parse tree except a <<Start>> symbol: creating a new rule <N'> such that <N'> generates all phrases generated by <N> except any phrases which are in said list of counter-example sentences; creating a new rule <No> such that <No> generates only phrases which are in said list of counter-example sentences and generated by <N>; and modifying a rule containing said <<START>> symbol in said parse tree such that said rule containing said <<START>> symbol ceases to generate said sentences in said list of counter-example sentences.
Claim 27
Independent Claim 201 words
A method for modifying grammars for a speech recognition application comprising the steps of: creating an initial grammar for a speech recognition system and outputting a set of initial grammar rules for said initial grammar; generating a list of possible sentences according to said initial grammar rules; generating a list of counter-example sentences comprising sentences which are legal within said initial grammar rules but which are inapplicable for said speech recognition application; generating from said initial grammar rules a revised grammar wherein said counter example sentences are illegal; generating a parse tree comprising a plurality of non-terminals <N> for each of said sentences in said list of counter-example sentences; for each non-terminal <N > in said parse tree except a <<Start>> symbol: creating a new rule <N'> such that <N'> generates all phrases generated by <N> except any phrases which are in said list of counter-example sentences; creating a new rule <No> such that <No> generates only phrases which are in said list of counter-example sentences and generated by <N>; and modifying a rule containing said <<START>> symbol in said parse tree such that said rule containing said <<START>> symbol ceases to generate said sentences in said list of counter-example sentences.

References Cited (Backward Citations)

US5086472A Cited
US5642519A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2002-08-09 2003-02-08 2003-08-10 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2006-08-09 2007-02-08 2007-08-10 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2010-08-09 2011-02-08 2011-08-10 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag