← Back to Patent Explorer
US5255342A Expired / Lapsed US ⏱️ 0.0 years remaining

Pattern recognition system and method using neural network

Assignee: Toshiba Corp
•
Filing: 1992-12-17
•
Granted: 1993-10-19
•
Expires: 2012-12-17
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract An inner product computing unit computes inner products of an input pattern whose category is unknown, and orthogonalized dictionary sets of a plurality of reference patterns whose categories are known. A nonlinear converting unit nonlinearly converts the inner products in accordance with a positive-negative symmetrical nonlinear function. A neural network unit or a statistical discriminant function computing unit performs predetermined computations of the nonlinearly converted values on the basis of preset coefficients in units of categories using a neural network or a statistical discriminant function. A determining section compares values calculated in units of categories using the preset coefficients with each other to discriminate a category to which the input pattern belongs.

Inventors

  • 👤 Tsuneo Nitta

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-02 03:26
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/16; G06; G06N; G06N3/00; G06N3/02; G06N3/04; G06N3/045; G06N3/0499; G06N3/08; G06N3/09; G06V; G06V10/00; G06V10/70; G06V10/74; G06V10/75

Claims Analysis

Total Claims: 7
Claim 1
Independent Claim 269 words
A speech pattern recognition system comprising: speech input means for inputting a speech pattern to be recognized; feature extracting means for extracting feature vectors from the input speech pattern; dictionary mean for storing a plurality of orthogonalized reference patterns, which are equal to eigenvectors calculated using Karhunen-Loeve (KL) expansion, and whose categories are known; inner product computing means, provided for each category, for computing inner products of the input speech pattern, using said feature vectors, whose category is unknown and the orthogonalized reference patterns of a category which are stored in said dictionary means and whose category is known; converting means, provided for each category, for nonlinearly converting the inner product of a category, which is computed by said inner product computing means, in accordance with a positive-negative symmetrical nonlinear function; evaluation value computing means, provided for each category and each evaluation value computing means including a multi-layer neural network whose elements each include multiplier means for multiplying an input signal from a lower adjacent layer by a preset weight coefficient and being connected to all elements constituting an upper adjacent layer, for computing an evaluation value of a category using the nonlinearly converted values calculated by said converting means and weight coefficients which are preset in said neural network of a category based on a discriminatively trained Back Propagation (BP) algorithm; comparing means for comparing the evaluation values obtained by said evaluation value computing means using said neural networks with other evaluation values; and discriminating means for outputting a category to which the input speech pattern belongs as a recognition result using comparison results of said comparing means.
Claim 2
Dependent Claim 269 words
A speech pattern recognition system comprising: speech input means for inputting a speech pattern to be recognized; feature extracting means for extracting feature vectors from the input speech pattern; dictionary mean for storing a plurality of orthogonalized reference patterns, which are equal to eigenvectors calculated using Karhunen-Loeve (KL) expansion, and whose categories are known; inner product computing means, provided for each category, for computing inner products of the input speech pattern, using said feature vectors, whose category is unknown and the orthogonalized reference patterns of a category which are stored in said dictionary means and whose category is known; converting means, provided for each category, for nonlinearly converting the inner product of a category, which is computed by said inner product computing means, in accordance with a positive-negative symmetrical nonlinear function; evaluation value computing means, provided for each category and each evaluation value computing means including a multi-layer neural network whose elements each include multiplier means for multiplying an input signal from a lower adjacent layer by a preset weight coefficient and being connected to all elements constituting an upper adjacent layer, for computing an evaluation value of a category using the nonlinearly converted values calculated by said converting means and weight coefficients which are preset in said neural network of a category based on a discriminatively trained Back Propagation (BP) algorithm; comparing means for comparing the evaluation values obtained by said evaluation value computing means using said neural networks with other evaluation values; and discriminating means for outputting a category to which the input speech pattern belongs as a recognition result using comparison results of said comparing means.
Claim 3
Dependent Claim 202 words
A computer-implemented speech pattern recognition method comprising the steps of: inputting a speech pattern to be recognized; extracting feature vectors from the input speech; computing inner products of the input pattern, using said feature vectors, whose category is unknown and orthogonalized reference patterns of a category which are equal to eigenvectors calculated using Karhunen-Loeve (KL) expansion, and whose category is known; nonlinearly converting the inner product of a category, which is computed in the computing step, in accordance with a positive-negative symmetrical nonlinear function; computing an evaluation value from the nonlinearly converted values converted by the converting step and weight coefficients using a multiple neural network whose elements each include multiplier means for multiplying an input signal from a lower adjacent layer by a preset weight coefficients and connected to all elements constituting an upper adjacent layer in which said weight coefficients are preset for each category based on a discriminatively trained Back Propagation (BP) algorithm; comparing in the evaluation values obtained from said neural networks in the evaluation value computing step of said categories with other evaluation values; and discriminating and outputting a category to which the input pattern belongs as a recognition result from comparison results of the comparing step.
Claim 4
Dependent Claim 202 words
A computer-implemented speech pattern recognition method comprising the steps of: inputting a speech pattern to be recognized; extracting feature vectors from the input speech; computing inner products of the input pattern, using said feature vectors, whose category is unknown and orthogonalized reference patterns of a category which are equal to eigenvectors calculated using Karhunen-Loeve (KL) expansion, and whose category is known; nonlinearly converting the inner product of a category, which is computed in the computing step, in accordance with a positive-negative symmetrical nonlinear function; computing an evaluation value from the nonlinearly converted values converted by the converting step and weight coefficients using a multiple neural network whose elements each include multiplier means for multiplying an input signal from a lower adjacent layer by a preset weight coefficients and connected to all elements constituting an upper adjacent layer in which said weight coefficients are preset for each category based on a discriminatively trained Back Propagation (BP) algorithm; comparing in the evaluation values obtained from said neural networks in the evaluation value computing step of said categories with other evaluation values; and discriminating and outputting a category to which the input pattern belongs as a recognition result from comparison results of the comparing step.
Claim 5
Dependent Claim 164 words
A speech pattern recognition system, comprising: speech input means for inputting a speech to be recognized; feature extracting means for extracting feature vectors from the input speech; multi-layer neural networks whose elements each include multiplier means for multiplying an input signal from a lower adjacent layer by a preset weight coefficient and connected to all elements constituting an upper adjacent layer and, respectively provided for categories of speech, for receiving the feature vectors as input, and for outputting evaluation values for each category, each of said neural networks having, as weight coefficients of a hidden layer, the weight coefficients being computed based on a discriminatively trained Back Propagation (BP) algorithm, eigenvectors calculated in advance by Karhunen-Loeve (KL) expansion from known feature vectors belonging to one of said categories, a nonlinear function of an output of the hidden layer being a positive-negative symmetrical nonlinear function; and determining means for determining a category as a recognition result from evaluation values output from the multi-layer neural networks.
Claim 6
Dependent Claim 164 words
A speech pattern recognition system, comprising: speech input means for inputting a speech to be recognized; feature extracting means for extracting feature vectors from the input speech; multi-layer neural networks whose elements each include multiplier means for multiplying an input signal from a lower adjacent layer by a preset weight coefficient and connected to all elements constituting an upper adjacent layer and, respectively provided for categories of speech, for receiving the feature vectors as input, and for outputting evaluation values for each category, each of said neural networks having, as weight coefficients of a hidden layer, the weight coefficients being computed based on a discriminatively trained Back Propagation (BP) algorithm, eigenvectors calculated in advance by Karhunen-Loeve (KL) expansion from known feature vectors belonging to one of said categories, a nonlinear function of an output of the hidden layer being a positive-negative symmetrical nonlinear function; and determining means for determining a category as a recognition result from evaluation values output from the multi-layer neural networks.
Claim 7
Dependent Claim 100 words
A speech pattern recognition system as recited in claim 1, wherein said multi-layer neural network comprises: second inner product computing means for computing second inner products using said nonlinearly converted inner products of a category from said converting means and said preset weight coefficients; second converting means for nonlinearly converting said second inner products computed by said second inner product computing means; means for obtaining a sum of the nonlinearly converted second inner products from said second converting means; and third converting means for nonlinearly converting the sum of the nonlinearly converted second inner products, thereby producing said evaluation value.

References Cited (Backward Citations)

US4394538A Cited
US4624011A Cited
US4736429A Cited
US4783802A Cited
US4888823A Cited
US4903306A Cited
US4805225A Cited
US4942608A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1996-10-18 1997-04-19 1997-10-19 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2000-10-18 2001-04-19 2001-10-19 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2004-10-18 2005-04-19 2005-10-19 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag