US5526465A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Methods and apparatus for verifying the originator of a sequence of operations
Assignee: Ensigma Ltd
•
Filing: 1991-09-30
•
Granted: 1996-06-11
•
Expires: 2011-09-30
Abstract
Abstract Speaker verification is important in such applications as financial transactions which are to be carried out automatically by telephone. False acceptances of a speaker cause serious problems but so do frequent false rejections in view of the annoyance caused. Some of the problems of speaker verification are reduced in the invention by forming Hidden Markov Models (HMMs) for each of a number of words using features of utterances of these words from a large number of speakers. These models are known as world models. In addition, for every person whose speech is to be recognized, one HMM is formed for each of the words as uttered by that person. These models are known as personal models. In verification, a person is prompted to repeat a string of isolated or connected words (15) and features from each of these words are extracted (16). Next, the probabilities that these features could have been generated by the world models for these words and by the personal model of that person are calculated, respectively (17 and 18) and these probabilities are compared (19) for each word. A decision (23) on verification is based on a poll (22) of these comparisons.
Inventors
- 👤 Michael J. Carey
- 👤 Eluned S. Parris
- 👤 John S. Bridle
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 16:04
CPC Classifications
G; G10; G10L; G10L17/00
Claims Analysis
Total Claims: 45
Claim 1
Independent Claim
132 words
A method of verifying that a sequence of operations originates from a specific entity, comprising the steps of extracting a test sequence of sets of features of the results of the operations, one set corresponding to each operation, matching the said test sequence of sets of features against a first stored finite state machine model derived from sets of features of the results of the same sequence of operations when originated by a plurality of entities, matching the said test sequence of features against a second stored finite state machine model derived from sets of features of the results of the same sequence of operations when originated by the specific entity, and comparing the results of the matching steps to indicate whether the test sequence of operations originated from the specific entity.
Claim 2
Independent Claim
132 words
A method of verifying that a sequence of operations originates from a specific entity, comprising the steps of extracting a test sequence of sets of features of the results of the operations, one set corresponding to each operation, matching the said test sequence of sets of features against a first stored finite state machine model derived from sets of features of the results of the same sequence of operations when originated by a plurality of entities, matching the said test sequence of features against a second stored finite state machine model derived from sets of features of the results of the same sequence of operations when originated by the specific entity, and comparing the results of the matching steps to indicate whether the test sequence of operations originated from the specific entity.
Claim 3
Dependent Claim
24 words
A method according to claim 1 wherein the entity is a person and the sequence of operations is the utterance of sequences of sounds.
Claim 4
Dependent Claim
46 words
A method according to claim 2 wherein each feature comprises a multi-element vector in which the elements together provide a representation of the sequence of sounds in an interval, and the set of vectors represents the sequence of sounds over a succession of the said intervals.
Claim 5
Dependent Claim
23 words
A method according to claim 2 wherein the utterance is the utterance of an item chosen from an alpha-numeric character and a word.
Claim 6
Dependent Claim
111 words
A method according to claim 4 wherein matching the said test sequence against a first stored finite state machine model comprises matching against a selected one of a plurality of first stored finite state machines models each derived from respective utterances of an item when uttered by each of a plurality of persons, and matching the said test sequence against a second stored finite state machine model comprises matching against that one of a plurality of second finite state machine models which is derived from the same item as the said selected one model, each second model being derived from utterances of a respective item when uttered by a specific person.
Claim 7
Dependent Claim
63 words
A method according to claim 5 wherein comparing the results of the matching step is by comparing probabilities calculated for each of a plurality of utterances from first and second said models derived from utterances of the same items, and indicating whether the plurality of utterances was from the specific person on the basis of the majority of results of the probability comparisons.
Claim 8
Dependent Claim
40 words
A method of speaker verification including prompting a speaker to utter a series of isolated or connected items chosen from alpha-numeric characters and words, carrying out a method according to claim 5 for each utterance made in response to prompting.
Claim 9
Dependent Claim
128 words
A method according to claim 5 wherein matching the said test sequence includes for each of the first and second finite state machine models calculating for each state in that finite state machine model the maximum probability that a sequence of states, obtainable from that finite state machine model and ending in that state, could generate the test sequence, determining the end of each item in the sequence of sets of features based on the said maximum probability for each state, using the said maximum probability for each state at the end of an item as the probability of that item, and comparing the result of the matching steps includes comparing the maximum probabilities for each item as obtained for the first and second finite state machine models.
Claim 10
Dependent Claim
25 words
A method according to claim 2 wherein the utterance is the utterance of a string of connected spoken items chosen from alphanumeric characters and words.
Claim 11
Dependent Claim
111 words
A method according to claim 9 wherein matching the said test sequence against a first stored finite state machine model comprises matching against a model comprising a stored item model for each item in the utterance, the item models being serially linked and each derived from respective utterances of that item when uttered by each of a plurality of persons, and matching the said test sequence against a second stored finite state machine model comprises matching against a model comprising a stored item model for each item in the utterance, the item models being serially linked and each derived from respective utterances of that item when uttered by a specific person.
Claim 12
Dependent Claim
46 words
A method according to claim 2 wherein each matching step comprises the calculation of a probability, and comparing the results of the matching steps is by subtracting one log probability from another, the sign of the result indicating whether the utterance was from a specific person.
Claim 13
Dependent Claim
25 words
A method according to claim 1 wherein the entity is a person and the sequence of operations is the writing of a word or letter.
Claim 14
Dependent Claim
23 words
A method according to claim 1 wherein extracting the test sequence includes cepstral processing to provide features in the form of cepstral coefficients.
Claim 15
Dependent Claim
18 words
A method according to claim 13 wherein the zero cepstral coefficient is omitted from the sets of features.
Claim 16
Dependent Claim
18 words
A method according to claim 13 wherein the first cepstral coefficient is omitted from the sets of features.
Claim 17
Dependent Claim
84 words
A method according to claim 13, wherein extracting the test sequence includes providing a set of power values for each feature in which each power value represents the power of sound in one of a series of equal intervals over a respective frequency band, providing cepstral processing for the power values by calculating a logarithm value for each power value and carrying out a cosine transform on the logarithm values, and using at least some of the resulting cepstral coefficients as respective said features.
Claim 18
Dependent Claim
59 words
A method according to claim 16 including, for at least one cepstral coefficient, determining first difference related features based on values of the said one coefficient as derived from a number of the said sets of power values which occur in different said intervals, and using the first difference related features as features of the said sets of features.
Claim 19
Dependent Claim
47 words
A method according to claim 17 including deriving a number of second difference related features based on a plurality of first difference related features derived from different values of one cepstral coefficient, and using the second difference related features as features of the said sets of features.
Claim 20
Dependent Claim
33 words
A method according to claim 18, wherein the second difference related feature is derived by calculating the difference between alternate first differences in a series derived from the series of cepstral coefficient values.
Claim 21
Dependent Claim
82 words
A method according to claim 18 wherein each second difference related feature is derived by weighting first difference related features in a series derived from the series of cepstral coefficients using respective multipliers which decrease to a minimum and increase after the minimum, forming the sum of first difference related features weighted with decreasing multipliers, forming the sum of first difference related features weighted with increasing multipliers, and forming the difference between the two sums to give the second difference related features.
Claim 22
Dependent Claim
42 words
A method according to claim 17 wherein the first difference related feature is derived by calculating the difference between alternate values of a cepstral coefficient in a series of values derived from the power values in a series of the said intervals.
Claim 23
Dependent Claim
86 words
A method according to claim 17 wherein each first difference related feature is derived by weighting values of a cepstral coefficient in a series of values derived from the power values in a series of the said intervals using respective multipliers which decrease to a minimum and increase after the minimum, forming the sum of the coefficients weighted with decreasing multipliers, forming the sum of the coefficients weighted with increasing multipliers, and forming the difference between the two sums to give the first difference related feature.
Claim 24
Dependent Claim
15 words
A method according to claim 1 wherein the finite state machines are Hidden Markov Models.
Claim 25
Dependent Claim
28 words
A method according to claim 1, wherein said specific entity is a word or phrase, and said plurality of entities comprise a plurality of different words or phrases.
Claim 26
Dependent Claim
24 words
A method according to claim 1, wherein said specific entity is a language, and said plurality of entities comprise a plurality of different languages.
Claim 27
Dependent Claim
146 words
Apparatus for verifying that a sequence of operations originated from a specific entity, comprising means for storing data specifying first and second finite state machines, the data for the first machine having been derived from sets of features of the results of a sequence of operations originated by a plurality of entities, the data for the second machine having been derived from sets of features of the results of the same sequence of operations originated by a specific entity, means for extracting a test sequence of sets of features from the results of a sequence of operations which are alleged to have been originated by the said specific entity, means for matching the said test sequence against the first and second said machines, respectively, and means for comparing results from the matching means to indicate whether the test sequence was originated by the said specific entity.
Claim 28
Dependent Claim
146 words
Apparatus for verifying that a sequence of operations originated from a specific entity, comprising means for storing data specifying first and second finite state machines, the data for the first machine having been derived from sets of features of the results of a sequence of operations originated by a plurality of entities, the data for the second machine having been derived from sets of features of the results of the same sequence of operations originated by a specific entity, means for extracting a test sequence of sets of features from the results of a sequence of operations which are alleged to have been originated by the said specific entity, means for matching the said test sequence against the first and second said machines, respectively, and means for comparing results from the matching means to indicate whether the test sequence was originated by the said specific entity.
Claim 29
Dependent Claim
23 words
Apparatus according to claim 26 wherein the entity is a person and the sequences of operations are the utterances of sequences of sounds.
Claim 30
Dependent Claim
14 words
Apparatus according to claim 27 wherein the finite state machines are Hidden Markov Models.
Claim 31
Dependent Claim
61 words
Apparatus according to claim 28 wherein the data specifying the Hidden Markov Models comprises a set of pairs of means (m) and variances (σ 2 ) for each state, the pairs of means and variances having been derived from respective distributions of values each representing a spectral component of a sound in the sequences used to derive the Hidden Markov Models.
Claim 32
Dependent Claim
32 words
Apparatus according to claim 29 wherein the means and variances are calculated from cepstral coefficients derived from the said spectral components and first and/or difference related features derived from the cepstral coefficients.
Claim 33
Dependent Claim
20 words
Apparatus according to claim 30 wherein the zero and first cepstral coefficients are omitted when deriving the means and variances.
Claim 34
Dependent Claim
30 words
Apparatus according to claim 29 wherein the means and variances are modified means and modified variances calculated using a gradient algorithm in an alpha-net comprising the two finite state machines.
Claim 35
Dependent Claim
64 words
Apparatus according to claim 32 wherein the modified mean m j (t) and the modified standard deviation σ j (t) are calculated from ##EQU15## where m j (t-1) and σ j (t-1) represent the previous mean and standard deviation, ξ is a constant, and J is a score value derived from the likelihood output of one of the first and second finite state machines.
Claim 36
Dependent Claim
64 words
Apparatus according to claim 32 wherein the modified mean m j (t) and the modified standard deviation σ j (t) are calculated from ##EQU16## where m j (t-1) and σ j (t-1) represent the previous mean and standard deviation, ξ is a constant, and J is a score value derived from the likelihood output of one of the first and second finite state machines.
Claim 37
Dependent Claim
21 words
Apparatus according to claim 26 wherein the entity is a person and the sequences of operations are the signing of signatures.
Claim 38
Independent Claim
85 words
A method of verifying that operations originate from a specific entity, comprising the steps of extracting test results of the operations, matching the said test results against a first model derived from results of the same operations when originated by a plurality of entities, matching the said test results against a second model derived from results of the same operations when originated by the specific entity, and comparing the results of the matching steps to indicate whether the test results originated from the specific entity.
Claim 39
Independent Claim
85 words
A method of verifying that operations originate from a specific entity, comprising the steps of extracting test results of the operations, matching the said test results against a first model derived from results of the same operations when originated by a plurality of entities, matching the said test results against a second model derived from results of the same operations when originated by the specific entity, and comparing the results of the matching steps to indicate whether the test results originated from the specific entity.
Claim 40
Independent Claim
90 words
A method of identifying an utterance, which comprises: extracting a test sequence of sets of features for said utterance; matching said test sequence of sets of features against a first stored finite state machine model derived from sets of features corresponding to a group of utterances; matching said test sequence of sets of features against a second stored finite state machine model derived from sets of features corresponding to said given utterance; and comparing the results of the matching steps to indicate whether said utterance corresponds to said given utterance.
Claim 41
Independent Claim
90 words
A method of identifying an utterance, which comprises: extracting a test sequence of sets of features for said utterance; matching said test sequence of sets of features against a first stored finite state machine model derived from sets of features corresponding to a group of utterances; matching said test sequence of sets of features against a second stored finite state machine model derived from sets of features corresponding to said given utterance; and comparing the results of the matching steps to indicate whether said utterance corresponds to said given utterance.
Claim 42
Dependent Claim
14 words
A method according to claim 37, wherein said utterance comprises a word or phrase.
Claim 43
Dependent Claim
14 words
A method according to claim 37, wherein said utterance comprises a sample of language.
Claim 44
Dependent Claim
101 words
Apparatus for identifying an utterance, comprising means for storing data specifying first and second finite state machines, the data for the first machine having been derived from sets of features corresponding to a group of utterances, and the data for the second machine having been derived from sets of features corresponding to said given utterance; means for extracting a test sequence of sets of features for said utterance; means for matching said test sequence against the first and second finite state machines, respectively; means for comparing results from said matching means to indicate whether said utterance corresponds to said given utterance.
Claim 45
Dependent Claim
101 words
Apparatus for identifying an utterance, comprising means for storing data specifying first and second finite state machines, the data for the first machine having been derived from sets of features corresponding to a group of utterances, and the data for the second machine having been derived from sets of features corresponding to said given utterance; means for extracting a test sequence of sets of features for said utterance; means for matching said test sequence against the first and second finite state machines, respectively; means for comparing results from said matching means to indicate whether said utterance corresponds to said given utterance.
References Cited (Backward Citations)
EP0099476A2
Cited
EP0121248A1
Cited
US4694493A
Cited
US4783804A
Cited
US4910782A
Cited
US5033087A
Cited
US5311601A
Cited
US5293452A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-06-11 | 1999-12-11 | 2000-06-11 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-06-11 | 2003-12-11 | 2004-06-11 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-06-11 | 2007-12-11 | 2008-06-11 | $7700.00 | Window Closed / Lapsed |