US5655058A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Segmentation of audio data for indexing of conversational speech for real-time or postprocessing applications
Assignee: Xerox Corp
•
Filing: 1994-04-12
•
Granted: 1997-08-05
•
Expires: 2014-04-12
Abstract
Abstract A method for segmenting audio data, comprising speech from a plurality of individual speakers, according to speaker is provided. The method comprises providing individual HMMs for each individual speaker, each individual HMM including at least one state, and constructing a speaker network HMM by connecting the individual HMMs in parallel. The audio data is then divided into segments by determining a most likely sequence of states through the speaker network HMM, each of the segments being associated with one of the individual HMMs. Afterward, the speaker of each of the segments is identified. The segmented data may be used to form an index into the audio data according to speaker.
Inventors
- 👤 Vijay Balasubramanian
- 👤 Francine R. Chen
- 👤 Philip A. Chou
- 👤 Donald G. Kimber
- 👤 Alex D. Poon
- 👤 Karon A. Weber
- 👤 Lynn D. Wilcox
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 10:56
CPC Classifications
G; G10; G10L; G10L17/00; G10L17/16; G10L15/00; G10L15/04; G10L15/08; G10L15/14; G10L15/142
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
112 words
A method for segmenting audio data according to speaker, said audio data comprising conversational speech from a plurality of individual speakers, comprising the steps of: providing an individual HMM for each individual speaker of the plurality of individual speakers of the audio data, each Hidden Markov Model (HMM) having at least one state; constructing a speaker network HMM by connecting said individual HMMs in parallel; segmenting said audio data into segments by determining a most likely sequence of states through the speaker network HMM, each segment being associated with a one of said individual HMMs; and determining an individual speaker of the plurality of individual speakers of each segment of the path.
Claim 2
Independent Claim
112 words
A method for segmenting audio data according to speaker, said audio data comprising conversational speech from a plurality of individual speakers, comprising the steps of: providing an individual HMM for each individual speaker of the plurality of individual speakers of the audio data, each Hidden Markov Model (HMM) having at least one state; constructing a speaker network HMM by connecting said individual HMMs in parallel; segmenting said audio data into segments by determining a most likely sequence of states through the speaker network HMM, each segment being associated with a one of said individual HMMs; and determining an individual speaker of the plurality of individual speakers of each segment of the path.
Claim 3
Dependent Claim
30 words
The method of claim 1, wherein the step of constructing a speaker network HMM further comprises determining an exit penalty for exiting a particular individual HMM in said speaker network.
Claim 4
Dependent Claim
16 words
The method of claim 1, wherein each of said individual HMMs comprises a plurality of states.
Claim 5
Dependent Claim
16 words
The method of claim 3, wherein each of said individual HMMs further includes a silence state.
Claim 6
Dependent Claim
32 words
The method of claim 1, wherein said step of constructing a speaker network HMM further comprises providing a silence model HMM, and connecting said silence model in parallel with said individual HMMs.
Claim 7
Dependent Claim
20 words
The method of claim 5, wherein said silence model comprises a plurality of states, each with a tied output distribution.
Claim 8
Dependent Claim
20 words
The method of claim 6, wherein said silence model comprises a plurality of states, each with a tied Gaussian distribution.
Claim 9
Dependent Claim
38 words
The method of claim 7, wherein each of said individual HMMs further include a silence state, the output distribution of said individual HMM silence states are tied to output distributions of said silence states in said silence model.
Claim 10
Dependent Claim
31 words
The method of claim 1, wherein said step of constructing a speaker network HMM further comprises providing a garbage model, and connecting said garbage model in parallel with said individual HMMs.
Claim 11
Dependent Claim
29 words
The method of claim 9, wherein said garbage model is provided from portions of said audio data containing speech from at least each of said plurality of individual speakers.
Claim 12
Independent Claim
127 words
A method of indexing audio data according to speaker, said audio data comprising conversational speech from a plurality of individual speakers, comprising the steps of: providing an individual Hidden Markov Model (HMM) for each individual speaker of the plurality of individual speakers of the audio data, each individual HMM including at least one state; constructing a speaker network HMM by connecting said individual HMMs in parallel; segmenting said audio data into segments by finding a most likely sequence of states through the speaker network HMM, each segment being associated with a one of the individual HMMs; determining for each segment an individual speaker of the plurality of individual speakers according to said individual HMMs; collecting segments from each individual; and outputting the results of the collected segments.
Claim 13
Independent Claim
127 words
A method of indexing audio data according to speaker, said audio data comprising conversational speech from a plurality of individual speakers, comprising the steps of: providing an individual Hidden Markov Model (HMM) for each individual speaker of the plurality of individual speakers of the audio data, each individual HMM including at least one state; constructing a speaker network HMM by connecting said individual HMMs in parallel; segmenting said audio data into segments by finding a most likely sequence of states through the speaker network HMM, each segment being associated with a one of the individual HMMs; determining for each segment an individual speaker of the plurality of individual speakers according to said individual HMMs; collecting segments from each individual; and outputting the results of the collected segments.
Claim 14
Dependent Claim
91 words
The method of claim 11, further comprising providing new individual HMMs for each individual speaker using said collected segments from each individual; constructing a second speaker network HMM by connecting said new individual HMMs in parallel; determining for said audio data an optimal path through said second speaker network HMM, identifying segments of said audio data associated with each new individual HMM; determining the individual speaker of each segment of the path according to said new individual HMMs; collecting segments from each individual; and outputting the results of the collected segments.
Claim 15
Dependent Claim
29 words
The method of claim 11, wherein the step of providing individual HMMs for each individual speaker comprises training each of said individual HMMs on speech data from a speaker.
Claim 16
Dependent Claim
16 words
The method of claim 11, wherein each of said individual HMMs comprise a plurality of states.
Claim 17
Dependent Claim
16 words
The method of claim 14, wherein each of said individual HMMs further includes a silence state.
Claim 18
Dependent Claim
32 words
The method of claim 11, wherein the step of constructing said speaker network HMM further comprises providing a silence model HMM, and connecting said silence model in parallel with said individual HMMs.
Claim 19
Dependent Claim
20 words
The method of claim 16, wherein said silence model comprises a plurality of states, each with a tied output distribution.
Claim 20
Dependent Claim
20 words
The method of claim 17, wherein said silence model comprises a plurality of states, each with a tied Gaussian distribution.
Claim 21
Dependent Claim
38 words
The method of claim 18, wherein each of said individual HMMs further include a silence state, the output distribution of said individual HMM silence states are tied to output distributions of said silence states in said silence model.
Claim 22
Dependent Claim
30 words
The method of claim 11, wherein the step of constructing said speaker network HMM further comprises determining a penalty for exiting any particular individual HMM in said speaker network HMM.
References Cited (Backward Citations)
No citation records indexed.
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-08-04 | 2001-02-03 | 2001-08-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-08-04 | 2005-02-03 | 2005-08-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-08-04 | 2009-02-03 | 2009-08-05 | $7700.00 | Window Closed / Lapsed |