US5357596A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Speech dialogue system for facilitating improved human-computer interaction
Assignee: Toshiba Corp
•
Filing: 1992-11-18
•
Granted: 1994-10-18
•
Expires: 2012-11-18
Abstract
Abstract A speech dialogue system capable of realizing natural and smooth dialogue between the system and a human user, and easy maneuverability of the system. In the system, a semantic content of input speech from a user is understood and a semantic content determination of a response output is made according to the understood semantic content of the input speech. Then, a speech response and a visual response according to the determined response output are generated and outputted to the user. The dialogue between the system and the user is managed by controlling transitions between user states during which the input speech is to be entered and system states during which the system response is to be outputted. The understanding of a semantic content of input speech from a user is made by detecting keywords in the input speech, with the keywords to be detected in the input speech limited in advance, according to a state of a dialogue between the user and the system.
Inventors
- 👤 Yoichi Takebayashi
- 👤 Hiroyuki Tsuboi
- 👤 Yoichi Sadamoto
- 👤 Yasuki Yamashita
- 👤 Yoshifumi Nagata
- 👤 Shigenobu Seto
- 👤 Hideaki Shinchi
- 👤 Hideki Hashimoto
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-05 23:37
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/16; G10; G10L; G10L15/00; G10L15/26
Claims Analysis
Total Claims: 49
Claim 1
Independent Claim
96 words
A speech dialogue system, comprising: speech understanding means for understanding a semantic content of an input speech from a user; dialogue management means for making a semantic content determination of a response output according to said semantic content of said input speech understood by said speech understanding means; response generation means for generating a speech response and a visual response according to said semantic content of said response output determined by said dialogue management means; and output means for outputting to said user said speech response and said visual response generated by said response generation means.
Claim 2
Dependent Claim
96 words
A speech dialogue system, comprising: speech understanding means for understanding a semantic content of an input speech from a user; dialogue management means for making a semantic content determination of a response output according to said semantic content of said input speech understood by said speech understanding means; response generation means for generating a speech response and a visual response according to said semantic content of said response output determined by said dialogue management means; and output means for outputting to said user said speech response and said visual response generated by said response generation means.
Claim 3
Dependent Claim
46 words
The speech dialogue system of claim 1, wherein said response generation means generates said visual response which includes an image of a human character delivering said speech response, text data of said speech response, and a content visualizing image of a content of said speech response.
Claim 4
Dependent Claim
37 words
The speech dialogue system of claim 1, wherein said output means outputs said speech response and said visual response by controlling at least one of an output order, an output timing, and a visual response output position.
Claim 5
Dependent Claim
55 words
The speech dialogue system of claim 1, further comprising user state detection means for detecting a physical state of said user, wherein said physical state of said user detected by said user state detection means is taken into a account by said dialogue management means in making said semantic content determination of said response output.
Claim 6
Dependent Claim
40 words
The speech dialogue system of claim 1, wherein said response generation means generates said visual response which includes an image of a human character delivering said speech response, wherein said image incorporates movement and facial expression of said human character.
Claim 7
Dependent Claim
32 words
The speech dialogue system of claim 5, wherein said response generation means generates said speech response incorporating a speech characteristic corresponding to said movement and said facial expression of said human character.
Claim 8
Dependent Claim
26 words
The speech dialogue system of claim 6, wherein said speech characteristic of said speech response includes at least one of an emotional expression and an intonation.
Claim 9
Dependent Claim
51 words
The speech dialogue system of claim 1, wherein said speech understanding means supplies a plurality of candidates for said semantic content of said input speech, and said dialogue management means makes said semantic content determination of said response output by evaluating said plurality of candidates in accordance with a dialogue history.
Claim 10
Dependent Claim
34 words
The speech dialogue system of claim 1, wherein said output means also outputs a visual indication for informing said user as to whether said speech dialogue system is ready to receive said input speech.
Claim 11
Dependent Claim
43 words
The speech dialogue system of claim 1, wherein said response generation means generates said visual response including a content visualizing image formed by pictures of objects mentioned in said speech response and a numerical figure indicating a quantity of each of said objects.
Claim 12
Dependent Claim
51 words
The speech dialogue system of claim 1, wherein said response generation means generates said speech response for making a confirmation of said semantic content of said input speech, while generating said visual response on the basis of a past history of a dialogue between said user and said speech dialogue system.
Claim 13
Dependent Claim
80 words
The speech dialogue system of claim 1, wherein said response generation means generates said visual response which include text data of said speech response and graphic images other than said text data, and said response generation means generates said speech response and said text data for making a confirmation of said semantic content of said input speech while generating said graphic images on the basis of a past history of a dialogue between said user and said speech dialogue system.
Claim 14
Dependent Claim
55 words
The speech dialogue system of claim 1, wherein said response generation means generates said speech response for making a confirmation of said semantic content of said input speech, said speech response being changed from a full speech response to a simplified Speech response according to a length of said speech response for making said confirmation.
Claim 15
Dependent Claim
29 words
The speech dialogue system of claim 13, wherein said length of said speech response for making said confirmation is determined from information items to be confirmed by said confirmation.
Claim 16
Dependent Claim
36 words
The speech dialogue system of claim 14, wherein said full speech response mentions all of said information items to be confirmed while said simplified speech response does not directly mention said information items to be confirmed.
Claim 17
Dependent Claim
22 words
The speech dialogue system of claim 15, wherein said simplified speech response contains a demonstrative pronoun to refer to said visual response.
Claim 18
Dependent Claim
29 words
The speech dialogue system of claim 13, wherein said full speech response recites said response output explicitly while said simplified speech response does not recite said response output explicitly.
Claim 19
Dependent Claim
22 words
The speech dialogue system of claim 17, wherein said simplified speech response contains a demonstrative pronoun to refer to said visual response.
Claim 20
Dependent Claim
36 words
The speech dialogue system of claim 13, wherein said output means outputs said visual response at an earlier timing that a timing for outputting said visual response when said speech response is said full speech response.
Claim 21
Dependent Claim
21 words
The speech dialogue system of claim 13, wherein said output means outputs said visual response before said speech response is outputted.
Claim 22
Independent Claim
72 words
A method of speech dialogue between a human user and a speech dialogue system, comprising the steps of: understanding a semantic content of an input speech from a user; making a semantic content determination of a response output according to said semantic content of said input speech; generating a speech response and a visual response according to said response output; and outputting to said user said speech response and said visual response.
Claim 23
Independent Claim
72 words
A method of speech dialogue between a human user and a speech dialogue system, comprising the steps of: understanding a semantic content of an input speech from a user; making a semantic content determination of a response output according to said semantic content of said input speech; generating a speech response and a visual response according to said response output; and outputting to said user said speech response and said visual response.
Claim 24
Dependent Claim
43 words
The method of claim 21, wherein said generating step generates said visual response which includes an image of a human character delivering said speech response, text data of said speech response, and a content visualizing image of a content of said speech response.
Claim 25
Dependent Claim
35 words
The method of claim 21, wherein said outputting step outputs said speech response and said visual response by controlling at least one of an output order, an output timing, and a visual response output position.
Claim 26
Dependent Claim
46 words
The method of claim 21, further comprising the step of detecting a physical state of said user, and wherein said making step makes said semantic content determination of said response output by taking said physical state of said user detected at said detecting step into account.
Claim 27
Dependent Claim
37 words
The method of claim 21, wherein said generating step generates said visual response which includes an image of a human character delivering said speech response, where said image incorporates movement and facial expression of said human character.
Claim 28
Dependent Claim
29 words
The method of claim 25, wherein said generating step generates said speech response incorporating a speech characteristic corresponding to said movement and said facial expression of said human character.
Claim 29
Dependent Claim
24 words
The method of claim 26, wherein said speech characteristic of said speech response includes at least one of an emotional expression and an intonation.
Claim 30
Dependent Claim
46 words
The method of claim 21, wherein said understanding step obtains a plurality of candidates for said semantic content of Said input speech, and said making step makes said semantic content determination of said response output by evaluating said plurality of candidates according to a dialogue history.
Claim 31
Dependent Claim
32 words
The method of claim 21, wherein said outputting step also outputs a visual indication for informing said user as to whether said speech dialogue system is ready to receive said input speech.
Claim 32
Dependent Claim
41 words
The method of claim 21, wherein said generating step generates said visual response which includes a content visualizing image formed by pictures of objects mentioned in said speech response and a numerical figure indicating a quantity of each of said objects.
Claim 33
Dependent Claim
48 words
The method of claim 21, wherein at said generating step, said speech response for making a confirmation of said semantic content of said input speech is generated, while said visual response reflecting a past history of a dialogue between said user and said speech dialogue system is generated.
Claim 34
Dependent Claim
73 words
The method of claim 21, wherein at said generating step, said visual response which includes text data of said speech response and graphic images other than said text data is generated, and said speech response and said text data for making a confirmation of said semantic content of said input speech is generated while graphic images reflecting a past history of a dialogue between said user and said speech dialogue system are generated.
Claim 35
Dependent Claim
54 words
The method of claim 21, wherein at said generating step, said speech response for making a confirmation of said semantic content of said input speech is generated, said speech response being changed from a full speech response to a simplified speech response according to a length of said speech response for making said confirmation.
Claim 36
Dependent Claim
27 words
The method of claim 33, wherein said length of said speech response for making said confirmation is determined from information items to be confirmed by said confirmation.
Claim 37
Dependent Claim
34 words
The method of claim 34, wherein said full speech response mentions all of said information items to be confirmed while said simplified speech response does not directly mention said information items to be confirmed.
Claim 38
Dependent Claim
20 words
The method of claim 35, wherein said simplified speech response contains a demonstrative pronoun to refer to said visual response.
Claim 39
Dependent Claim
27 words
The method of claim 33, wherein said full speech response recites said response output explicitly while said simplified speech response does not recite said response output explicitly.
Claim 40
Dependent Claim
20 words
The method of claim 37, wherein said simplified speech response contains a demonstrative pronoun to refer to said visual response.
Claim 41
Dependent Claim
36 words
The method of claim 33, wherein at said outputting step, said visual response is outputted at an earlier timing than a timing for outputting said visual response when said speech response is said full speech response.
Claim 42
Dependent Claim
21 words
The method of claim 33, wherein at said outputting step, said visual response is outputted before said speech response is outputted.
Claim 43
Dependent Claim
96 words
A speech dialogue system, comprising: speech understanding means for understanding a semantic content of an input speech from a user; response output means for outputting a system response according to said semantic content of said input speech understood by said speech understanding means; and dialogue management means for managing a dialogue between said user and said speech dialogue system by controlling transitions between user states during which said input speech is to be entered into said speech understanding means and system states during which said system response is to be outputted from said response output means.
Claim 44
Dependent Claim
96 words
A speech dialogue system, comprising: speech understanding means for understanding a semantic content of an input speech from a user; response output means for outputting a system response according to said semantic content of said input speech understood by said speech understanding means; and dialogue management means for managing a dialogue between said user and said speech dialogue system by controlling transitions between user states during which said input speech is to be entered into said speech understanding means and system states during which said system response is to be outputted from said response output means.
Claim 45
Dependent Claim
38 words
The speech dialogue system of claim 41, wherein said dialogue management means controls said transitions between said user states and said system states according to said semantic content of said input speech understood by said speech understanding means.
Claim 46
Dependent Claim
82 words
A speech dialogue system, comprising: speech understanding means for understanding a semantic content of an input speech from a user by detecting keywords of said input speech; dialogue management means for limiting said keywords to be detected in said input speech in advance, according to a state of a dialogue between said user and said speech dialogue system; and response output means for outputting a system response according to said semantic content of said input speech understood by said speech understanding means.
Claim 47
Dependent Claim
82 words
A speech dialogue system, comprising: speech understanding means for understanding a semantic content of an input speech from a user by detecting keywords of said input speech; dialogue management means for limiting said keywords to be detected in said input speech in advance, according to a state of a dialogue between said user and said speech dialogue system; and response output means for outputting a system response according to said semantic content of said input speech understood by said speech understanding means.
Claim 48
Dependent Claim
96 words
The speech dialog system of claim 43, wherein said dialogue management means makes a semantic content determination of said system response to be outputted by said response output means in accordance with said semantic content of said input speech and understood by said speech understanding means, and limits said keywords to be detected in said input speech by said speech understanding means in advance by using said semantic content determination of said system response for previous input speech which is indicative of a current state of said dialogue between said user and said speech dialogue system.
Claim 49
Dependent Claim
43 words
The speech dialogue system of claim 43, wherein said dialogue management means also limits syntactic and semantic rules to be used by said speech understanding means in advance, according to a state of a dialogue between said user and said speech dialogue system.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1997-10-17 | 1998-04-18 | 1998-10-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2001-10-17 | 2002-04-18 | 2002-10-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2005-10-17 | 2006-04-18 | 2006-10-18 | $7700.00 | Window Closed / Lapsed |