Patent US6185535B1 successfully refreshed from Google Patents.
US6185535B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Voice control of a user interface to service applications
Assignee: Telefonaktiebolaget LM Ericsson AB
•
Filing: 1998-10-16
•
Granted: 2001-02-06
•
Expires: 2018-10-16
Abstract
Abstract Voice control of a service application provided to a terminal from a remote server is distributed between the terminal and a remote application part. A relatively low power automatic speech recognition system (ASR) is provided in the terminal for recognizing those portions of user-supplied audio input that relate to terminal functions or functions defined by a predefined markup language. Recognized words may be used to control the terminal functions, or may alternatively be converted to text and forwarded to the remote server. Unrecognized portions of the audio input may be encoded and forwarded to the remote application part which includes a more powerful ASR. The remote application part may use its ASR to recognize words defined by the application. Recognized words may be converted to text and supplied as input to the remote server. In the reverse direction, text received by the remote application part from the remote server may be converted to an encoded audio output signal, and forwarded to the terminal, which can then generate a signal to be supplied to a loudspeaker. In this way, a voice control mechanism is used in place of the remote server's visual display output and keyboard input.
Inventors
- 👤 Jan Hedin
- 👤 Bernhard Meier
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-31 08:21
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/28; G10L15/30
Claims Analysis
Total Claims: 36
Claim 1
Independent Claim
221 words
A method of controlling a service application provided to a terminal from a remote server, the method comprising the steps of: receiving an audio input signal representing audio information; using a first automatic speech recognition system located in the terminal to determine whether the audio input signal includes one or more words defined by a first vocabulary, wherein portions of the audio input signal not corresponding to the one or more words defined by the first vocabulary constitute an unrecognized portion of the audio input signal; if the audio input signal includes one or more words defined by the first vocabulary, then using a terminal application part of an application protocol service logic to determine what to do with the one or more words defined by the first vocabulary; formatting the unrecognized portion of the audio input signal for inclusion in a data unit whose structure is defined by a first predefined markup language; communicating the data unit to a remote application part via a first digital data link that operates in accordance with a first application protocol; and in the remote application part, extracting the formatted unrecognized portion of the audio input signal from the data unit and using a remote application part service logic to determine what to do with the formatted unrecognized portion of the audio input signal.
Claim 2
Independent Claim
221 words
A method of controlling a service application provided to a terminal from a remote server, the method comprising the steps of: receiving an audio input signal representing audio information; using a first automatic speech recognition system located in the terminal to determine whether the audio input signal includes one or more words defined by a first vocabulary, wherein portions of the audio input signal not corresponding to the one or more words defined by the first vocabulary constitute an unrecognized portion of the audio input signal; if the audio input signal includes one or more words defined by the first vocabulary, then using a terminal application part of an application protocol service logic to determine what to do with the one or more words defined by the first vocabulary; formatting the unrecognized portion of the audio input signal for inclusion in a data unit whose structure is defined by a first predefined markup language; communicating the data unit to a remote application part via a first digital data link that operates in accordance with a first application protocol; and in the remote application part, extracting the formatted unrecognized portion of the audio input signal from the data unit and using a remote application part service logic to determine what to do with the formatted unrecognized portion of the audio input signal.
Claim 3
Dependent Claim
20 words
The method of claim 1 , wherein the audio input signal is in the form of compressed digitally encoded speech.
Claim 4
Dependent Claim
52 words
The method of claim 1 , wherein if the audio input signal includes one or more words defined by the first vocabulary, then the terminal application part of the application protocol service logic causes the one or more words to be used to select one or more terminal functions to be performed.
Claim 5
Dependent Claim
29 words
The method of claim 3 , wherein the one or more terminal functions include selecting a current menu item as a response to be supplied to the remote server.
Claim 6
Dependent Claim
43 words
The method of claim 3 , wherein: a current menu item is associated with a first selection; and the one or more terminal functions include associating the current menu item with a second selection that is not the same as the first selection.
Claim 7
Dependent Claim
53 words
The method of claim 1 , wherein if the audio input signal includes one or more words defined by the first vocabulary, then the terminal application part of the application protocol service logic causes a corresponding message to be generated and communicated to the remote application part via the first digital data link.
Claim 8
Dependent Claim
13 words
The method of claim 6 , wherein the corresponding message includes state information.
Claim 9
Dependent Claim
12 words
The method of claim 6 , wherein the corresponding message includes text.
Claim 10
Dependent Claim
13 words
The method of claim 6 , wherein the corresponding message includes binary data.
Claim 11
Dependent Claim
19 words
The method of claim 6 , wherein the remote application part forwards the corresponding message to the remote server.
Claim 12
Dependent Claim
34 words
The method of claim 10 , wherein the remote application part forwards the corresponding message to the remote server via a second digital data link that operates in accordance with a second application protocol.
Claim 13
Dependent Claim
19 words
The method of claim 11 , wherein the first application protocol is the same as the second application protocol.
Claim 14
Dependent Claim
89 words
The method of claim 1 , further comprising the steps of: using a second automatic speech recognition system located in the remote application part to determine whether the unrecognized portion of the audio input signal includes one or more words defined by a second vocabulary; and if the unrecognized portion of the audio input signal includes one or more words defined by the second vocabulary, then using the remote application part service logic to determine what to do with the one or more words defined by the second vocabulary.
Claim 15
Dependent Claim
35 words
The method of claim 13 , wherein: the first vocabulary exclusively includes words defined by a syntax of the first predefined markup language; and the second vocabulary exclusively includes words associated with the remote server.
Claim 16
Dependent Claim
48 words
The method of claim 13 , wherein if the unrecognized portion of the audio input signal includes one or more words defined by the second vocabulary, then the remote application part service logic causes a corresponding keyboard emulation response to be generated and sent to the remote server.
Claim 17
Dependent Claim
44 words
The method of claim 13 , wherein if the unrecognized portion of the audio input signal includes one or more words defined by the second vocabulary, then the remote application part service logic causes a remote application part service logic state to be changed.
Claim 18
Dependent Claim
92 words
The method of claim 1 , further comprising the steps of: in the remote application part, receiving text from the remote server; in the remote application part, generating a corresponding audio output signal representing audio information; formatting the audio output signal for inclusion in a second data unit whose structure is defined by the first predefined markup language; communicating the second data unit to the terminal via the first digital data link; and in the terminal, extracting the audio output signal from the second data unit and generating therefrom a loudspeaker signal.
Claim 19
Independent Claim
222 words
An apparatus for controlling a service application provided to a terminal from a remote server, the apparatus comprising: means for receiving an audio input signal representing audio information; a first automatic speech recognition system located in the terminal for determining whether the audio input signal includes one or more words defined by a first vocabulary, wherein portions of the audio input signal not corresponding to the one or more words defined by the first vocabulary constitute an unrecognized portion of the audio input signal; a terminal application part of an application protocol service logic for determining what to do with the one or more words defined by the first vocabulary if the audio input signal includes one or more words defined by the first vocabulary; means for formatting the unrecognized portion of the audio input signal for inclusion in a data unit whose structure is defined by a first predefined markup language; means for communicating the data unit to a remote application part via a first digital data link that operates in accordance with a first application protocol; and the remote application part, comprising: means for extracting the formatted unrecognized portion of the audio input signal from the data unit; and a remote application part service logic for determining what to do with the formatted unrecognized portion of the audio input signal.
Claim 20
Independent Claim
222 words
An apparatus for controlling a service application provided to a terminal from a remote server, the apparatus comprising: means for receiving an audio input signal representing audio information; a first automatic speech recognition system located in the terminal for determining whether the audio input signal includes one or more words defined by a first vocabulary, wherein portions of the audio input signal not corresponding to the one or more words defined by the first vocabulary constitute an unrecognized portion of the audio input signal; a terminal application part of an application protocol service logic for determining what to do with the one or more words defined by the first vocabulary if the audio input signal includes one or more words defined by the first vocabulary; means for formatting the unrecognized portion of the audio input signal for inclusion in a data unit whose structure is defined by a first predefined markup language; means for communicating the data unit to a remote application part via a first digital data link that operates in accordance with a first application protocol; and the remote application part, comprising: means for extracting the formatted unrecognized portion of the audio input signal from the data unit; and a remote application part service logic for determining what to do with the formatted unrecognized portion of the audio input signal.
Claim 21
Dependent Claim
20 words
The apparatus of claim 18 , wherein the audio input signal is in the form of compressed digitally encoded speech.
Claim 22
Dependent Claim
54 words
The apparatus of claim 18 , wherein the terminal application part of the application protocol service logic comprises: means for causing the one or more words to be used to select one or more terminal functions to be performed if the audio input signal includes one or more words defined by the first vocabulary.
Claim 23
Dependent Claim
29 words
The apparatus of claim 20 , wherein the one or more terminal functions include selecting a current menu item as a response to be supplied to the remote server.
Claim 24
Dependent Claim
43 words
The apparatus of claim 20 , wherein: a current menu item is associated with a first selection; and the one or more terminal functions include associating the current menu item with a second selection that is not the same as the first selection.
Claim 25
Dependent Claim
55 words
The apparatus of claim 18 , wherein the terminal application part of the application protocol service logic comprises: means for causing a corresponding message to be generated and communicated to the remote application part via the first digital data link if the audio input signal includes one or more words defined by the first vocabulary.
Claim 26
Dependent Claim
13 words
The apparatus of claim 23 , wherein the corresponding message includes state information.
Claim 27
Dependent Claim
12 words
The apparatus of claim 23 , wherein the corresponding message includes text.
Claim 28
Dependent Claim
13 words
The apparatus of claim 23 , wherein the corresponding message includes binary data.
Claim 29
Dependent Claim
22 words
The apparatus of claim 23 , wherein the remote application part includes means for forwarding the corresponding message to the remote server.
Claim 30
Dependent Claim
37 words
The apparatus of claim 27 , wherein the remote application part includes means for forwarding the corresponding message to the remote server via a second digital data link that operates in accordance with a second application protocol.
Claim 31
Dependent Claim
19 words
The apparatus of claim 28 , wherein the first application protocol is the same as the second application protocol.
Claim 32
Dependent Claim
86 words
The apparatus of claim 18 , further comprising: a second automatic speech recognition system located in the remote application part for determining whether the unrecognized portion of the audio input signal includes one or more words defined by a second vocabulary, and wherein the remote application part service logic includes means for determining what to do with the one or more words defined by the second vocabulary if the unrecognized portion of the audio input signal includes one or more words defined by the second vocabulary.
Claim 33
Dependent Claim
35 words
The apparatus of claim 30 , wherein: the first vocabulary exclusively includes words defined by a syntax of the first predefined markup language; and the second vocabulary exclusively includes words associated with the remote server.
Claim 34
Dependent Claim
50 words
The apparatus of claim 30 , wherein the remote application part service logic comprises: means for causing a corresponding keyboard emulation response to be generated and sent to the remote server if the unrecognized portion of the audio input signal includes one or more words defined by the second vocabulary.
Claim 35
Dependent Claim
46 words
The apparatus of claim 30 , wherein the remote application part service logic comprises: means for causing a remote application part service logic state to be changed if the unrecognized portion of the audio input signal includes one or more words defined by the second vocabulary.
Claim 36
Dependent Claim
99 words
The apparatus of claim 18 , further comprising: means, in the remote application part, for receiving text from the remote server; means, in the remote application part, for generating a corresponding audio output signal representing audio information; means for formatting the audio output signal for inclusion in a second data unit whose structure is defined by the first predefined markup language; means for communicating the second data unit to the terminal via the first digital data link; and means, in the terminal, for extracting the audio output signal from the second data unit and generating therefrom a loudspeaker signal.
References Cited (Backward Citations)
US5797116A
Cited
WO1995017746A1
Cited
US5956683A
Cited
US6029135A
Cited
US5890123A
Cited
US5983184A
Cited
US5799063A
Cited
US5915001A
Cited
US5926789A
Cited
US5960399A
Cited
WO1998034217A1
Cited
US6094476A
Cited
GB2323693A
Cited
US5884266A
Cited
US6078886A
Cited
US5924070A
Cited
US5991723A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-02-06 | 2004-08-07 | 2005-02-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-02-06 | 2008-08-07 | 2009-02-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-02-06 | 2012-08-07 | 2013-02-06 | $7700.00 | Window Closed / Lapsed |