US5208745A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Multimedia interface and method for computer system
Assignee: Electric Power Research Institute
•
Filing: 1990-06-04
•
Granted: 1993-05-04
•
Expires: 2010-06-04
Abstract
Abstract A multimedia interface presents information and receives user commands and data for a computer system. The multimedia interface operates in parallel with another application software module, such as an expert system. To add multimedia features to the application software module, the module is modified so as to generate multimedia commands at the same time as it displays text on a text monitor. The multimedia commands, which are held in a queue, provide additional information in the form of video images and generated speech corresponding to the displayed text. In addition, the multimedia commands are split into at least two sets: one set which is dispatched to the user substantially immediately after displaying the corresponding text, and one set which is dispatched upon request by the user. In the preferred embodiment, the multimedia interface presents information to the user through text, graphics, video, sound, speech production, and printed output. User inputs are made through a keyboard and voice recognition. In one preferred embodiment two data processing units are used: one for an expert system module and one for a video output processing module. Each module includes its own flat VGA display. The video module includes a digital video controller which enables it to display drawings, photographs, still and animated graphics, video stills, full-motion video and motion video with graphic overlays. An optional satellite station facilitates use of the system in environments where it is inconvenient or impossible to bring the complete system.
Inventors
- 👤 George H. Quentin
- 👤 Brian A. Isle
- 👤 Charles P. Bloom
- 👤 Arch W. Butler
- 👤 David Spoor
- 👤 David J. Wunderlin
- 👤 Renee Bedros
- 👤 Francis M. Campos
- 👤 Stephen R. Sweet
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 10:10
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/40; G06F16/48; H; H04; H04N; H04N5/00; H04N5/76; H04N5/765; G06F1/00; G06F1/16; G06F1/1613; G06F1/1628; G06F3/00; G06F3/01; G06F3/048; G06F3/0487; G06F3/0489; G06F3/16; G06Q; G06Q10/00; G06Q10/10; Y; Y10; Y10S; Y10S706/00; Y10S706/902; Y10S706/911; Y10S715/00; Y10S715/978
Claims Analysis
Total Claims: 18
Claim 1
Independent Claim
175 words
In a computer system, the combination comprising: a first data processing unit coupled to a first display apparatus; first memory means, coupled to said first data processing unit, for storing application software, wherein said application software displays messages on said first display apparatus and also transmits video display instructions; a second data processing unit coupled to a second display apparatus, and coupled to said first data processing unit so as to receive said transmitted video display instructions; random access video memory means, coupled to said second data processing unit, for storing a multiplicity of digitized video images; and a digital video controller, coupled to said second data processing unit and to said video memory means, that displays on said second display apparatus selected ones and selected sequences of said digitized video images stored in said video memory means in accordance with said video display instructions transmitted by said application software; said application software including means for coordinating said video images displayed on said second display apparatus with said messages displayed on said first display apparatus.
Claim 2
Dependent Claim
175 words
In a computer system, the combination comprising: a first data processing unit coupled to a first display apparatus; first memory means, coupled to said first data processing unit, for storing application software, wherein said application software displays messages on said first display apparatus and also transmits video display instructions; a second data processing unit coupled to a second display apparatus, and coupled to said first data processing unit so as to receive said transmitted video display instructions; random access video memory means, coupled to said second data processing unit, for storing a multiplicity of digitized video images; and a digital video controller, coupled to said second data processing unit and to said video memory means, that displays on said second display apparatus selected ones and selected sequences of said digitized video images stored in said video memory means in accordance with said video display instructions transmitted by said application software; said application software including means for coordinating said video images displayed on said second display apparatus with said messages displayed on said first display apparatus.
Claim 3
Dependent Claim
330 words
In a computer system, the combination comprising: a first data processing unit coupled to a first display; first memory means, coupled to said first data processing unit, for storing application software, wherein said application software displays messages on said first display apparatus and also transmits video display instructions; wherein said application software includes means for defining a predefined set of pieces of equipment and a predefined set of maintenance tasks in conjunction with corresponding ones of said pieces of equipment; a second data processing unit coupled to a second display, and coupled to said first data processing unit so as to receive said transmitted video display instructions; random access video memory means, coupled to said second data processing unit, for storing a multiplicity of digitized video images, a multiplicity of said digitized video images stored in said video memory means corresponding to one or more of said pieces of equipment; a digital video controller, coupled to said second data processing unit and to said video memory means, that displays on said second display apparatus selected ones and selected sequences of said digitized video images stored in said video memory means in accordance with said video display instructions transmitted by said application software; and user input means for specifying one of said equipment maintenance tasks to be performed in conjunction with corresponding ones of said pieces of equipment; said application software including software that responds to specification of an equipment maintenance task, entered via said user input means, by generating video display instructions that instruct said digital video controller to display a single stored digitized video image for certain predefined equipment maintenance tasks and a sequence of said stored digitized video images for other predefined equipment maintenance tasks; said application software simultaneously displaying on said first display messages corresponding to said video images; whereby said computer system can be used to provide assistance in the form of video sequences and message displays to a person performing a specified equipment maintenance task.
Claim 4
Dependent Claim
330 words
In a computer system, the combination comprising: a first data processing unit coupled to a first display; first memory means, coupled to said first data processing unit, for storing application software, wherein said application software displays messages on said first display apparatus and also transmits video display instructions; wherein said application software includes means for defining a predefined set of pieces of equipment and a predefined set of maintenance tasks in conjunction with corresponding ones of said pieces of equipment; a second data processing unit coupled to a second display, and coupled to said first data processing unit so as to receive said transmitted video display instructions; random access video memory means, coupled to said second data processing unit, for storing a multiplicity of digitized video images, a multiplicity of said digitized video images stored in said video memory means corresponding to one or more of said pieces of equipment; a digital video controller, coupled to said second data processing unit and to said video memory means, that displays on said second display apparatus selected ones and selected sequences of said digitized video images stored in said video memory means in accordance with said video display instructions transmitted by said application software; and user input means for specifying one of said equipment maintenance tasks to be performed in conjunction with corresponding ones of said pieces of equipment; said application software including software that responds to specification of an equipment maintenance task, entered via said user input means, by generating video display instructions that instruct said digital video controller to display a single stored digitized video image for certain predefined equipment maintenance tasks and a sequence of said stored digitized video images for other predefined equipment maintenance tasks; said application software simultaneously displaying on said first display messages corresponding to said video images; whereby said computer system can be used to provide assistance in the form of video sequences and message displays to a person performing a specified equipment maintenance task.
Claim 5
Dependent Claim
23 words
The combination set forth in claim 2, wherein said user input means includes voice input and recognition means for receiving spoken user commands.
Claim 6
Dependent Claim
41 words
The combination set forth in claim 2, further including voice output means, coupled to said first data processing unit, for converting specified text strings into synthesized speech; said application software generating and transmitting to said voice output means specified text strings.
Claim 7
Dependent Claim
39 words
The combination set forth in claim 2, including portable housing that houses said computer system; said portable housing enabling said computer system to be taken to and used at the place where a selected piece of equipment is located.
Claim 8
Dependent Claim
247 words
In a computer system, the combination comprising: a first data processing unit coupled to a first display; first memory means, coupled to said first data processing unit, for storing application software, wherein said application software displays messages on said first display and also transmits video display instructions; a second data processing unit coupled to a second display, and coupled to said first data processing unit so as to receive said transmitted video display instructions; random access video memory means, coupled to said second data processing unit, for storing a multiplicity of digitized video images; a digital video controller, coupled to said second data processing unit and to said video memory means, that displays on said second display apparatus selected ones and selected sequences of said digitized video images stored in said video memory means in accordance with said video display instructions transmitted by said application software; and an audio speaker coupled to said digital video controller; said random access video memory means storing both digitized video images and a multiplicity of distinct digitized audio sequences; said application software transmitting audio play instructions to said second data processing unit; said second data processing unit forwarding corresponding audio play instructions to said digital video controller; and said digital video controller sending selected digitized audio sequences stored in said video memory means in accordance with said audio play instructions transmitted by said application software; whereby said computer system can play audio sequences in conjunction with video sequences and message displays.
Claim 9
Dependent Claim
247 words
In a computer system, the combination comprising: a first data processing unit coupled to a first display; first memory means, coupled to said first data processing unit, for storing application software, wherein said application software displays messages on said first display and also transmits video display instructions; a second data processing unit coupled to a second display, and coupled to said first data processing unit so as to receive said transmitted video display instructions; random access video memory means, coupled to said second data processing unit, for storing a multiplicity of digitized video images; a digital video controller, coupled to said second data processing unit and to said video memory means, that displays on said second display apparatus selected ones and selected sequences of said digitized video images stored in said video memory means in accordance with said video display instructions transmitted by said application software; and an audio speaker coupled to said digital video controller; said random access video memory means storing both digitized video images and a multiplicity of distinct digitized audio sequences; said application software transmitting audio play instructions to said second data processing unit; said second data processing unit forwarding corresponding audio play instructions to said digital video controller; and said digital video controller sending selected digitized audio sequences stored in said video memory means in accordance with said audio play instructions transmitted by said application software; whereby said computer system can play audio sequences in conjunction with video sequences and message displays.
Claim 10
Dependent Claim
192 words
The combination set forth in claim 6, wherein said application software includes means for defining a predefined set of pieces of equipment and a predefined set of maintenance tasks in conjunction with corresponding ones of said pieces of equipment; a multiplicity of said digitized video images stored in said video memory means corresponding to one or more of said pieces of equipment, said combination further including user input means for specifying one of said equipment maintenance tasks to be performed in conjunction with corresponding ones of said pieces of equipment; said application software including software that responds to specification of an equipment maintenance task, entered via said user input means, by generating video display instructions that instruct said digital video controller to display a single stored digitized video image for certain predefined equipment maintenance tasks and a sequence of said stored digitized video images for other predefined equipment maintenance tasks; said application software simultaneously displaying on said first display messages corresponding to said video images; whereby said computer system can be used to provide assistance in the form of video sequences and messages to a person performing a specified equipment maintenance task.
Claim 11
Dependent Claim
23 words
The combination set forth in claim 7, wherein said user input means includes voice input and recognition means for receiving spoken user commands.
Claim 12
Dependent Claim
41 words
The combination set forth in claim 7, further including voice output means, coupled to said first data processing unit, for converting specified text strings into synthesized speech; said application software generating and transmitting to said voice output means specified text strings.
Claim 13
Dependent Claim
221 words
In a computer system, the combination comprising: a first data processing unit coupled to a first display; first memory means, coupled to said first data processing unit, for storing application software, wherein said application software displays messages on said first display and also transmits video display instructions; a second data processing unit coupled to a second display, and coupled to said first data processing unit so as to receive said transmitted video display instructions; random access video memory means, coupled to said second data processing unit, for storing a multiplicity of digitized video images; a digital video controller, coupled to said second data processing unit and to said video memory means, that displays on said second display selected ones and selected sequences of said digitized video images stored in said video memory means in accordance with said video display instructions transmitted by said application software; and a portable, handheld satellite station, having a third data processing unit; a third display; communication means for communicating with said first data processing unit; and user input means for interacting with said application software; said first and second data processing units including means for transmitting messages and video images to said satellite station; whereby said satellite station allows use of said computer system by a peripatetic/ambulatory user without having to move said entire computer system.
Claim 14
Dependent Claim
221 words
In a computer system, the combination comprising: a first data processing unit coupled to a first display; first memory means, coupled to said first data processing unit, for storing application software, wherein said application software displays messages on said first display and also transmits video display instructions; a second data processing unit coupled to a second display, and coupled to said first data processing unit so as to receive said transmitted video display instructions; random access video memory means, coupled to said second data processing unit, for storing a multiplicity of digitized video images; a digital video controller, coupled to said second data processing unit and to said video memory means, that displays on said second display selected ones and selected sequences of said digitized video images stored in said video memory means in accordance with said video display instructions transmitted by said application software; and a portable, handheld satellite station, having a third data processing unit; a third display; communication means for communicating with said first data processing unit; and user input means for interacting with said application software; said first and second data processing units including means for transmitting messages and video images to said satellite station; whereby said satellite station allows use of said computer system by a peripatetic/ambulatory user without having to move said entire computer system.
Claim 15
Dependent Claim
192 words
The combination set forth in claim 10, wherein said application software includes means for defining a predefined set of pieces of equipment and a predefined set of maintenance tasks in conjunction with corresponding ones of said pieces of equipment; a multiplicity of said digitized video images stored in said video memory means corresponding to one or more of said pieces of equipment, said combination further including user input means for specifying one of said equipment maintenance tasks to be performed in conjunction with corresponding ones of said pieces of equipment; said application software including software that responds to specification of an equipment maintenance task, entered via said user input means, by generating video display instructions that instruct said digital video controller to display a single stored digitized video image for certain predefined equipment maintenance tasks and a sequence of said stored digitized video images for other predefined equipment maintenance tasks; said application software simultaneously displaying on said first display messages corresponding to said video images; whereby said computer system can be used to provide assistance in the form of video sequences and message to a person performing a specified equipment maintenance task.
Claim 16
Dependent Claim
23 words
The combination set forth in claim 11, wherein said user input means includes voice input and recognition means for receiving spoken user commands.
Claim 17
Dependent Claim
41 words
The combination set forth in claim 11, further including voice output means, coupled to said first data processing unit, for converting specified text strings into synthesized speech; said application software generating and transmitting to said voice output means specified text strings.
Claim 18
Dependent Claim
39 words
The combination set forth in claim 11, including portable housing that houses said computer system; said portable housing enabling said computer system to be taken to and used at the place where a selected piece of equipment is located.
References Cited (Backward Citations)
US4639881A
Cited
US4644478A
Cited
US4654852A
Cited
US4757463A
Cited
EP0273435A2
Cited
US4858152A
Cited
US4815014A
Cited
US5006976A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1996-05-03 | 1996-11-02 | 1997-05-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2000-05-03 | 2000-11-02 | 2001-05-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2004-05-03 | 2004-11-02 | 2005-05-04 | $7700.00 | Window Closed / Lapsed |