US5884039A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System for providing a directory of AV devices and capabilities and call processing such that each participant participates to the extent of capabilities available
Assignee: Pragmatus AV LLC
•
Filing: 1996-06-07
•
Granted: 1999-03-16
•
Expires: 2016-06-07
Abstract
Abstract A multimedia collaboration system that integrates separate real-time and asynchronous networks--the former for real-time audio and video, and the latter for control signals and textual, graphical and other data--in a manner that is interoperable across different computer and network operating system platforms and which closely approximates the experience of face-to-face collaboration, while liberating the participants from the limitations of time and distance. These capabilities are achieved by exploiting a variety of hardware, software and networking technologies in a manner that preserves the quality and integrity of audio/video/data and other multimedia information, even after wide area transmission, and at a significantly reduced networking cost as compared to what would be required by presently known approaches. The system architecture is readily scalable to the largest enterprise network environments. It accommodates differing levels of collaborative capabilities available to individual users and permits high-quality audio and video capabilities to be readily superimposed onto existing personal computers and workstations and their interconnecting LANs and WANs. In a particular preferred embodiment, a plurality of geographically dispersed multimedia LANs are interconnected by a WAN. The demands made on the WAN are significantly reduced by employing multi-hopping techniques, including dynamically avoiding the unnecessary decompression of data at intermediate hops, and exploiting video mosaicing, cut-and-paste and audio mixing technologies so that significantly fewer wide area transmission paths are required while maintaining the high quality of the transmitted audio/video.
Inventors
- 👤 Lester F. Ludwig
- 👤 J. Chris Lauwers
- 👤 Keith A. Lantz
- 👤 Gerald J. Burnett
- 👤 Emmett R. Burns
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 10:31
CPC Classifications
H; H04; H04L; H04L65/00; H04L65/80; G; G06; G06Q; G06Q10/00; G06Q10/10; H04L12/00; H04L12/02; H04L12/16; H04L12/18; H04L12/1813; H04L12/1818; H04L12/1822; H04L12/1827; H04L12/1831; H04L51/00; H04L51/04; H04L51/07; H04L51/10; H04L65/1066; H04L65/1101; H04L65/40; H04L65/403; H04L65/4038; H04L67/00; H04L67/14; H04L67/50; H04L67/75; H04L9/00; H04L9/40; H04M; H04M3/00; H04M3/42; H04M3/50; H04M3/53; H04M3/5307; H04M3/56; H04M3/562; H04M3/563; H04M3/567; H04N; H04N7/00; H04N7/14; H04N7/141; H04N7/147; H04N7/148; H04N7/15; H04N7/152; H04L12/1836; H04L12/185; H04M2201/00; H04M2201/38; H04M2203/00; H04M2203/50; H04M2203/5018; H04M2203/5027; H04M3/42221; H04M3/42314; H04M3/42323; H04M3/428; H04M3/4285; H04M3/564; H04M7/00; H04M7/006; H04M7/12; H04Q; H04Q2213/00; H04Q2213/1305; H04Q2213/13093; H04Q2213/13175; H04Q2213/1319; H04Q2213/1322; H04Q2213/1324; H04Q2213/1326; H04Q2213/1332; H04Q2213/13337; H04Q2213/13389
Claims Analysis
Total Claims: 40
Claim 1
Independent Claim
280 words
A method of conducting a teleconference among a plurality of participants having workstations with associated monitors for displaying visual images, and with associated AV capture and reproduction capabilities for capturing and reproducing video images and spoken audio of the participants, the workstations being interconnected by a first network, the network providing a data path for carrying digital data signals among the workstations, the method comprising the steps of: (a) managing a data conference during which data is shared in real-time among a plurality of the participants and displayed on the monitors of their respective workstations; (b) managing a videoconference during which the video image and spoken audio of one of the participants is reproduced in real-time at the workstation of another of the participants; (c) providing at least one AV device with associated capabilities of providing at least audio and/or video signals to a workstation; (d) providing at least one directory of the AV devices and each device's associated capabilities; (e) processing a workstation request for provision of audio or video signals to cause an appropriate AV device to provide the requested signals to the workstation; (f) tracking the audio and video capabilities associated with each workstation; and (g) processing a call, from a second to a first participant, based on the capabilities associated with the first participant, such that, if at least one capability of the set of capabilities consisting of audio capture, audio reproduction, video capture, video reproduction, and the capability of connecting to the first network, is not available to at least one of the participants, each of the plurality of participants can participate in the teleconference to the extent of the capabilities available to the participant.
Claim 2
Independent Claim
280 words
A method of conducting a teleconference among a plurality of participants having workstations with associated monitors for displaying visual images, and with associated AV capture and reproduction capabilities for capturing and reproducing video images and spoken audio of the participants, the workstations being interconnected by a first network, the network providing a data path for carrying digital data signals among the workstations, the method comprising the steps of: (a) managing a data conference during which data is shared in real-time among a plurality of the participants and displayed on the monitors of their respective workstations; (b) managing a videoconference during which the video image and spoken audio of one of the participants is reproduced in real-time at the workstation of another of the participants; (c) providing at least one AV device with associated capabilities of providing at least audio and/or video signals to a workstation; (d) providing at least one directory of the AV devices and each device's associated capabilities; (e) processing a workstation request for provision of audio or video signals to cause an appropriate AV device to provide the requested signals to the workstation; (f) tracking the audio and video capabilities associated with each workstation; and (g) processing a call, from a second to a first participant, based on the capabilities associated with the first participant, such that, if at least one capability of the set of capabilities consisting of audio capture, audio reproduction, video capture, video reproduction, and the capability of connecting to the first network, is not available to at least one of the participants, each of the plurality of participants can participate in the teleconference to the extent of the capabilities available to the participant.
Claim 3
Dependent Claim
36 words
The method of claim 1, further comprising the step of: (a) converting signals of one format to another format to enable the teleconferencing system to support capture and reproduction devices based on different signal format standards.
Claim 4
Dependent Claim
79 words
The method of claim 1, wherein the AV device (i) has associated capabilities of any one of the group consisting of (1) storing one or more of digital data, audio or video signals; (2) retrieving one or more of stored digital data, audio, and video signals; (3) generating one or more of digital data, audio and video signals; and (4) accessing a remote source of digital data, audio and video signals and providing the accessed signals to a workstation.
Claim 5
Dependent Claim
42 words
The apparatus of claim 3, wherein the AV device is any one or more of: (a) a VCR; (b) a laser disk player; (c) a compact disk player; (d) a multimedia resource; (e) a television signal source; and (f) a fax machine.
Claim 6
Dependent Claim
25 words
The method of claim 1, wherein: at least the audio and/or the video signals are delivered to at least one workstation over a UTP network.
Claim 7
Dependent Claim
285 words
A teleconferencing system for conducting a teleconference among a plurality of participants, the system comprising: (a) a workstation associated with each of at least three participants, each workstation having at least one origination and at least one reproduction capability, each selected from the group consisting of audio, video and data origination/reproduction capabilities; (b) a first network providing a data path for carrying digital data signals among the workstations; (c) an AV path for carrying AV signals, representing video images and spoken audio of the participants; (d) a plurality of AV devices each having capabilities for providing audio and/or video signals to a workstation; and (e) a directory of each AV device and its associated capabilities, wherein the system is configured to: (i) manage a data conference during which images, based on digital data carried among the workstations, are displayed at the workstations of a plurality of the participants; (ii) manage reproduction of video images and audio at the workstation of a participant by addressing a workstation request for provision of audio or video signals, to cause an appropriate AV device to provide the requested signals to the workstation, (iii) track the audio and video origination and reproduction capabilities associated with each workstation, and (iv) to process a call, from a second to a first participant, based on which capabilities are associated with the workstation associated with first participant, such that (1) if any capability of the set of capabilities consisting of audio capture, audio reproduction, video capture, video reproduction, and the capability of connecting to the first network, is not available to at least one of the participants, each participant can participate in the teleconference to the extent of the capabilities available to the participant.
Claim 8
Dependent Claim
285 words
A teleconferencing system for conducting a teleconference among a plurality of participants, the system comprising: (a) a workstation associated with each of at least three participants, each workstation having at least one origination and at least one reproduction capability, each selected from the group consisting of audio, video and data origination/reproduction capabilities; (b) a first network providing a data path for carrying digital data signals among the workstations; (c) an AV path for carrying AV signals, representing video images and spoken audio of the participants; (d) a plurality of AV devices each having capabilities for providing audio and/or video signals to a workstation; and (e) a directory of each AV device and its associated capabilities, wherein the system is configured to: (i) manage a data conference during which images, based on digital data carried among the workstations, are displayed at the workstations of a plurality of the participants; (ii) manage reproduction of video images and audio at the workstation of a participant by addressing a workstation request for provision of audio or video signals, to cause an appropriate AV device to provide the requested signals to the workstation, (iii) track the audio and video origination and reproduction capabilities associated with each workstation, and (iv) to process a call, from a second to a first participant, based on which capabilities are associated with the workstation associated with first participant, such that (1) if any capability of the set of capabilities consisting of audio capture, audio reproduction, video capture, video reproduction, and the capability of connecting to the first network, is not available to at least one of the participants, each participant can participate in the teleconference to the extent of the capabilities available to the participant.
Claim 9
Dependent Claim
57 words
The teleconferencing system of claim 6, wherein the system is further configured to: (a) associate a participant with an identifier entered when the participant logs into any one of a plurality of workstations, and (b) to route a subsequent call to initiate a videoconference with that participant to the workstation at which that participant is logged in.
Claim 10
Dependent Claim
34 words
The teleconferencing system of claim 6, wherein the system is further configured to: (a) convert signals of one format to another format to support originating and reproduction devices based on different signal format standards.
Claim 11
Dependent Claim
84 words
The teleconferencing system of claim 6, wherein the AV path connects the workstation of a first participant at a first location to the workstation of a second of the participants at a second location via a third location, the system further comprising: (a) an AV signal switcher at the third location, coupled to the AV path to receive and route the AV signals to a location other than the third location if the AV signals are intended to be processed at the other location.
Claim 12
Dependent Claim
68 words
The teleconferencing system of claim 9, further comprising: (a) at least a first and second codec at the first and second locations respectively, each configured to compress the AV signals and decompress compressed AV signals and wherein video and audio, compressed by the first codec, can be routed from the first location to the second location via the AV signal switcher without being decompressed at the third location.
Claim 13
Dependent Claim
40 words
The teleconferencing system of claim 10, where in the video image and spoken audio of the first participant routed to the second location, via the third location, can be reproduced at the workstations of both the first and second participants.
Claim 14
Dependent Claim
33 words
The teleconferencing system of claim 11, further comprising a video mosaic generator for combining the captured images of a first and second participant into a mosaic image for reproduction at least one workstation.
Claim 15
Dependent Claim
40 words
The teleconferencing system of claim 12, further comprising a distributed mosaic generator for combining a portion of the mosaic image with a captured image of a third participant to generate a composite mosaic image for production at least one workstation.
Claim 16
Dependent Claim
47 words
The teleconferencing system of claim 11, further comprising an audio summer for receiving the captured audio of a first, second and third participant and combining the received audio of the second and third participants into an audio sum for reproduction at the workstation of the first participant.
Claim 17
Dependent Claim
38 words
The teleconferencing system of claim 11, wherein the system is configured to: (a) route at least the AV signals among participant's workstations in such a way so as to optimize the carrying of AV signals between the workstations.
Claim 18
Dependent Claim
23 words
A teleconferencing system of claim 15, wherein the routing is optimized based on either the actual or anticipated state of the AV path.
Claim 19
Dependent Claim
67 words
The teleconferencing system of claim 6, further comprising: (a) a video mosaic generator for combining the captured images of a first and second participant into a mosaic image; and (b) a distributed mosaic generator for combining a portion of the mosaic image with a captured image of a third participant to generate a composite mosaic image of the captured images of the first, second and third participants.
Claim 20
Dependent Claim
84 words
The teleconferencing system of claim 6, further comprising: (a) a video mosaic generator, for combining the captured images of a first and second of the participants into a mosaic image of the captured images, whereby the mosaic image can be reproduced at the workstations of the first and second participants; wherein the system is configured to allow a participant to select the image one participant whose image is reproduced in the mosaic image upon which the mosaic image is replaced with the selected image.
Claim 21
Dependent Claim
72 words
The teleconferencing system of claim 6, further comprising: (a) a video mosaic generator for the captured images of a first and second of the participants into a mosaic image of the captured images; and (b) an audio summer for receiving the captured audio of first, second and third participants and combining the received audio of second and third participants into an audio sum for production at the workstation of the first participant.
Claim 22
Dependent Claim
79 words
The system of claim 6, wherein the AV device (i) has associated capabilities of any one of the group consisting of (1) storing one or more of digital data, audio or video signals; (2) retrieving one or more of stored digital data, audio, and video signals; (3) generating one or more of digital data, audio and video signals; and (4) accessing a remote source of digital data, audio and video signals and providing the accessed signals to a workstation.
Claim 23
Dependent Claim
42 words
The system of claim 20, wherein the AV device is any one or more of: (a) a VCR; (b) a laser disk player; (c) a compact disk player; (d) a multimedia resource; (e) a television signal source; and (f) a fax machine.
Claim 24
Dependent Claim
21 words
The system of claim 6, wherein the AV path (i) is at least partly defined by unshielded twisted pair (UTP) wiring.
Claim 25
Dependent Claim
347 words
A teleconferencing system for conducting a teleconference among a plurality of participants, the system comprising: (a) a workstation (i) associated with each of at least two participants, and (ii) having at least one origination and at least one reproduction capability, (1) each selected from the group consisting of audio, video and data origination/reproduction capabilities; (b) an AV path (i) configured to carry AV signals, (1) representing video images and spoken audio of the participants (ii) among the workstations; (c) at least one AV device (i) having capabilities for providing at least audio and/or video signals (1) to a workstation, and (ii) configured to address a request (1) for providing audio and/or video signals (2) to one of the workstations; and (d) at least one directory of (i) each workstation and its origination/reproduction capabilities, and/or (ii) each AV reproduction device and its associated capabilities, wherein the system is configured (i) to manage the reproduction (1) of video images and audio (2) at the workstation of a participant (ii) by interacting with the directory (iii) to address a request, (1) generated at a workstation, (2) audio and/or video signals, (iv) to cause an appropriate AV device (1) to provide the requested signals to the workstation (v) to track the audio and video origination and reproduction capabilities associated with each workstation, and (vi) to process a call, from a second to a first participant, based on which capabilities are associated with the first participant, and to manage a teleconference among a plurality of participants such that, if at least one capability from the set of capabilities consisting of audio capture, audio reproduction, video capture, video reproduction, and the capability conducting a data conference is not available to any participant, each participant can participate in the teleconference to the extent of the capabilities available to that participant, and wherein the system is further configured (i) to associate a participant (1) with each workstation at which the participant logs in and (ii) to route a videoconference call, (1) for that participant, (2) to the workstation at which that participant is logged in.
Claim 26
Dependent Claim
347 words
A teleconferencing system for conducting a teleconference among a plurality of participants, the system comprising: (a) a workstation (i) associated with each of at least two participants, and (ii) having at least one origination and at least one reproduction capability, (1) each selected from the group consisting of audio, video and data origination/reproduction capabilities; (b) an AV path (i) configured to carry AV signals, (1) representing video images and spoken audio of the participants (ii) among the workstations; (c) at least one AV device (i) having capabilities for providing at least audio and/or video signals (1) to a workstation, and (ii) configured to address a request (1) for providing audio and/or video signals (2) to one of the workstations; and (d) at least one directory of (i) each workstation and its origination/reproduction capabilities, and/or (ii) each AV reproduction device and its associated capabilities, wherein the system is configured (i) to manage the reproduction (1) of video images and audio (2) at the workstation of a participant (ii) by interacting with the directory (iii) to address a request, (1) generated at a workstation, (2) audio and/or video signals, (iv) to cause an appropriate AV device (1) to provide the requested signals to the workstation (v) to track the audio and video origination and reproduction capabilities associated with each workstation, and (vi) to process a call, from a second to a first participant, based on which capabilities are associated with the first participant, and to manage a teleconference among a plurality of participants such that, if at least one capability from the set of capabilities consisting of audio capture, audio reproduction, video capture, video reproduction, and the capability conducting a data conference is not available to any participant, each participant can participate in the teleconference to the extent of the capabilities available to that participant, and wherein the system is further configured (i) to associate a participant (1) with each workstation at which the participant logs in and (ii) to route a videoconference call, (1) for that participant, (2) to the workstation at which that participant is logged in.
Claim 27
Dependent Claim
38 words
The teleconferencing system of claim 23, wherein the system is further configured to: (a) convert signals of one format to another format, whereby the teleconferencing system can support originating and reproduction devices based on different signal format standards.
Claim 28
Dependent Claim
32 words
The teleconferencing system of claim 23, wherein the system is configured to combine the captured images of a first and second participant into a mosaic image for reproduction at least one workstation.
Claim 29
Dependent Claim
47 words
The teleconferencing system of claim 23, further comprising an audio summer for receiving the captured audio of a first, second and third participant and combining the received audio of the second and third participants into an audio sum for reproduction at the workstation of the first participant.
Claim 30
Dependent Claim
40 words
The teleconferencing system of claim 23, further comprising: (a) at least one signal router for routing at least the AV signals among participant's workstations in such a way so as to optimize the carrying of AV signals between the workstations.
Claim 31
Dependent Claim
41 words
The teleconferencing system of claim 23, wherein the system is further configured to: (a) allow a participant to select the image one participant whose image is reproduced in the mosaic image and thereby replace the mosaic image with the selected image.
Claim 32
Dependent Claim
79 words
The system of claim 23, wherein the AV device (i) has associated capabilities of any one of the group consisting of (1) storing one or more of digital data, audio or video signals; (2) retrieving one or more of stored digital data, audio, and video signals; (3) generating one or more of digital data, audio and video signals; and (4) accessing a remote source of digital data, audio and video signals and providing the accessed signals to a workstation.
Claim 33
Dependent Claim
42 words
The system of claim 29, wherein the AV device is any one or more of: (a) a VCR; (b) a laser disk player; (c) a compact disk player; (d) a multimedia resource; (e) a television signal source; and (f) a fax machine.
Claim 34
Dependent Claim
21 words
The system of claim 23, wherein the AV path (i) is at least partly defined by unshielded twisted pair (UTP) wiring.
Claim 35
Independent Claim
302 words
A method for conducting a teleconference among a plurality of participants having workstations with associated monitors for displaying visual images, and with associated AV capture and reproduction capabilities for capturing and reproducing video images and spoken audio of the participants, the workstations being interconnected by a first network, the network providing a data path for carrying digital data signals among the workstations, the method comprising the steps of: (a) managing a data conference during which data is shared in real-time among a plurality of the participants and displayed on the monitors of their respective workstations; (b) managing a videoconference during which the video image and spoken audio of one of the participants is reproduced in real-time at the workstation of another of the participants; (c) providing at least one AV device with associated capabilities of providing at least audio and/or video signals to a workstation; (d) defining at least one directory of AV devices and each device's associated capabilities; (e) processing a request for a audio and/or video signals to cause an appropriate AV device to provide the requested signals to the workstation; and (f) managing connections between participants by (i) associating a participant (1) with each workstation at which the participant logs in and (ii) routing a videoconference call, (1) for that participant, (2) to the workstation at which that participant is logged in, wherein the step of managing the video conference is conducted among a plurality of participants such that, if at least one capability of the set of capabilities consisting of audio capture, audio reproduction, video capture, video reproduction, and the capability of connecting to the first network, is not available to at least one of the participants, each of the plurality of participants can participate in the teleconference to the extent of the capabilities available to the participant.
Claim 36
Independent Claim
302 words
A method for conducting a teleconference among a plurality of participants having workstations with associated monitors for displaying visual images, and with associated AV capture and reproduction capabilities for capturing and reproducing video images and spoken audio of the participants, the workstations being interconnected by a first network, the network providing a data path for carrying digital data signals among the workstations, the method comprising the steps of: (a) managing a data conference during which data is shared in real-time among a plurality of the participants and displayed on the monitors of their respective workstations; (b) managing a videoconference during which the video image and spoken audio of one of the participants is reproduced in real-time at the workstation of another of the participants; (c) providing at least one AV device with associated capabilities of providing at least audio and/or video signals to a workstation; (d) defining at least one directory of AV devices and each device's associated capabilities; (e) processing a request for a audio and/or video signals to cause an appropriate AV device to provide the requested signals to the workstation; and (f) managing connections between participants by (i) associating a participant (1) with each workstation at which the participant logs in and (ii) routing a videoconference call, (1) for that participant, (2) to the workstation at which that participant is logged in, wherein the step of managing the video conference is conducted among a plurality of participants such that, if at least one capability of the set of capabilities consisting of audio capture, audio reproduction, video capture, video reproduction, and the capability of connecting to the first network, is not available to at least one of the participants, each of the plurality of participants can participate in the teleconference to the extent of the capabilities available to the participant.
Claim 37
Dependent Claim
55 words
The method of claim 32, further comprising the steps of: (a) tracking the audio and video capabilities associated with each workstation; and (b) processing a call, from a second to a first participant, by including a request for a service with respect to the first participant, based on the capabilities associated with the first participant.
Claim 38
Dependent Claim
79 words
The method of claim 32, wherein the AV device (I) has associated capabilities of any one of the group consisting of (1) storing one or more of digital data, audio or video signals; (2) retrieving one or more of stored digital data, audio, and video signals; (3) generating one or more of digital data, audio and video signals; and (4) accessing a remote source of digital data, audio and video signals and providing the accessed signals to a workstation.
Claim 39
Dependent Claim
42 words
The method of claim 34, wherein the AV device is any one or more of: (a) a VCR; (b) a laser disk player; (c) a compact disk player; (d) a multimedia resource; (e) a television signal source; and (f) a fax machine.
Claim 40
Dependent Claim
25 words
The method of claim 32, wherein: at least the audio and/or the video signals are delivered to at least one workstation over a UTP network.
References Cited (Backward Citations)
US3974337A
Cited
US3723653A
Cited
US4005265A
Cited
US3873771A
Cited
US4210927A
Cited
US4441180A
Cited
US4516156A
Cited
US4645872A
Cited
US4451705A
Cited
US4531024A
Cited
US4574374A
Cited
US4529839A
Cited
US4529840A
Cited
DE3507152A1
Cited
US4650929A
Cited
EP0190060A1
Cited
US4710917A
Cited
US4837798A
Cited
US4931872A
Cited
US4961211A
Cited
US4987492A
Cited
US5200989A
Cited
US4995071A
Cited
US5130793A
Cited
EP0354370A1
Cited
US5027400A
Cited
US5170427A
Cited
US5003532A
Cited
US5010399A
Cited
EP0414222A2
Cited
US5130801A
Cited
US5303343A
Cited
US5042062A
Cited
US5099510A
Cited
US5202957A
Cited
US5283637A
Cited
US5260941A
Cited
US5218627A
Cited
EP0497022A1
Cited
EP0516371A2
Cited
EP0523626A1
Cited
EP0523618A2
Cited
US5315633A
Cited
EP0561381A2
Cited
US5408526A
Cited
US5471318A
Cited
US5689553A
Cited
US5374952A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-03-15 | 2002-09-14 | 2003-03-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-03-15 | 2006-09-14 | 2007-03-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-03-15 | 2010-09-14 | 2011-03-16 | $7700.00 | Window Closed / Lapsed |