US6233389B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Multimedia time warping system
Assignee: Adeia Media Solutions Inc
•
Filing: 1998-07-30
•
Granted: 2001-05-15
•
Expires: 2018-07-30
Abstract
Abstract A multimedia time warping system. The invention allows the user to store selected television broadcast programs while the user is simultaneously watching or reviewing another program. A preferred embodiment of the invention accepts television (TV) input streams in a multitude of forms, for example, National Television Standards Committee (NTSC) or PAL broadcast, and digital forms such as Digital Satellite System (DSS), Digital Broadcast Services (DBS), or Advanced Television Standards Committee (ATSC). The TV streams are converted to an Moving Pictures Experts Group (MPEG) formatted stream for internal transfer and manipulation and are parsed and separated it into video and audio components. The components are stored in temporary buffers. Events are recorded that indicate the type of component that has been found, where it is located, and when it occurred. The program logic is notified that an event has occurred and the data is extracted from the buffers. The parser and event buffer decouple the CPU from having to parse the MPEG stream and from the real time nature of the data streams which allows for slower CPU and bus speeds and translate to lower system costs. The video and audio components are stored on a storage device and when the program is requested for display, the video and audio components are extracted from the storage device and reassembled into an MPEG stream which is sent to a decoder. The decoder converts the MPEG stream into TV output signals and delivers the TV output signals to a TV receiver. User control commands are accepted and sent through the system. These commands affect the flow of said MPEG stream and allow the user to view stored programs with at least the following functions: reverse, fast forward, play, pause, index, fast/slow reverse play, and fast/slow play.
Inventors
- 👤 James M. Barton
- 👤 Roderick James McInnis
- 👤 Alan S. Moskowitz
- 👤 Andrew Martin Goodman
- 👤 Ching Tong Chow
- 👤 Jean Swey Kao
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 22:13
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/76; H04N5/765; H04N5/775; G; G06; G06V; G06V20/00; G06V20/50; G06V20/52; G11; G11B; G11B27/00; G11B27/002; G11B27/02; G11B27/022; G11B27/024; G11B27/031; G11B27/032; G11B27/034; G11B27/10; G11B27/102; G11B27/105; G11B27/19; G11B27/28; G11B27/30; G11B27/3027; G11B27/3036; G11B27/3054; H04N21/00; H04N21/40; H04N21/41; H04N21/414; H04N21/4147; H04N21/422; H04N21/42204; H04N21/426; H04N21/42607; H04N21/42615; H04N21/4263; H04N21/43; H04N21/4302; H04N21/4307; H04N21/43072; H04N21/43076; H04N21/432; H04N21/433; H04N21/4334; H04N21/434; H04N21/4341; H04N21/4344; H04N21/4345; H04N21/44; H04N21/4402; H04N21/440281; H04N21/45; H04N21/4508; H04N21/4532; H04N21/454; H04N21/47; H04N21/472; H04N21/47214; H04N21/488; H04N21/4884; H04N21/80; H04N21/83; H04N21/845; H04N21/8456; H04N21/85; H04N21/854; H04N21/8547; H04N5/78; H04N5/781; H04N5/782; H04N5/783; H04N9/00; H04N9/79; H04N9/7921; H04N9/80; H04N9/804; H04N9/8042; H04N9/806; H04N9/8063; G11B2220/00; G11B2220/20; G11B2220/21; G11B2220/215; G11B2220/216; G11B2220/25; G11B2220/2537; G11B2220/2562; G11B2220/2575; G11B2220/40; G11B2220/45; G11B2220/455; G11B2220/90
Claims Analysis
Total Claims: 65
Claim 1
Independent Claim
212 words
A process for the simultaneous storage and play back of multimedia data, comprising the steps of: accepting television (TV) broadcast signals, wherein said TV signals are based on a multitude of standards, including, but not limited to, National Television Standards Committee (NTSC) broadcast, PAL broadcast, satellite transmission, DSS, DBS, or ATSC; tuning said TV signals to a specific program; providing at least one Input Section, wherein said Input Section converts said specific program to an Moving Pictures Experts Group (MPEG) formatted stream for internal transfer and manipulation; providing a Media Switch, wherein said Media Switch parses said MPEG stream, said MPEG stream is separated into its video and audio components; storing said video and audio components on a storage device; providing at least one Output Section, wherein said Output Section extracts said video and audio components from said storage device; wherein said Output Section assembles said video and audio components into an MPEG stream; wherein said Output Section sends said MPEG stream to a decoder; wherein said decoder converts said MPEG stream into TV output signals; wherein said decoder delivers said TV output signals to a TV receiver; and accepting control commands from a user, wherein said control commands are sent through the system and affect the flow of said MPEG stream.
Claim 2
Dependent Claim
212 words
A process for the simultaneous storage and play back of multimedia data, comprising the steps of: accepting television (TV) broadcast signals, wherein said TV signals are based on a multitude of standards, including, but not limited to, National Television Standards Committee (NTSC) broadcast, PAL broadcast, satellite transmission, DSS, DBS, or ATSC; tuning said TV signals to a specific program; providing at least one Input Section, wherein said Input Section converts said specific program to an Moving Pictures Experts Group (MPEG) formatted stream for internal transfer and manipulation; providing a Media Switch, wherein said Media Switch parses said MPEG stream, said MPEG stream is separated into its video and audio components; storing said video and audio components on a storage device; providing at least one Output Section, wherein said Output Section extracts said video and audio components from said storage device; wherein said Output Section assembles said video and audio components into an MPEG stream; wherein said Output Section sends said MPEG stream to a decoder; wherein said decoder converts said MPEG stream into TV output signals; wherein said decoder delivers said TV output signals to a TV receiver; and accepting control commands from a user, wherein said control commands are sent through the system and affect the flow of said MPEG stream.
Claim 3
Dependent Claim
22 words
The process of claim 1 , wherein said Input Section directs said MPEG stream to the destination indicated by said control commands.
Claim 4
Dependent Claim
25 words
The process of claim 1 , wherein said Output Section extracts said video and audio components from the storage device indicated by said control commands.
Claim 5
Dependent Claim
27 words
The process of claim 1 , further comprising the step of: creating custom video output sequences, wherein said sequences are specified by a user or program control.
Claim 6
Dependent Claim
24 words
The process of claim 1 , wherein the storing and extracting of said video and audio components from said storage device are performed simultaneously.
Claim 7
Dependent Claim
23 words
The process of claim 1 , wherein said Media Switch calculates and logically associates a time stamp to said video and audio components.
Claim 8
Dependent Claim
32 words
The process of claim 1 , wherein said Media Switch extracts time stamp values from a digital TV stream and logically associates said time stamp values to said video and audio components.
Claim 9
Dependent Claim
59 words
The process of claim 1 , further comprising the steps of: placing said video component into a circular video buffer; posting an event in a circular event buffer, wherein said event contains an indication that a video component was found and the location of said video component in said circular video buffer; and sending notice of said event posting.
Claim 10
Dependent Claim
59 words
The process of claim 1 , further comprising the steps of: placing said audio component into a circular audio buffer; posting an event in a circular event buffer, wherein said event contains an indication that an audio component was found and the location of said audio component in said circular audio buffer; and sending notice of said event posting.
Claim 11
Dependent Claim
41 words
The process of claims 8 or 9 , further comprising the steps of: receiving said notice; retrieving said event posting from said event buffer; and indexing into the appropriate buffer indicated by the type and location information in said event buffer.
Claim 12
Dependent Claim
48 words
The process of claim 10 , further comprising the steps of: generating a buffer containing the logical audio or video segments in order, including ancillary information, wherein each of said logical segments points to the appropriate circular buffer location where corresponding audio or video components have been placed.
Claim 13
Dependent Claim
24 words
The process of claim 1 , further comprising the step of: increasing the decoder system clock rate for fast playback or fast reverse playback.
Claim 14
Dependent Claim
24 words
The process of claim 1 , further comprising the step of: decreasing the decoder system clock rate for slow playback or slow reverse playback.
Claim 15
Dependent Claim
23 words
The process of claim 1 , further comprising the step of: combining system audio cues and on-screen displays with said TV output signals.
Claim 16
Dependent Claim
42 words
The process of claim 1 , further comprising the steps of: decoding the Vertical Blanking Interval (VBI) data or private data channel information from said TV signal; and examining said data to determine the starting or ending indicators of a specific program.
Claim 17
Dependent Claim
71 words
The process of claim 1 , further comprising the step of: scanning the words contained within the closed caption (CC) fields to determine program starting and ending times, wherein particular words or phrases are used to trigger the recording of a specific program and wherein the CC information is preserved in time synchronization with the audio and video, and can be correctly presented to the viewer when the stream is displayed.
Claim 18
Dependent Claim
25 words
The process of claim 16 , further comprising the step of: performing a specific action when a specific word is found in said CC information.
Claim 19
Dependent Claim
21 words
The process of claim 1 , wherein said Media Switch has a data bus connecting it to a CPU and DRAM.
Claim 20
Dependent Claim
19 words
The process of claim 1 , wherein said Media Switch shares an address bus with a CPU and DRAM.
Claim 21
Dependent Claim
17 words
The process of claim 1 , wherein said Media Switch operates asychronously and autonomously with a CPU.
Claim 22
Dependent Claim
16 words
The process of claim 1 , wherein said storage device is connected to said Media Switch.
Claim 23
Dependent Claim
21 words
The process of claim 1 , wherein said Media Switch allows the CPU to queue up Direct Memory Access (DMA) transfers.
Claim 24
Dependent Claim
14 words
The process of claim 1 , wherein said Media Switch is implemented in hardware.
Claim 25
Dependent Claim
57 words
The process of claim 1 , further comprising the step of: providing a multimedia recording device, including, but not limited to, a Video Cassette Recorder (VCR) or a Digital Video Disk-Random Access Memory (DVD-RAM) device, wherein said recording device is attached to the output side of said decoder, allowing said user to record said TV output signals.
Claim 26
Dependent Claim
23 words
The process of claim 24 , wherein said user queues up programs from said storage device to be stored on said recording device.
Claim 27
Dependent Claim
22 words
The process of claim 24 , wherein said user sets time schedules for said programs to be sent to said recording device.
Claim 28
Dependent Claim
27 words
The process of claim 24 , wherein title pages may be sent to said recording device before sending a program to be stored on said recording device.
Claim 29
Dependent Claim
33 words
The process of claim 24 , wherein a program that is longer in duration than a magnetic tape in said recording device allows, is sped up to fit within the desired time limit.
Claim 30
Dependent Claim
35 words
The process of claim 24 , wherein a program that is longer in duration than a magnetic tape in said recording device allows, has frames dropped from it to fit within the desired time limit.
Claim 31
Dependent Claim
54 words
The process of claim 24 , wherein the output of said recording device is routed to said Input Section, allowing said recording device to act as a storage back up system, said recording device accepts overflow storage, TV programs, software updates, or other data that are later retrieved and sent to said Input Section.
Claim 32
Dependent Claim
219 words
A process for the simultaneous storage and play back of multimedia data, comprising the steps of: providing a physical data source, wherein said physical data source accepts broadcast data from an input device, parses video and audio data from said broadcast data, and temporarily stores said video and audio data; providing a source object, wherein said source object extracts video and audio data from said physical data source; providing a transform object, wherein said transform object stores and retrieves data streams onto a storage device; wherein said source object obtains a buffer from said transform object, said source object converts video data into data streams and fills said buffer with said streams; wherein said source object is automatically flow controlled by said transform object; providing a sink object, wherein said sink object obtains data stream buffers from said transform object and outputs said streams to a video and audio decoder; wherein said decoder converts said streams into display signals and sends said signals to a display; wherein said sink object is automatically flow controlled by said transform object; providing a control object, wherein said control object receives commands from a user, said commands control the flow of the broadcast data through the system; and wherein said control object sends flow command events to said source, transform, and sink objects.
Claim 33
Dependent Claim
219 words
A process for the simultaneous storage and play back of multimedia data, comprising the steps of: providing a physical data source, wherein said physical data source accepts broadcast data from an input device, parses video and audio data from said broadcast data, and temporarily stores said video and audio data; providing a source object, wherein said source object extracts video and audio data from said physical data source; providing a transform object, wherein said transform object stores and retrieves data streams onto a storage device; wherein said source object obtains a buffer from said transform object, said source object converts video data into data streams and fills said buffer with said streams; wherein said source object is automatically flow controlled by said transform object; providing a sink object, wherein said sink object obtains data stream buffers from said transform object and outputs said streams to a video and audio decoder; wherein said decoder converts said streams into display signals and sends said signals to a display; wherein said sink object is automatically flow controlled by said transform object; providing a control object, wherein said control object receives commands from a user, said commands control the flow of the broadcast data through the system; and wherein said control object sends flow command events to said source, transform, and sink objects.
Claim 34
Independent Claim
215 words
An apparatus for the simultaneous storage and play back of multimedia data, comprising: a module for accepting television (TV) broadcast signals, wherein said TV signals are based on a multitude of standards, including, but not limited to, National Television Standards Committee (NTSC) broadcast, PAL broadcast, satellite transmission, DSS, DBS, or ATSC; a module for tuning said TV signals to a specific program; at least one Input Section, wherein said Input Section converts said specific program to an Moving Pictures Experts Group (MPEG) formatted stream for internal transfer and manipulation; a Media Switch, wherein said Media Switch parses said MPEG stream, said MPEG stream is separated into its video and audio components; a module for storing said video and audio components on a storage device; at least one Output Section, wherein said Output Section extracts said video and audio components from said storage device; wherein said Output Section assembles said video and audio components into an MPEG stream; wherein said Output Section sends said MPEG stream to a decoder; wherein said decoder converts said MPEG stream into TV output signals; wherein said decoder delivers said TV output signals to a TV receiver; and accepting control commands from a user, wherein said control commands are sent through the system and affect the flow of said MPEG stream.
Claim 35
Independent Claim
215 words
An apparatus for the simultaneous storage and play back of multimedia data, comprising: a module for accepting television (TV) broadcast signals, wherein said TV signals are based on a multitude of standards, including, but not limited to, National Television Standards Committee (NTSC) broadcast, PAL broadcast, satellite transmission, DSS, DBS, or ATSC; a module for tuning said TV signals to a specific program; at least one Input Section, wherein said Input Section converts said specific program to an Moving Pictures Experts Group (MPEG) formatted stream for internal transfer and manipulation; a Media Switch, wherein said Media Switch parses said MPEG stream, said MPEG stream is separated into its video and audio components; a module for storing said video and audio components on a storage device; at least one Output Section, wherein said Output Section extracts said video and audio components from said storage device; wherein said Output Section assembles said video and audio components into an MPEG stream; wherein said Output Section sends said MPEG stream to a decoder; wherein said decoder converts said MPEG stream into TV output signals; wherein said decoder delivers said TV output signals to a TV receiver; and accepting control commands from a user, wherein said control commands are sent through the system and affect the flow of said MPEG stream.
Claim 36
Dependent Claim
22 words
The apparatus of claim 32 , wherein said Input Section directs said MPEG stream to the destination indicated by said control commands.
Claim 37
Dependent Claim
25 words
The apparatus of claim 32 , wherein said Output Section extracts said video and audio components from the storage device indicated by said control commands.
Claim 38
Dependent Claim
27 words
The apparatus of claim 32 , further comprising: a module for creating custom video output sequences, wherein said sequences are specified by a user or program control.
Claim 39
Dependent Claim
24 words
The apparatus of claim 32 , wherein the storing and extracting of said video and audio components from said storage device are performed simultaneously.
Claim 40
Dependent Claim
23 words
The apparatus of claim 32 , wherein said Media Switch calculates and logically associates a time stamp to said video and audio components.
Claim 41
Dependent Claim
32 words
The apparatus of claim 32 , wherein said Media Switch extracts time stamp values from a digital TV stream and logically associates said time stamp values to said video and audio components.
Claim 42
Dependent Claim
65 words
The apparatus of claim 32 , further comprising: a module for placing said video component into a circular video buffer; a module for posting an event in a circular event buffer, wherein said event contains an indication that a video component was found and the location of said video component in said circular video buffer; and a module for sending notice of said event posting.
Claim 43
Dependent Claim
65 words
The apparatus of claim 32 , further comprising: a module for placing said audio component into a circular audio buffer; a module for posting an event in a circular event buffer, wherein said event contains an indication that an audio component was found and the location of said audio component in said circular audio buffer; and a module for sending notice of said event posting.
Claim 44
Independent Claim
47 words
The apparatus of claims 39 or 40 , further comprising: a module for receiving said notice; a module for retrieving said event posting from said event buffer; and a module for indexing into the appropriate buffer indicated by the type and location information in said event buffer.
Claim 45
Dependent Claim
48 words
The apparatus of claim 41 , further comprising: a module for generating a buffer containing the logical audio or video segments in order, including ancillary information, wherein each of said logical segments points to the appropriate circular buffer location where corresponding audio or video components have been placed.
Claim 46
Dependent Claim
24 words
The apparatus of claim 32 , further comprising: a module for increasing the decoder system clock rate for fast playback or fast reverse playback.
Claim 47
Dependent Claim
24 words
The apparatus of claim 32 , further comprising: a module for decreasing the decoder system clock rate for slow playback or slow reverse playback.
Claim 48
Dependent Claim
23 words
The apparatus of claim 32 , further comprising: a module for combining system audio cues and on-screen displays with said TV output signals.
Claim 49
Dependent Claim
45 words
The apparatus of claim 32 , further comprising: a module for decoding the Vertical Blanking Interval (VBI) data or private data channel information from said TV signal; and a module for examining said data to determine the starting or ending indicators of a specific program.
Claim 50
Dependent Claim
71 words
The apparatus of claim 32 , further comprising: a module for scanning the words contained within the closed caption (CC) fields to determine program starting and ending times, wherein particular words or phrases are used to trigger the recording of a specific program and wherein the CC information is preserved in time synchronization with the audio and video, and can be correctly presented to the viewer when the stream is displayed.
Claim 51
Dependent Claim
25 words
The apparatus of claim 47 , further comprising: a module for performing a specific action when a specific word is found in said CC information.
Claim 52
Dependent Claim
21 words
The apparatus of claim 32 , wherein said Media Switch has a data bus connecting it to a CPU and DRAM.
Claim 53
Dependent Claim
19 words
The apparatus of claim 32 , wherein said Media Switch shares an address bus with a CPU and DRAM.
Claim 54
Dependent Claim
17 words
The apparatus of claim 32 , wherein said Media Switch operates asychronously and autonomously with a CPU.
Claim 55
Dependent Claim
16 words
The apparatus of claim 32 , wherein said storage device is connected to said Media Switch.
Claim 56
Dependent Claim
21 words
The apparatus of claim 32 , wherein said Media Switch allows the CPU to queue up Direct Memory Access (DMA) transfers.
Claim 57
Dependent Claim
53 words
The apparatus of claim 32 , further comprising: a multimedia recording device, including, but not limited to, a Video Cassette Recorder (VCR) or a Digital Video Disk-Random Access Memory (DVD-RAM) device, wherein said recording device is attached to the output side of said decoder, allowing said user to record said TV output signals.
Claim 58
Dependent Claim
23 words
The apparatus of claim 54 , wherein said user queues up programs from said storage device to be stored on said recording device.
Claim 59
Dependent Claim
22 words
The apparatus of claim 54 , wherein said user sets time schedules for said programs to be sent to said recording device.
Claim 60
Dependent Claim
27 words
The apparatus of claim 54 , wherein title pages may be sent to said recording device before sending a program to be stored on said recording device.
Claim 61
Dependent Claim
33 words
The apparatus of claim 54 , wherein a program that is longer in duration than a magnetic tape in said recording device allows, is sped up to fit within the desired time limit.
Claim 62
Dependent Claim
35 words
The apparatus of claim 54 , wherein a program that is longer in duration than a magnetic tape in said recording device allows, has frames dropped from it to fit within the desired time limit.
Claim 63
Dependent Claim
54 words
The apparatus of claim 54 , wherein the output of said recording device is routed to said Input Section, allowing said recording device to act as a storage back up system, said recording device accepts overflow storage, TV programs, software updates, or other data that are later retrieved and sent to said Input Section.
Claim 64
Independent Claim
211 words
An apparatus for the simultaneous storage and play back of multimedia data, comprising: a physical data source, wherein said physical data source accepts broadcast data from an input device, parses video and audio data from said broadcast data, and temporarily stores said video and audio data; a source object, wherein said source object extracts video and audio data from said physical data source; a transform object, wherein said transform object stores and retrieves data streams onto a storage device; wherein said source object obtains a buffer from said transform object, said source object converts video data into data streams and fills said buffer with said streams; wherein said source object is automatically flow controlled by said transform object; a sink object, wherein said sink object obtains data stream buffers from said transform object and outputs said streams to a video and audio decoder; wherein said decoder converts said streams into display signals and sends said signals to a display; wherein said sink object is automatically flow controlled by said transform object; a control object, wherein said control object receives commands from a user, said commands control the flow of the broadcast data through the system; and wherein said control object sends flow command events to said source, transform, and sink objects.
Claim 65
Independent Claim
211 words
An apparatus for the simultaneous storage and play back of multimedia data, comprising: a physical data source, wherein said physical data source accepts broadcast data from an input device, parses video and audio data from said broadcast data, and temporarily stores said video and audio data; a source object, wherein said source object extracts video and audio data from said physical data source; a transform object, wherein said transform object stores and retrieves data streams onto a storage device; wherein said source object obtains a buffer from said transform object, said source object converts video data into data streams and fills said buffer with said streams; wherein said source object is automatically flow controlled by said transform object; a sink object, wherein said sink object obtains data stream buffers from said transform object and outputs said streams to a video and audio decoder; wherein said decoder converts said streams into display signals and sends said signals to a display; wherein said sink object is automatically flow controlled by said transform object; a control object, wherein said control object receives commands from a user, said commands control the flow of the broadcast data through the system; and wherein said control object sends flow command events to said source, transform, and sink objects.
References Cited (Backward Citations)
US4313135B1
Cited
US4313135A
Cited
US4665431A
Cited
US5675388A
Cited
US5202761A
Cited
USRE33535E
Cited
US5371551A
Cited
US5787225A
Cited
US5438423A
Cited
US5438423C1
Cited
US5696868A
Cited
US5550594A
Cited
US5706388A
Cited
US5920842A
Cited
EP0726574A2
Cited
US5572261A
Cited
US5937138A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-05-14 | 2004-11-13 | 2005-05-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-05-14 | 2008-11-13 | 2009-05-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-05-14 | 2012-11-13 | 2013-05-15 | $7700.00 | Window Closed / Lapsed |