US6873344B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Media production system using flowgraph representation of operations
Assignee: Sony Corp
•
Filing: 2001-08-13
•
Granted: 2005-03-29
•
Expires: 2021-08-13
Abstract
Abstract A system for processing images, or clips, as, for example, in a movie or video post production system. The clips are associated with a flowgraph representation that visually depicts all of the operations used to generate the clips. Correspondence between the image and flowgraph representations is tightly maintained so that the user can conveniently switch between, and work among, the different representations. Efficient user interface mechanisms are provided to work with flowgraph items to construct nodes representing operations. Nodes can be joined in an automated, or assisted, manner. Flowgraphs can be automatically generated according to user inputs in other parts of the system. For example, layered effects can have flowgraphs that are automatically generated. A freehand drawing timing capture tool is provided. All operations that contribute to a single (or more) pixel's value can be listed and selectively activated or deactivated to detect a problem. Any input mechanism can be bookmarked with a labeled value so that the labeled value can be called up at a later time to restore a setting, or multiple settings. A method for using a trilinear look-up table to computer various functions where the table resolution can change is disclosed.
Inventors
- 👤 Sukendeep Samra
- 👤 Bruno Sargeant
- 👤 Junichi Tsukamoto
- 👤 Sidhartha Deb
- 👤 Makoto Kawamura
- 👤 Shingo Kawabe
- 👤 Mark A. van den Bergen
- 👤 Farhana Bandukwala
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 11:18
CPC Classifications
G; G11; G11B; G11B27/00; G11B27/10; G11B27/34; G06; G06F; G06F3/00; G06F3/01; G06F3/048; G06F3/0484; G06F40/00; G06F40/10; G06F40/166; G06F40/169; G11B27/02; G11B27/031; G11B27/034; H; H04; H04M; H04M3/00; H04M3/42; H04M3/56; H04M3/567; G06F3/0481; G06F3/04817; G06F3/0482; G06F3/04842; G06F3/0486
Claims Analysis
Total Claims: 20
Claim 1
Independent Claim
202 words
A method for modifying a pixel value of a digital image, the method executing in a digital processing system, the method comprising accepting a signal from a user input device to indicate a first operation to be performed on a pixel; displaying a result of the first operation on the pixel; accepting a signal from a user input device to indicate a second operation to be performed on the pixel; displaying a result of the first and second operations on the pixel; maintaining an association between and operations; displaying a visual sequence of the first and second operations on the display screen wherein a first visual indicator corresponds to the first operation and a second visual indicator corresponds to the second operation, and wherein the order of application of operations is shown, wherein the first operation includes multiple sub-operations; displaying multiple expanded visual indicators in association with the first visual indicator, wherein the multiple expanded visual indicators correspond to the multiple sub-operations; accepting a signal from a user input device to indicate modification of the visual sequence; and displaying a result of a corresponding change in application of the operations to the pixel in response to the modification of the visual sequence.
Claim 2
Independent Claim
202 words
A method for modifying a pixel value of a digital image, the method executing in a digital processing system, the method comprising accepting a signal from a user input device to indicate a first operation to be performed on a pixel; displaying a result of the first operation on the pixel; accepting a signal from a user input device to indicate a second operation to be performed on the pixel; displaying a result of the first and second operations on the pixel; maintaining an association between and operations; displaying a visual sequence of the first and second operations on the display screen wherein a first visual indicator corresponds to the first operation and a second visual indicator corresponds to the second operation, and wherein the order of application of operations is shown, wherein the first operation includes multiple sub-operations; displaying multiple expanded visual indicators in association with the first visual indicator, wherein the multiple expanded visual indicators correspond to the multiple sub-operations; accepting a signal from a user input device to indicate modification of the visual sequence; and displaying a result of a corresponding change in application of the operations to the pixel in response to the modification of the visual sequence.
Claim 3
Dependent Claim
13 words
The method of claim 1 , wherein the visual indicators include a flowgraph.
Claim 4
Dependent Claim
30 words
The method of claim 2 , wherein the flowgraph includes nodes that correspond to operations, wherein the nodes are connected by connectors to show the order of execution of operations.
Claim 5
Dependent Claim
21 words
The method of claim 1 , wherein modification of the visual sequence includes deletion of a visual indication of an operation.
Claim 6
Dependent Claim
21 words
The method of claim 1 , wherein modification of the visual sequence includes addition of a visual indication of an operation.
Claim 7
Dependent Claim
20 words
The method of claim 1 , wherein modification of the visual sequence includes changing an order of application of operations.
Claim 8
Dependent Claim
20 words
The method of claim 1 , further comprising indicating the first and second operations as first and second nodes, respectively.
Claim 9
Dependent Claim
24 words
The method of claim 7 , further comprising indicating the order of application of operations as a line connecting the first and second nodes.
Claim 10
Dependent Claim
23 words
The method of claim 8 , wherein an order of application of operations is indicated with a directional indicator associated with the line.
Claim 11
Dependent Claim
13 words
The method of claim 9 , wherein the directional indicator includes an arrow.
Claim 12
Dependent Claim
14 words
The method of claim 9 , wherein the directional indicator includes an input port.
Claim 13
Dependent Claim
62 words
The method of claim 1 , further comprising displaying a third visual indicator on the display screen that corresponds to a third operation; accepting a signal from a user input device to define an ordering of the first, second and third visual indicators; and displaying a result of the pixel after applying the first, second and third operations in the defined ordering.
Claim 14
Dependent Claim
38 words
The method of claim 1 , wherein an operation can include one or more of the following: brightness adjustment, clamp effect, contrast, convert, crop, dissolve, fade, gain, gamma, invert, CMY graph, luma graph, monochrome, offset and swap RGBA.
Claim 15
Dependent Claim
17 words
The method of claim 1 , wherein an operation includes obtaining a pixel from a storage location.
Claim 16
Dependent Claim
13 words
The method of claim 1 , wherein an operation includes an output operation.
Claim 17
Independent Claim
218 words
An apparatus for modifying a pixel value of a digital image, the apparatus comprising a digital processor; a display coupled to the digital processor; an input device coupled to the digital processor; a machine-readable medium including instructions for accepting a signal from a user input device to indicate a first operation to be performed on a pixel; displaying a result of the first operation on the pixel; accepting a signal from a user input device to indicate a second operation to be performed on the pixel; displaying a result of the first and second operations on the pixel; maintaining an association between and operations; displaying a visual sequence of the first and second operations on the display screen wherein a first visual indicator corresponds to the first operation and a second visual indicator corresponds to the second operation, and wherein the order of application of operations is shown, wherein the first operation includes multiple sub-operations; displaying multiple expanded visual indicators in association with the first visual indicator, wherein the multiple expanded visual indicators correspond to the multiple sub-operations; accepting a signal from a user input device to indicate modification of the visual sequence; and displaying a result of a corresponding change in application of the operations to the pixel in response to the modification of the visual sequence.
Claim 18
Independent Claim
218 words
An apparatus for modifying a pixel value of a digital image, the apparatus comprising a digital processor; a display coupled to the digital processor; an input device coupled to the digital processor; a machine-readable medium including instructions for accepting a signal from a user input device to indicate a first operation to be performed on a pixel; displaying a result of the first operation on the pixel; accepting a signal from a user input device to indicate a second operation to be performed on the pixel; displaying a result of the first and second operations on the pixel; maintaining an association between and operations; displaying a visual sequence of the first and second operations on the display screen wherein a first visual indicator corresponds to the first operation and a second visual indicator corresponds to the second operation, and wherein the order of application of operations is shown, wherein the first operation includes multiple sub-operations; displaying multiple expanded visual indicators in association with the first visual indicator, wherein the multiple expanded visual indicators correspond to the multiple sub-operations; accepting a signal from a user input device to indicate modification of the visual sequence; and displaying a result of a corresponding change in application of the operations to the pixel in response to the modification of the visual sequence.
Claim 19
Dependent Claim
237 words
A machine-readable medium including instructions for modifying a pixel value of a digital image, the medium comprising one or more instructions for accepting a signal from a user input device to indicate a first operation to be performed on a pixel; one or more instructions for displaying a result of the first operation on the pixel; one or more instructions for accepting a signal from a user input device to indicate a second operation to be performed on the pixel; one or more instructions for displaying a result of the first and second operations on the pixel; one or more instructions for maintaining an association between and operations; one or more instructions for displaying a visual sequence of the first and second operations on the display screen wherein a first visual indicator corresponds to the first operation and a second visual indicator corresponds to the second operation, and wherein the order of application of operations is shown, wherein the first operation includes multiple sub-operations; displaying multiple expanded visual indicators in association with the first visual indicator, wherein the multiple expanded visual indicators correspond to the multiple sub-operations; one or more instructions for accepting a signal from a user input device to indicate modification of the visual sequence; and one or more instructions for displaying a result of a corresponding change in application of the operations to the pixel in response to the modification of the visual sequence.
Claim 20
Dependent Claim
237 words
A machine-readable medium including instructions for modifying a pixel value of a digital image, the medium comprising one or more instructions for accepting a signal from a user input device to indicate a first operation to be performed on a pixel; one or more instructions for displaying a result of the first operation on the pixel; one or more instructions for accepting a signal from a user input device to indicate a second operation to be performed on the pixel; one or more instructions for displaying a result of the first and second operations on the pixel; one or more instructions for maintaining an association between and operations; one or more instructions for displaying a visual sequence of the first and second operations on the display screen wherein a first visual indicator corresponds to the first operation and a second visual indicator corresponds to the second operation, and wherein the order of application of operations is shown, wherein the first operation includes multiple sub-operations; displaying multiple expanded visual indicators in association with the first visual indicator, wherein the multiple expanded visual indicators correspond to the multiple sub-operations; one or more instructions for accepting a signal from a user input device to indicate modification of the visual sequence; and one or more instructions for displaying a result of a corresponding change in application of the operations to the pixel in response to the modification of the visual sequence.
References Cited (Backward Citations)
US5517607A
Cited
US5982350A
Cited
US5852449A
Cited
US5438654A
Cited
US5844563A
Cited
US6750890B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2008-03-28 | 2008-09-27 | 2009-03-29 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2012-03-28 | 2012-09-27 | 2013-03-29 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2016-03-28 | 2016-09-27 | 2017-03-29 | $7700.00 | Window Closed / Lapsed |