Patent US5859934A successfully refreshed from Google Patents.
US5859934A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for transforming coordinate systems in a telemanipulation system
Assignee: SRI International Inc
•
Filing: 1997-01-14
•
Granted: 1999-01-12
•
Expires: 2017-01-14
Abstract
Abstract In a telemanipulation system for manipulating objects located in a workspace at a remote worksite by an operator from an operator's station, such as in a remote surgical system, the remote worksite having a manipulator with an end effector for manipulating an object at the workspace, such as a body cavity, a controller including a hand control at the control operator's station for remote control of the manipulator, an image capture device, such as a camera, and image output device for reproducing a viewable real-time image, the improvement wherein a position sensor associated with the image capture device senses position relative to the end effector and a processor transforms the viewable real-time image into a perspective image with correlated manipulation of the end effector by the hand controller such that the operator can manipulate the end effector and the manipulator as if viewing the workspace in true presence. Image transformation according to the invention includes translation, rotation and perspective correction.
Inventors
- 👤 Philip S. Green
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 06:49
CPC Classifications
A; A61; A61B; A61B34/00; A61B34/70; A61B34/76; A61B34/30; A61B34/35; A61B34/37; B; B25; B25J; B25J19/00; B25J19/02; B25J19/021; B25J19/023; B25J3/00; B25J3/04; B25J9/00; B25J9/16; B25J9/1679; B25J9/1689; G; G06; G06T; G06T1/00; G06T1/0014; G06T3/00; H; H04; H04N; H04N13/00; H04N13/20; H04N13/204; H04N13/239; H04N13/246; H04N13/296; H04N13/30; H04N13/332; H04N13/337; H04N13/341; H04N13/398; A61B17/00; A61B17/00234; A61B90/00; A61B90/36; A61B90/361; G03; G03C; G03C1/00; G03C1/005; G03C1/0051; G03C1/0053; G05; G05B; G05B2219/00; G05B2219/30; G05B2219/35; G05B2219/35506; G05B2219/39; G05B2219/39389; G05B2219/40; G05B2219/40158; G05B2219/40161; G05B2219/40169; G05B2219/45; G05B2219/45123; H04N13/10; H04N13/189; H04N13/194
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
246 words
A telemanipulation surgical system for surgery at a worksite internal to a patient wherein the surgical system comprises a surgical instrument and a controller having a hand control in an apparent workspace for remote control of the surgical instrument by an operator, an image capture device for taking a real-time image of the internal worksite within the patient, and an image generator for producing a display on a monitor for eyes of the operator, said controller further comprising: an image processor coupled to said image capture device for processing the real-time image into a processed image for display to the operator, wherein said image capture device is at an angle and an arbitrary position relative to the surgical instrument at the worksite which differs from an anthropomorphic relative position of eyes of the operator and the hand control in the apparent workspace, said image processor and said image generator cooperating to produce an image of said surgical instrument which image is coincident with the anthropomorphic position of said hand control; a sensor coupled to the surgical instrument for detecting an actual position of the surgical instrument within the internal worksite; and a coordinate transformer coupled to the image processor and the sensor, the coordinate transformer translating the actual position of the surgical instrument in the real-time image to a perceived position in the processed image such that the surgical instrument appears at or near the anthropomorphic position to the image capture device in the processed image.
Claim 2
Dependent Claim
246 words
A telemanipulation surgical system for surgery at a worksite internal to a patient wherein the surgical system comprises a surgical instrument and a controller having a hand control in an apparent workspace for remote control of the surgical instrument by an operator, an image capture device for taking a real-time image of the internal worksite within the patient, and an image generator for producing a display on a monitor for eyes of the operator, said controller further comprising: an image processor coupled to said image capture device for processing the real-time image into a processed image for display to the operator, wherein said image capture device is at an angle and an arbitrary position relative to the surgical instrument at the worksite which differs from an anthropomorphic relative position of eyes of the operator and the hand control in the apparent workspace, said image processor and said image generator cooperating to produce an image of said surgical instrument which image is coincident with the anthropomorphic position of said hand control; a sensor coupled to the surgical instrument for detecting an actual position of the surgical instrument within the internal worksite; and a coordinate transformer coupled to the image processor and the sensor, the coordinate transformer translating the actual position of the surgical instrument in the real-time image to a perceived position in the processed image such that the surgical instrument appears at or near the anthropomorphic position to the image capture device in the processed image.
Claim 3
Dependent Claim
43 words
The system of claim 1 wherein the coordinate transformer translates an actual orientation of the surgical instrument in the worksite to a perceived orientation in the processed image such that the surgical instrument appears to extend directly outward from the image capture device.
Claim 4
Dependent Claim
31 words
The system of claim 1 wherein the display is located at the hand control such that the surgical instrument appears to be integral with the hand control in the processed image.
Claim 5
Dependent Claim
72 words
The system of claim 2 further comprising a servomechanism for directly correlating movement of the hand control with movement of the surgical instrument in the processed image such that movement of the hand control relative to the position and orientation of the hand control in the apparent workspace results in movement of the surgical instrument relative to the actual position and the actual orientation of the surgical instrument at the internal worksite.
Claim 6
Independent Claim
167 words
A method of performing surgery by an operator at a remote location with a hand-operated controller comprising: positioning a distal end portion of a surgical instrument adjacent an internal worksite within a patient's body; positioning an image capture device at an arbitrary position relative to the surgical instrument at the internal worksite which differs from an anthropomorphic relative position of eyes of the operator and the controller at an apparent worksite; detecting an actual position of the surgical instrument within the internal worksite; taking a real-time image of the positioned surgical instrument and at least a portion of the internal worksite with the positioned image capture device; processing the real-time image into a processed image for display to the operator at the apparent worksite; and transforming the actual position of the surgical instrument within the real-time image in the internal worksite to a perceived position such that the surgical instrument appears at or adjacent the anthropomorphic relative position to the image capture device in the processed image.
Claim 7
Independent Claim
167 words
A method of performing surgery by an operator at a remote location with a hand-operated controller comprising: positioning a distal end portion of a surgical instrument adjacent an internal worksite within a patient's body; positioning an image capture device at an arbitrary position relative to the surgical instrument at the internal worksite which differs from an anthropomorphic relative position of eyes of the operator and the controller at an apparent worksite; detecting an actual position of the surgical instrument within the internal worksite; taking a real-time image of the positioned surgical instrument and at least a portion of the internal worksite with the positioned image capture device; processing the real-time image into a processed image for display to the operator at the apparent worksite; and transforming the actual position of the surgical instrument within the real-time image in the internal worksite to a perceived position such that the surgical instrument appears at or adjacent the anthropomorphic relative position to the image capture device in the processed image.
Claim 8
Dependent Claim
42 words
The method of claim 5 further comprising translating an actual orientation of the surgical instrument in the internal worksite to a perceived orientation in the processed image such that the surgical instrument appears to extend directly outward from the image capture device.
Claim 9
Dependent Claim
40 words
The method of claim 5 further comprising positioning the hand-operated controller at the perceived position of the surgical instrument in the processed image such that the surgical instrument appears to be integral with the hand control in the processed image.
Claim 10
Dependent Claim
56 words
The method of claim 5 further comprising directly correlating movement of the hand-operated controller with movement of the surgical instrument in the processed image such that movement of the hand-operated controller relative to the hand-operated controller corresponds to movement of the surgical instrument relative to the actual position of the surgical instrument at the internal worksite.
Claim 11
Dependent Claim
213 words
A telemanipulation surgical system to help an operator perform surgery at a worksite internal to a patient, the surgical system comprising: a surgical instrument; an image capture device for taking a real-time image of the surgical instrument within the internal worksite, wherein said surgical instrument defines an arbitrary position relative to the image capture device; a controller defining an apparent workspace, the controller including: a hand control; an image processor coupled to said image capture device for processing the real-time image into a processed image; a coordinate transformer coupled to the image processor, the coordinate transformer transforming an actual position of the surgical instrument in the real-time image to a perceived position; and an image generator coupled to the image processor for displaying the processed image to the operator; wherein the hand control defines an anthropomorphic position relative to eyes of the operator which is different than the arbitrary position, and wherein the image generator displays the processed image to the eyes of the operator such that the surgical instrument at the perceived position appears coincident with the hand control; and a servomechanism coupling the hand control to the surgical instrument for correlating movements of the hand control in the apparent workspace with the movements of the surgical instrument in the internal worksite.
Claim 12
Dependent Claim
213 words
A telemanipulation surgical system to help an operator perform surgery at a worksite internal to a patient, the surgical system comprising: a surgical instrument; an image capture device for taking a real-time image of the surgical instrument within the internal worksite, wherein said surgical instrument defines an arbitrary position relative to the image capture device; a controller defining an apparent workspace, the controller including: a hand control; an image processor coupled to said image capture device for processing the real-time image into a processed image; a coordinate transformer coupled to the image processor, the coordinate transformer transforming an actual position of the surgical instrument in the real-time image to a perceived position; and an image generator coupled to the image processor for displaying the processed image to the operator; wherein the hand control defines an anthropomorphic position relative to eyes of the operator which is different than the arbitrary position, and wherein the image generator displays the processed image to the eyes of the operator such that the surgical instrument at the perceived position appears coincident with the hand control; and a servomechanism coupling the hand control to the surgical instrument for correlating movements of the hand control in the apparent workspace with the movements of the surgical instrument in the internal worksite.
Claim 13
Dependent Claim
33 words
A surgical system as claimed in claim 9, wherein the image generator is positioned to display the processed image such that the surgical instrument appears integral with the hand control to the operator.
Claim 14
Dependent Claim
72 words
A surgical system as claimed in claim 9, wherein the surgical instrument further defines a first orientation relative to the image capture device, wherein the hand control defines a second orientation relative to the eyes of the operator which is different that the first orientation, and wherein the surgical instrument appears at or near the second orientation in the processed image displayed by the image generator to the eyes of the operator.
References Cited (Backward Citations)
GB2128842A
Cited
US4853874A
Cited
EP0291965A1
Cited
EP0323681A1
Cited
US5305203A
Cited
US5046022A
Cited
EP0411498A2
Cited
US5368015A
Cited
US5339799A
Cited
US5313306A
Cited
US5182641A
Cited
WO1993005479A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-01-11 | 2002-07-13 | 2003-01-12 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-01-11 | 2006-07-13 | 2007-01-12 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-01-11 | 2010-07-13 | 2011-01-12 | $7700.00 | Window Closed / Lapsed |