US6073218A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Methods and apparatus for coordinating shared multiple raid controller access to common storage devices
Assignee: NetApp Inc
•
Filing: 1996-12-23
•
Granted: 2000-06-06
•
Expires: 2016-12-23
Abstract
Abstract Methods and associated apparatus for performing concurrent I/O operations on a common shared subset of disk drives (LUNs) by a plurality of RAID controllers. The methods of the present invention are operable in all of a plurality of RAID controllers to coordinate concurrent access to a shared set of disk drives. In addition to providing redundancy features, the plurality of RAID controllers operable in accordance with the methods of the present invention enhance the performance of a RAID subsystem by better utilizing available processing power among the plurality of RAID controllers. Under the methods of the present invention, each of a plurality of RAID controllers may actively process different I/O requests on a common shared subset of disk drives. One of the plurality of controllers is designated as primary with respect to a particular shared subset of disk drives. The plurality of RAID controllers then exchange messages over a communication medium to coordinate concurrent access to the shared subset of disk drives through the primary controller. The messages exchanged include semaphore lock and release requests to coordinate exclusive access during critical operations as well as cache and meta-cache data to maintain cache coherency between the plurality of the RAID controllers with respect to the common shared subset of disk drives. These messages are exchanged via any of several well known communication mediums including, a shared memory common to the plurality of controllers and the communication bus connecting the shared subset of disk drives to each of the plurality of controllers.
Inventors
- 👤 Rodney A. DeKoning
- 👤 Gerald J. Fredin
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-01 05:34
CPC Classifications
G; G06; G06F; G06F11/00; G06F11/07; G06F11/16; G06F11/1666; G06F12/00; G06F12/02; G06F12/08; G06F12/0802; G06F12/0806; G06F12/0815; G06F9/00; G06F9/06; G06F9/46; G06F9/52; G06F11/20; G06F12/0866
Claims Analysis
Total Claims: 40
Claim 1
Independent Claim
105 words
In a system including a plurality of RAID control modules connected to a common shared LUN in a RAID storage subsystem, a method operable within said plurality of RAID control modules for coordinating exclusive access by said plurality of control modules to said common shared LUN comprising the steps of: designating one of said plurality of RAID control modules as a primary control module; and exchanging access coordination messages between said primary control module and others of said plurality of RAID control modules to coordinate temporary exclusive access by one of said plurality of RAID control modules to identified stripes within said common shared LUN.
Claim 2
Dependent Claim
105 words
In a system including a plurality of RAID control modules connected to a common shared LUN in a RAID storage subsystem, a method operable within said plurality of RAID control modules for coordinating exclusive access by said plurality of control modules to said common shared LUN comprising the steps of: designating one of said plurality of RAID control modules as a primary control module; and exchanging access coordination messages between said primary control module and others of said plurality of RAID control modules to coordinate temporary exclusive access by one of said plurality of RAID control modules to identified stripes within said common shared LUN.
Claim 3
Dependent Claim
81 words
The method of claim 1 wherein the step of exchanging access coordination messages includes the steps of: generating, within one of said others of said plurality of RAID control modules, an exclusive access request message; transmitting said exclusive access request message to said primary control module; and awaiting receipt by said one of said others of said plurality of RAID control modules of an exclusive access grant message from said primary control module granting exclusive access to said common shared LUN.
Claim 4
Dependent Claim
92 words
The method of claim 2 wherein the step of exchanging access coordination messages further includes the steps of: receiving, within said primary control module, said exclusive access request message; awaiting availability of exclusive access to said common shared LUN in response to receipt of said exclusive access request message; generating, within said primary control module, said exclusive access grant message in response to availability of exclusive access to said common shared LUN; and transmitting said exclusive access grant message to said one of said others of said plurality of RAID control modules.
Claim 5
Dependent Claim
57 words
The method of claim 3 wherein said exclusive access request message identifies a portion of said common shared LUN for which exclusive access is desired and wherein the step of awaiting availability comprises the step of awaiting availability of exclusive access to the portion of said common shared LUN identified by the received exclusive access request message.
Claim 6
Dependent Claim
83 words
The method of claim 4 wherein said primary control module is associated with at least one semaphore and wherein the step of awaiting availability includes the steps of: determining that none of said at least one semaphore is associated with said portion of said common shared LUN; associating one of said at least one semaphore with said portion in response to the determination none of said at least one semaphore is associated with said portion; and locking the semaphore associated with said portion.
Claim 7
Dependent Claim
49 words
The method of claim 3 wherein the step of exchanging access coordination messages further includes the steps of: generating, within said one of said others of said plurality of RAID control modules, an exclusive access release message; and transmitting said exclusive access release message to said primary control module.
Claim 8
Dependent Claim
48 words
The method of claim 6 wherein the step of exchanging access coordination messages further includes the steps of: receiving, within said primary control module, said exclusive access release message; and releasing exclusive access to said common shared LUN in response to receipt of said exclusive access release message.
Claim 9
Dependent Claim
57 words
The method of claim 7 wherein said exclusive access request message identifies a portion of said common shared LUN for which exclusive access is desired and wherein the step of awaiting availability comprises the step of awaiting availability of exclusive access to the portion of said common shared LUN identified by the received exclusive access request message.
Claim 10
Dependent Claim
62 words
The method of claim 8 wherein said primary control module is associated with at least one semaphore and wherein the step of releasing exclusive access includes the steps of: determining, within said primary control module, which of said at least one semaphore was previously associated with said portion of said common shared LUN; and unlocking the semaphore previously associated with said portion.
Claim 11
Dependent Claim
61 words
The method of claim 1 wherein each of said plurality of RAID control modules is associated with a cache memory subsystem and wherein the method further comprises the step of: exchanging cache coherency messages among said plurality of RAID control modules to maintain coherency of data in said cache memory subsystem associated with each of said plurality of RAID control modules.
Claim 12
Dependent Claim
27 words
The method of claim 10 wherein said cache coherency messages include cache data generated in response to processing of an I/O request from an attached host computer.
Claim 13
Dependent Claim
89 words
The method of claim 10 wherein the step of exchanging cache coherency messages includes the steps of: generating, within one of said others of said plurality of RAID control modules having a local cache memory, a cache update permission request message; transmitting said cache update permission request message to said primary control module; and awaiting receipt by said one of said others of said plurality of RAID control modules of a cache update permission grant message from said primary control module granting permission to update said local cache memory.
Claim 14
Dependent Claim
93 words
The method of claim 12 wherein the step of exchanging cache coherency messages further includes the steps of: receiving, within said primary control module, said cache update permission request message; invalidating local cache memory in said others of said plurality of RAID control modules in response to receiving said cache update permission request message; generating, within said primary control module, said cache update permission grant message in response to invalidating local cache memory; and transmitting said exclusive access grant message to said one of said others of said plurality of RAID control modules.
Claim 15
Dependent Claim
166 words
The method of claim 13 wherein said cache update permission request message identifies a portion of said common shared LUN for which update of said local cache memory update is requested and wherein the step of invalidating comprises the step of: for each of said others of said plurality of RAID control modules performing the steps of: determining whether said each of said others of said plurality of RAID control modules have portions of its respective local cache memory corresponding to said portion of said common shared LUN; generating a cache invalidate message identifying said portion of said respective local cache memory in response to the determination that said each of said others of said plurality of RAID control modules has a portion of its respective local cache memory corresponding to said portion of said common shared LUN; and transmitting said cache invalidate message to said each of said others of said plurality of RAID control modules in response to generation of said cache invalidate message.
Claim 16
Dependent Claim
53 words
The method of claim 14 wherein the step of invalidating further comprises the steps of: receiving, within said each of said others of said RAID control modules, said cache invalidate message; and invalidating the identified portion of said respective local cache memory within said each of said others of said RAID control modules.
Claim 17
Dependent Claim
145 words
In a system including a plurality of storage control modules connected to a common shared set of storage devices in a storage subsystem, a method operable within said plurality of storage control modules for processing I/O requests directed to said common shared set of storage devices comprising the steps of: designating one of said plurality of storage control modules as a primary control modules; receiving a plurality of I/O requests from attached host computer systems; coordinating temporary exclusive access to identified stripes within said common shared set of storage devices by said distinct control modules, wherein the step of coordinating includes the step of: exchanging exclusive access messages between said primary control module and others of said plurality of storage control modules; and processing each of said plurality of I/O requests substantially in parallel within distinct control modules of said plurality of storage control modules.
Claim 18
Dependent Claim
145 words
In a system including a plurality of storage control modules connected to a common shared set of storage devices in a storage subsystem, a method operable within said plurality of storage control modules for processing I/O requests directed to said common shared set of storage devices comprising the steps of: designating one of said plurality of storage control modules as a primary control modules; receiving a plurality of I/O requests from attached host computer systems; coordinating temporary exclusive access to identified stripes within said common shared set of storage devices by said distinct control modules, wherein the step of coordinating includes the step of: exchanging exclusive access messages between said primary control module and others of said plurality of storage control modules; and processing each of said plurality of I/O requests substantially in parallel within distinct control modules of said plurality of storage control modules.
Claim 19
Dependent Claim
69 words
The method of claim 16: wherein said exclusive access messages include exclusive access request messages directed from said distinct control modules to said primary control module, wherein said exclusive access messages include exclusive access grant messages directed from said primary control module to said distinct control modules, and wherein said exclusive access messages include exclusive access release messages directed from said distinct control modules to said primary control module.
Claim 20
Dependent Claim
61 words
The method of claim 16 wherein each of said plurality of storage control modules is associated with a cache memory subsystem and wherein the step of coordinating includes the step of: exchanging cache information among said plurality of storage control modules to maintain coherency of information stored in said cache memory associated with each of said plurality of storage control modules.
Claim 21
Dependent Claim
114 words
A program storage device readable by a computer, tangibly embodying a program or instructions executable by computers in a plurality of RAID control modules connected to a common shared LUN in a RAID storage subsystem to perform the method steps for coordinating exclusive access by said plurality of control modules to said common shared LUN, said method steps comprising: designating one of said plurality of RAID control modules as a primary control module; and exchanging access coordination messages between said primary control module and others of said plurality of RAID control modules to coordinate temporary exclusive access by one of said plurality of RAID control modules to identified stripes within said common shared LUN.
Claim 22
Dependent Claim
114 words
A program storage device readable by a computer, tangibly embodying a program or instructions executable by computers in a plurality of RAID control modules connected to a common shared LUN in a RAID storage subsystem to perform the method steps for coordinating exclusive access by said plurality of control modules to said common shared LUN, said method steps comprising: designating one of said plurality of RAID control modules as a primary control module; and exchanging access coordination messages between said primary control module and others of said plurality of RAID control modules to coordinate temporary exclusive access by one of said plurality of RAID control modules to identified stripes within said common shared LUN.
Claim 23
Dependent Claim
84 words
The program storage device of claim 19 wherein the method step of exchanging access coordination messages includes the steps of: generating, within one of said others of said plurality of RAID control modules, an exclusive access request message; transmitting said exclusive access request message to said primary control module; and awaiting receipt by said one of said others of said plurality of RAID control modules of an exclusive access grant message from said primary control module granting exclusive access to said common shared LUN.
Claim 24
Dependent Claim
95 words
The program storage device of claim 20 wherein the method step of exchanging access coordination messages further includes the steps of: receiving, within said primary control module, said exclusive access request message; awaiting availability of exclusive access to said common shared LUN in response to receipt of said exclusive access request message; generating, within said primary control module, said exclusive access grant message in response to availability of exclusive access to said common shared LUN; and transmitting said exclusive access grant message to said one of said others of said plurality of RAID control modules.
Claim 25
Dependent Claim
60 words
The program storage device of claim 21 wherein said exclusive access request message identifies a portion of said common shared LUN for which exclusive access is desired and wherein the method step of awaiting availability comprises the step of awaiting availability of exclusive access to the portion of said common shared LUN identified by the received exclusive access request message.
Claim 26
Dependent Claim
86 words
The program storage device of claim 22 wherein said primary control module is associated with at least one semaphore and wherein the method step of awaiting availability includes the steps of: determining that none of said at least one semaphore is associated with said portion of said common shared LUN; associating one of said at least one semaphore with said portion in response to the determination none of said at least one semaphore is associated with said portion; and locking the semaphore associated with said portion.
Claim 27
Dependent Claim
52 words
The program storage device of claim 21 wherein the method step of exchanging access coordination messages further includes the steps of: generating, within said one of said others of said plurality of RAID control modules, an exclusive access release message; and transmitting said exclusive access release message to said primary control module.
Claim 28
Dependent Claim
51 words
The program storage device of claim 24 wherein the method step of exchanging access coordination messages further includes the steps of: receiving, within said primary control module, said exclusive access release message; and releasing exclusive access to said common shared LUN in response to receipt of said exclusive access release message.
Claim 29
Dependent Claim
60 words
The program storage device of claim 25 wherein said exclusive access request message identifies a portion of said common shared LUN for which exclusive access is desired and wherein the method step of awaiting availability comprises the step of awaiting availability of exclusive access to the portion of said common shared LUN identified by the received exclusive access request message.
Claim 30
Dependent Claim
65 words
The program storage device of claim 26 wherein said primary control module is associated with at least one semaphore and wherein the method step of releasing exclusive access includes the steps of: determining, within said primary control module, which of said at least one semaphore was previously associated with said portion of said common shared LUN; and unlocking the semaphore previously associated with said portion.
Claim 31
Dependent Claim
63 words
The program storage device of claim 19 wherein each of said plurality of RAID control modules is associated with a cache memory subsystem and wherein the method further comprises the step of: exchanging cache coherency messages among said plurality of RAID control modules to maintain coherency of data in said cache memory subsystem associated with each of said plurality of RAID control modules.
Claim 32
Dependent Claim
29 words
The program storage device of claim 28 wherein said cache coherency messages include cache data generated in response to processing of an I/O request from an attached host computer.
Claim 33
Dependent Claim
92 words
The program storage device of claim 28 wherein the method step of exchanging cache coherency messages includes the steps of: generating, within one of said others of said plurality of RAID control modules having a local cache memory, a cache update permission request message; transmitting said cache update permission request message to said primary control module; and awaiting receipt by said one of said others of said plurality of RAID control modules of a cache update permission grant message from said primary control module granting permission to update said local cache memory.
Claim 34
Dependent Claim
96 words
The program storage device of claim 30 wherein the method step of exchanging cache coherency messages further includes the steps of: receiving, within said primary control module, said cache update permission request message; invalidating local cache memory in said others of said plurality of RAID control modules in response to receiving said cache update permission request message; generating, within said primary control module, said cache update permission grant message in response to invalidating local cache memory; and transmitting said exclusive access grant message to said one of said others of said plurality of RAID control modules.
Claim 35
Dependent Claim
169 words
The program storage device of claim 31 wherein said cache update permission request message identifies a portion of said common shared LUN for which update of said local cache memory update is requested and wherein the method step of invalidating comprises the step of: for each of said others of said plurality of RAID control modules performing the steps of: determining whether said each of said others of said plurality of RAID control modules have portions of its respective local cache memory corresponding to said portion of said common shared LUN; generating a cache invalidate message identifying said portion of said respective local cache memory in response to the determination that said each of said others of said plurality of RAID control modules has a portion of its respective local cache memory corresponding to said portion of said common shared LUN; and transmitting said cache invalidate message to said each of said others of said plurality of RAID control modules in response to generation of said cache invalidate message.
Claim 36
Dependent Claim
56 words
The program storage device of claim 32 wherein the method step of invalidating further comprises the steps of: receiving, within said each of said others of said RAID control modules, said cache invalidate message; and invalidating the identified portion of said respective local cache memory within said each of said others of said RAID control modules.
Claim 37
Dependent Claim
154 words
A program storage device readable by a computer, tangibly embodying a program or instructions executable by computers in a plurality of storage control modules connected to a common shared set of storage devices in a storage subsystem to perform the method steps for processing I/O requests directed to said common shared set of storage devices, said method steps comprising: designating one of said plurality of storage control modules as a primary control modules; receiving a plurality of I/O requests from attached host computer systems; coordinating temporary exclusive access to identified stripes within said common shared set of storage devices by said distinct control modules, wherein the step of coordinating includes the step of: exchanging exclusive access messages between said primary control module and others of said plurality of storage control modules; and processing each of said plurality of I/O requests substantially in parallel within distinct control modules of said plurality of storage control modules.
Claim 38
Dependent Claim
154 words
A program storage device readable by a computer, tangibly embodying a program or instructions executable by computers in a plurality of storage control modules connected to a common shared set of storage devices in a storage subsystem to perform the method steps for processing I/O requests directed to said common shared set of storage devices, said method steps comprising: designating one of said plurality of storage control modules as a primary control modules; receiving a plurality of I/O requests from attached host computer systems; coordinating temporary exclusive access to identified stripes within said common shared set of storage devices by said distinct control modules, wherein the step of coordinating includes the step of: exchanging exclusive access messages between said primary control module and others of said plurality of storage control modules; and processing each of said plurality of I/O requests substantially in parallel within distinct control modules of said plurality of storage control modules.
Claim 39
Dependent Claim
71 words
The program storage device of claim 34: wherein said exclusive access messages include exclusive access request messages directed from said distinct control modules to said primary control module, wherein said exclusive access messages include exclusive access grant messages directed from said primary control module to said distinct control modules, and wherein said exclusive access messages include exclusive access release messages directed from said distinct control modules to said primary control module.
Claim 40
Dependent Claim
64 words
The program storage device of claim 34 wherein each of said plurality of storage control modules is associated with a cache memory subsystem and wherein the method step of coordinating includes the step of: exchanging cache information among said plurality of storage control modules to maintain coherency of information stored in said cache memory associated with each of said plurality of storage control modules.
References Cited (Backward Citations)
DE645702C
Cited
US3702006A
Cited
US5764922A
Cited
US5148432A
Cited
US5101492A
Cited
US5249279A
Cited
US5210860A
Cited
US5440743A
Cited
EP0493984A2
Cited
US5434970A
Cited
US5317731A
Cited
US5715447A
Cited
EP0551718A2
Cited
US5379417A
Cited
US5546535A
Cited
US5666511A
Cited
US5388108A
Cited
US5603062A
Cited
US5495601A
Cited
US5459864A
Cited
US5455934A
Cited
US5367669A
Cited
US5331476A
Cited
US5386324A
Cited
US5548711A
Cited
US5535365A
Cited
WO1995013583A1
Cited
US5446855A
Cited
EP0707269A1
Cited
US5682537A
Cited
US5694571A
Cited
US5678026A
Cited
US5787304A
Cited
US5761705A
Cited
US5845292A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-06-06 | 2003-12-06 | 2004-06-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-06-06 | 2007-12-06 | 2008-06-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-06-06 | 2011-12-06 | 2012-06-06 | $7700.00 | Window Closed / Lapsed |