When Good Disks Go Bad: Dealing with Disk Failures Under LVM (5900-3153, June 2013)

1
When Good Disks Go Bad: Dealing with Disk Failures
Under LVM
Abstract .............................................................................................................................................. 3
Background ........................................................................................................................................ 3
1. Preparing for Disk Recovery .............................................................................................................. 4
Defining a Recovery Strategy............................................................................................................. 4
Using Hot-Swappable Disks ............................................................................................................... 4
Using Alternate Links (PVLinks) ........................................................................................................... 4
LVM Online Disk Replacement (LVM OLR) ........................................................................................... 5
Mirroring Critical Information, Especially the Root Volume Group .......................................................... 5
Creating Recovery Media ................................................................................................................. 6
Other Recommendations for Optimal System Recovery ......................................................................... 6
2. Recognizing a Failing Disk ................................................................................................................ 9
I/O Errors in the System Log.............................................................................................................. 9
Disk Failure Notification Messages from Diagnostics .......................................................................... 10
LVM Command Errors ..................................................................................................................... 10
3. Confirming Disk Failure .................................................................................................................. 12
4. Gathering Information About a Failing Disk ...................................................................................... 15
5. Removing the Disk ......................................................................................................................... 18
Removing a Mirror Copy from a Disk ............................................................................................... 18
Moving the Physical Extents to Another Disk ...................................................................................... 19
Removing the Disk from the Volume Group........................................................................................ 20
Replacing a LVM Disk in an HP Serviceguard Cluster Volume Group .................................................... 25
Disk Replacement Scenarios ............................................................................................................ 25
Disk Replacement Process Flowchart ................................................................................................. 28
Replacing a Mirrored Nonboot Disk ................................................................................................. 31
Replacing an Unmirrored Nonboot Disk............................................................................................ 33
Replacing a Mirrored Boot Disk ....................................................................................................... 36
Disk Replacement Flowchart ............................................................................................................ 39
Conclusion ........................................................................................................................................ 42
Appendix A: Using Device File Types ................................................................................................... 43
Appendix B: Device Special File Naming Model ................................................................................... 44

Summary of content (67 pages)