Exadata关于磁盘部分,新增加了lun,celldisk,griddisk的概念,这里简单介绍一下,如下图:

Exadata 删除,添加物理磁盘过程

我们可以看到一个物理硬盘添加到Cell之后,会自动创建LUN,LUN对应的是创建一个celldisk,一个celldisk对应一个或者多个griddisk,而griddisk就可以提供给ASM实例使用了。

这里我主要记录一下我在将一个正在运行的Exadata机器, 它的一个磁盘正常删除并添加的完整过程。
(这里强调一下“CellCLI>”都是在Cell上执行的命令,“SQL>” 都是在compute node(既数据库节点)上执行的命令)

1.首先要确定我需要删除的硬盘的LUN的位置,celldisk名字,通过下面命令可以查询


  1. CellCLI>  LIST CELLDISK WHERE name LIKE 'CD_03.*' detail  
  2.          name:                   CD_03_dmorlcel08                    <<<<<<<<< celldisk名字  
  3.          comment:  
  4.          creationTime:           2012-04-20T04:37:54-04:00  
  5.          deviceName:             /dev/sdd  
  6.          devicePartition:        /dev/sdd  
  7.          diskType:               HardDisk  
  8.          errorCount:             0  
  9.          freeSpace:              0  
  10.          id:                     772cc8b1-ca81-468e-8b65-16e2724ef4da  
  11.          interleaving:           none  
  12.          lun:                    0_3                                  <<<<<<<<< 在0_3 这个LUN                           
  13.          raidLevel:              0  
  14.          size:                   557.859375G  
  15.          status:                 normal 

2.查询griddisk的信息,这个可以找到asm中的disk name,以及diskgroup的name。
通过这个命令还可以看到这个celldisk对应三个griddisk。


  1. CellCLI> LIST GRIDDISK WHERE cellDisk LIKE 'CD_03.*' detail  
  2.          name:                   DATA_CD_03_dmorlcel08  
  3.          asmDiskGroupName:       DATA  
  4.          asmDiskName:            DATA_CD_03_DMORLCEL08  <<<<<<<<<<<<<<<<<<<<<<<<<ASM disk name  
  5.          availableTo:  
  6.          cellDisk:               CD_03_dmorlcel08  
  7.          comment:  
  8.          creationTime:           2012-04-20T04:39:48-04:00  
  9.          diskType:               HardDisk  
  10.          errorCount:             0  
  11.          id:                     524f59b3-32af-4926-bc40-bf094d05a71d  
  12.          offset:                 32M  
  13.          size:                   423G  
  14.          status:                 active 
  15.  
  16.          name:                   DBFS_DG_CD_03_dmorlcel08  
  17.          asmDiskGroupName:       DBFS_DG  
  18.          asmDiskName:            DBFS_DG_CD_03_DMORLCEL08  <<<<<<<<<<<<<<<<<<<<<<<<<ASM disk name  
  19.          availableTo:  
  20.          cellDisk:               CD_03_dmorlcel08  
  21.          comment:  
  22.          creationTime:           2012-04-20T04:57:22-04:00  
  23.          diskType:               HardDisk  
  24.          errorCount:             0  
  25.          id:                     001ef1df-5d41-4fab-b1ad-5a8983a63b8c  
  26.          offset:                 528.734375G  
  27.          size:                   29.125G  
  28.          status:                 active 
  29.  
  30.          name:                   RECO_CD_03_dmorlcel08  
  31.          asmDiskGroupName:       RECO                       <<<<<<<<<<<<<<<<<<<<<<<<<ASM diskgroup name  
  32.          asmDiskName:            RECO_CD_03_DMORLCEL08      <<<<<<<<<<<<<<<<<<<<<<<<<ASM disk name  
  33.          availableTo:  
  34.          cellDisk:               CD_03_dmorlcel08  
  35.          comment:  
  36.          creationTime:           2012-04-20T04:56:28-04:00  
  37.          diskType:               HardDisk  
  38.          errorCount:             0  
  39.          id:                     544c54c0-2969-4ad3-bea0-f3e2b4f1bf31  
  40.          offset:                 423.046875G  
  41.          size:                   105.6875G  
  42.          status:                 active 

3.通过ASM实例查询磁盘信息


  1. $more  /etc/oratab  
  2. #Backup file is  /u01/app/oracle/product/11.2.0.3/db_home1/srvm/admin/oratab.bak.dmorldb05 line added by Agent  
  3. +ASM1:/u01/app/11.2.0.3/grid:N          # line added by Agent 
  4.  
  5. $ export ORACLE_SID=+ASM1  
  6. $ export ORACLE_HOME=/u01/app/11.2.0.3/grid  
  7. $ sqlplus / as sysasm  
  8. SQL> set line 400  
  9. SQL> select GROUP_NUMBER,DISK_NUMBER,LABEL,NAME,MOUNT_STATUS,state,FAILGROUP,MODE_STATUS,PATH from v$asm_disk where name='RECO_CD_03_DMORLCEL08';    <<<<<<<disk name need to correct 
  10.  
  11. GROUP_NUMBER DISK_NUMBER LABEL                           NAME                           PATH  
  12. ------------ ----------- ------------------------------- ------------------------------   
  13.            4          10 RECO_CD_03_DMORLCEL08           RECO_CD_03_DMORLCEL08          o/192.168.10.16/RECO_CD_03_dmorlcel08 
  14.  
  15. 查询对应的磁盘组  
  16. SQL>  select GROUP_NUMBER,NAME from v$asm_diskgroup;      <<<<<determine the diskgroup number 
  17.  
  18. GROUP_NUMBER NAME  
  19. ------------ ------------------------------  
  20.           1 DATA  
  21.           2 DBFS_DG  
  22.           4 RECO  
  23. SQL> select NAME,ALLOCATION_UNIT_SIZE,STATE,TOTAL_MB,OFFLINE_DISKS,TOTAL_MB,FREE_MB,REQUIRED_MIRROR_FREE_MB from v$asm_diskgroup; 

4.下面开始我们的删除操作,如果删除celldisk,首先应该从最上层,ASM层面开始删除磁盘


  1. SQL> alter diskgroup RECO drop disk RECO_CD_03_DMORLCEL08 REBALANCE power 8;  
  2. SQL> alter diskgroup DBFS_DG drop disk DBFS_DG_CD_03_DMORLCEL08 REBALANCE power 8;  
  3. SQL> alter diskgroup DATA drop disk DATA_CD_03_DMORLCEL08 REBALANCE power 8; 

5.删除的过程中,通过这个命令查收reblance进度,确保ASM删除磁盘的动作完成,再进行下一步操作。


  1. SQL> set line 200  
  2. SQL> select * from v$asm_operation; 
  3.  
  4. GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE  EST_MINUTES ERROR_CODE  
  5. ------------ ----- ---- ---------- ---------- ---------- ---------- ----------  
  6.            1 REBAL RUN           8          8      58593     207611       7586    19  
  7. SQL> / 
  8.  
  9. GROUP_NUMBER OPERA STAT      POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE   EST_MINUTES ERROR_CODE  
  10. ------------ ----- ---- ---------- ---------- ---------- ---------- ----------  
  11.            1 REBAL RUN           8          8      58856     207656       7643    19 
  12.  
  13. SQL> / 
  14.  
  15. no rows selected     <<<<<<<<<<<<表示reblance已经完成 

6.ASM中删除掉DBFS_DG_CD_03_DMORLCEL08磁盘后,通过griddisk命令查询,发现对应的asmDiskName,asmDiskGroupName,已经没有值了。


  1. CellCLI> list GRIDDISK DBFS_DG_CD_03_DMORLCEL08 detail  
  2.          name:                   DBFS_DG_CD_03_dmorlcel08  
  3.          asmDiskGroupName:  
  4.          asmDiskName:  
  5.          availableTo:  
  6.          cellDisk:               CD_03_dmorlcel08  
  7.          comment:  
  8.          creationTime:           2012-04-20T04:57:22-04:00  
  9.          diskType:               HardDisk  
  10.          errorCount:             0  
  11.          id:                     001ef1df-5d41-4fab-b1ad-5a8983a63b8c  
  12.          offset:                 528.734375G  
  13.          size:                   29.125G  
  14.          status:                 active  

7.删除griddisk,并查询,发现已经查询不到griddisk DBFS_DG_CD_03_DMORLCEL08的信息


  1. CellCLI> DROP GRIDDISK DBFS_DG_CD_03_DMORLCEL08;  
  2. GridDisk DBFS_DG_CD_03_dmorlcel08 successfully dropped 
  3.  
  4. CellCLI> list GRIDDISK DBFS_DG_CD_03_DMORLCEL08 detail 
  5.  
  6. CELL-02007: Grid disk does not exist: DBFS_DG_CD_03_DMORLCEL08 
  7.  
  8. CellCLI>  LIST gridDISK WHERE cellDisk LIKE '.*CD_03.*' detail  
  9.          name:                   DATA_CD_03_dmorlcel08  
  10.          asmDiskGroupName:       DATA  
  11.          asmDiskName:            DATA_CD_03_DMORLCEL08  
  12.          availableTo:  
  13.          cellDisk:               CD_03_dmorlcel08  
  14.          comment:  
  15.          creationTime:           2012-04-20T04:39:48-04:00  
  16.          diskType:               HardDisk  
  17.          errorCount:             0  
  18.          id:                     524f59b3-32af-4926-bc40-bf094d05a71d  
  19.          offset:                 32M  
  20.          size:                   423G  
  21.          status:                 active 
  22.  
  23.          name:                   RECO_CD_03_dmorlcel08  
  24.          asmDiskGroupName:  
  25.          asmDiskName:  
  26.          availableTo:  
  27.          cellDisk:               CD_03_dmorlcel08  
  28.          comment:  
  29.          creationTime:           2012-04-20T04:56:28-04:00  
  30.          diskType:               HardDisk  
  31.          errorCount:             0  
  32.          id:                     544c54c0-2969-4ad3-bea0-f3e2b4f1bf31  
  33.          offset:                 423.046875G  
  34.          size:                   105.6875G  
  35.          status:                 active 

8.继续删除RECO_CD_03_dmorlcel08并查询


  1. CellCLI> DROP GRIDDISK RECO_CD_03_dmorlcel08;  
  2. GridDisk RECO_CD_03_dmorlcel08 successfully dropped 
  3.  
  4. CellCLI> LIST gridDISK WHERE cellDisk LIKE '.*CD_03.*' detail  
  5.          name:                   DATA_CD_03_dmorlcel08  
  6.          asmDiskGroupName:       DATA  
  7.          asmDiskName:            DATA_CD_03_DMORLCEL08  
  8.          availableTo:  
  9.          cellDisk:               CD_03_dmorlcel08  
  10.          comment:  
  11.          creationTime:           2012-04-20T04:39:48-04:00  
  12.          diskType:               HardDisk  
  13.          errorCount:             0  
  14.          id:                     524f59b3-32af-4926-bc40-bf094d05a71d  
  15.          offset:                 32M  
  16.          size:                   423G  
  17.          status:                 active 

9.继续删除DATA_CD_03_DMORLCEL08,并查询


  1. CellCLI> DROP GRIDDISK DATA_CD_03_DMORLCEL08  
  2. GridDisk DATA_CD_03_dmorlcel08 successfully dropped 
  3.  
  4. CellCLI>  LIST gridDISK WHERE cellDisk LIKE '.*CD_03.*' detail 
  5.  
  6. CellCLI>  LIST CELLDISK WHERE name LIKE 'CD_03.*' detail  
  7.          name:                   CD_03_dmorlcel08  
  8.          comment:  
  9.          creationTime:           2012-04-20T04:37:54-04:00  
  10.          deviceName:             /dev/sdd  
  11.          devicePartition:        /dev/sdd  
  12.          diskType:               HardDisk  
  13.          errorCount:             0  
  14.          freeSpace:              557.8125G  
  15.          freeSpaceMap:           offset=32M,size=19.96875G  
  16.                                  offset=20.015625G,size=537.84375G  
  17.          id:                     772cc8b1-ca81-468e-8b65-16e2724ef4da  
  18.          interleaving:           none  
  19.          lun:                    0_3  
  20.          raidLevel:              0  
  21.          size:                   557.859375G  
  22.          status:                 normal 
  23.  
  24. CellCLI>  LIST CELLDISK WHERE name LIKE 'CD_03.*' detail  
  25.          name:                   CD_03_dmorlcel08  
  26.          comment:  
  27.          creationTime:           2012-04-20T04:37:54-04:00  
  28.          deviceName:             /dev/sdd  
  29.          devicePartition:        /dev/sdd  
  30.          diskType:               HardDisk  
  31.          errorCount:             0  
  32.          freeSpace:              557.8125G  
  33.          freeSpaceMap:           offset=32M,size=19.96875G  
  34.                                  offset=20.015625G,size=537.84375G  
  35.          id:                     772cc8b1-ca81-468e-8b65-16e2724ef4da  
  36.          interleaving:           none  
  37.          lun:                    0_3  
  38.          raidLevel:              0  
  39.          size:                   557.859375G  
  40.          status:                 normal 
  41.  
  42. CellCLI> drop celldisk CD_03_dmorlcel08  
  43. CellDisk CD_03_dmorlcel08 successfully dropped 

10.删除celldisk,并查询LUN信息


  1. CellCLI>  LIST CELLDISK WHERE name LIKE 'CD_03.*' detail 
  2.  
  3. CellCLI> LIST LUN 0_3 DETAIL  
  4.          name:                   0_3  
  5.          cellDisk:  
  6.          deviceName:             /dev/sdd  
  7.          diskType:               HardDisk  
  8.          id:                     0_3  
  9.          isSystemLun:            FALSE  
  10.          lunAutoCreate:          FALSE  
  11.          lunSize:                557.861328125G  
  12.          lunUID:                 0_3  
  13.          physicalDrives:         28:3  
  14.          raidLevel:              0  
  15.          lunWriteCacheMode:      "WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU"  
  16.          status:                 normal  
  17. 比较一个正常的LUN信息  
  18. CellCLI> LIST LUN 0_4 DETAIL  
  19.          name:                   0_4  
  20.          cellDisk:               CD_04_dmorlcel08      <<<<<<<  
  21.          deviceName:             /dev/sde  
  22.          diskType:               HardDisk  
  23.          id:                     0_4  
  24.          isSystemLun:            FALSE  
  25.          lunAutoCreate:          FALSE  
  26.          lunSize:                557.861328125G  
  27.          lunUID:                 0_4  
  28.          physicalDrives:         28:4  
  29.          raidLevel:              0  
  30.          lunWriteCacheMode:      "WriteBack, ReadAheadNone, Direct, No Write Cache if Bad BBU"  
  31.          status:                 normal 

11.在删除完成后,我们要开始添加的过程,实际troubleshooting中,会遇到Exadata在磁盘更换完成后,并没有正常的创建celldisk和griddisk,我们需要手动创建celldisk和griddisk。

手动创建之前,我们需要查询physicaldisk状态,确认physicalSerial和你更换的磁盘是对应的


  1. CellCLI> list physicaldisk where luns=0_3 detail  
  2.          name:                   28:3  
  3.          deviceId:               24  
  4.          diskType:               HardDisk  
  5.          enclosureDeviceId:      28  
  6.          errMediaCount:          0  
  7.          errOtherCount:          0  
  8.          foreignState:           false  
  9.          luns:                   0_3  
  10.          makeModel:              "SEAGATE ST360057SSUN600G"  
  11.          physicalFirmware:       0A25  
  12.          physicalInsertTime:     2012-01-20T15:57:20-05:00  
  13.          physicalInterface:      sas  
  14.          physicalSerial:         E12EQY  
  15.          physicalSize:           558.9109999993816G  
  16.          slotNumber:             3  
  17.          status:                 normal 

12.创建celldisk,根据前面的信息,确认需要创建的celldisk与LUN能准确的匹配上,不要写错


  1. CellCLI>  create celldisk CD_03_dmorlcel08 lun=0_4(如果没有正确匹配,会遇到如下错误) 
  2.  
  3. CELL-04527: Cannot complete the creation of cell disk CD_03_dmorlcel08. Received error: CELL-04522: The LUN 0_4 has a valid celldisk.  
  4. Cell disks are not created: CD_03_dmorlcel08 
  5.  
  6. 成功创建  
  7. CellCLI>  create celldisk CD_03_dmorlcel08 lun=0_3  
  8. CellDisk CD_03_dmorlcel08 successfully created 

14.首先查询一个正常的磁盘,确认后续需要设置的信息,如name,size,offset


  1. CellCLI> list griddisk where celldisk=CD_04_dmorlcel08 attributes name,size,offset  
  2.          DATA_CD_04_dmorlcel08           423G            32M  
  3.          DBFS_DG_CD_04_dmorlcel08        29.125G         528.734375G  
  4.          RECO_CD_04_dmorlcel08           105.6875G       423.046875G 

15.创建griddisk磁盘


  1. CellCLI> create griddisk DATA_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=423G  
  2. CellCLI> create griddisk DBFS_DG_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=29.125G 
  3. CellCLI> create griddisk RECO_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=105.6875G 
  4.  
  5. 下面是执行的记录,以及查询结果  
  6. CellCLI>  create celldisk CD_03_dmorlcel08 lun=0_3  
  7. CellDisk CD_03_dmorlcel08 successfully created 
  8.  
  9. CellCLI> create griddisk DATA_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=423G  
  10. GridDisk DATA_CD_03_dmorlcel08 successfully created 
  11.  
  12. CellCLI> create griddisk DBFS_DG_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=29.125G 
  13. GridDisk DBFS_DG_CD_03_dmorlcel08 successfully created 
  14.  
  15. CellCLI> create griddisk RECO_CD_03_dmorlcel08 celldisk=CD_03_dmorlcel08,size=105.6875G  
  16. GridDisk RECO_CD_03_dmorlcel08 successfully created 
  17.  
  18. 可以查询到celldisk信息  
  19. CellCLI> LIST CELLDISK WHERE name LIKE 'CD_03.*' detail  
  20.          name:                   CD_03_dmorlcel08  
  21.          comment:  
  22.          creationTime:           2013-02-07T02:13:17-05:00  
  23.          deviceName:             /dev/sdd  
  24.          devicePartition:        /dev/sdd  
  25.          diskType:               HardDisk  
  26.          errorCount:             0  
  27.          freeSpace:              0  
  28.          id:                     2f3e651e-6fb6-47e7-a227-692645519ce4  
  29.          interleaving:           none  
  30.          lun:                    0_3  
  31.          raidLevel:              0  
  32.          size:                   557.859375G  
  33.          status:                 normal 
  34.  
  35. 可以查询到griddisk信息  
  36. CellCLI> LIST gridDISK WHERE cellDisk LIKE '.*CD_03.*' detail  
  37.          name:                   DATA_CD_03_dmorlcel08  
  38.          availableTo:  
  39.          cellDisk:               CD_03_dmorlcel08  
  40.          comment:  
  41.          creationTime:           2013-02-07T02:14:17-05:00  
  42.          diskType:               HardDisk  
  43.          errorCount:             0  
  44.          id:                     6f9cb08e-fd8f-4063-b902-439387237f5d  
  45.          offset:                 32M  
  46.          size:                   423G  
  47.          status:                 active 
  48.  
  49.          name:                   DBFS_DG_CD_03_dmorlcel08  
  50.          availableTo:  
  51.          cellDisk:               CD_03_dmorlcel08  
  52.          comment:  
  53.          creationTime:           2013-02-07T02:14:26-05:00  
  54.          diskType:               HardDisk  
  55.          errorCount:             0  
  56.          id:                     055710ce-216a-4b10-a215-b38763ea65df  
  57.          offset:                 423.046875G  
  58.          size:                   29.125G  
  59.          status:                 active 
  60.  
  61.          name:                   RECO_CD_03_dmorlcel08  
  62.          availableTo:  
  63.          cellDisk:               CD_03_dmorlcel08  
  64.          comment:  
  65.          creationTime:           2013-02-07T02:14:33-05:00  
  66.          diskType:               HardDisk  
  67.          errorCount:             0  
  68.          id:                     fdf9a255-0a0d-4152-a557-de80b112ddff  
  69.          offset:                 452.171875G  
  70.          size:                   105.6875G  
  71.          status:                 active 
  72.  
  73. CellCLI> list griddisk where celldisk=CD_03_dmorlcel08 attributes name,size,offset  
  74.          DATA_CD_03_dmorlcel08              423G            32M  
  75.          DBFS_DG_CD_03_dmorlcel08        29.125G         423.046875G  
  76.          RECO_CD_03_dmorlcel08              105.6875G       452.171875G 

16.如果磁盘没有删除的情况下,需要force再次删除一下,但是我们的测试中,前面已经正常删除磁盘 .


  1. SQL> alter diskgroup data drop disk DATA_CD_07_dm03cel13 force; 
  2.  
  3. select GROUP_NUMBER,DISK_NUMBER,LABEL,NAME,MOUNT_STATUS,state,FAILGROUP,MODE_STATUS,PATH from v$asm_disk where name like '%CD_03_DMORLCEL08'; 

17.添加磁盘


  1. SQL>  ALTER DISKGROUP DATA ADD DISK 'o/192.168.10.16/DATA_CD_03_dmorlcel08' rebalance power 10;  
  2. SQL>  ALTER DISKGROUP DBFS_DG ADD DISK 'o/192.168.10.16/DBFS_DG_CD_03_dmorlcel08' rebalance power 10;  
  3. SQL>  ALTER DISKGROUP RECO ADD DISK 'o/192.168.10.16/RECO_CD_03_dmorlcel08' rebalance power 10; 
  4.  
  5. 添加完成两个磁盘后,查询ASM的结果 
  6.  
  7. GROUP_NUMBER DISK_NUMBER LABEL                           NAME                           MOUNT_S STATE    FAILGROUP                      MODE_ST PATH  
  8. ------------ ----------- ------------------------------- ------------------------------ ------- -------- ------------------------------ ------- ------------------ 
  9.  
  10.            1           3 DATA_CD_03_DMORLCEL08           DATA_CD_03_DMORLCEL08          CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/DATA_CD_03_dmorlcel08  
  11.            2           6 DBFS_DG_CD_03_DMORLCEL08        DBFS_DG_CD_03_DMORLCEL08       CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/DBFS_DG_CD_03_dmorlcel08 
  12.  
  13.   

18.添加磁盘的过程,通过这个命令来检查完成状况

SQL> select * from v$asm_operation;

19.最后,全部完成的状态


  1. SQL> select GROUP_NUMBER,DISK_NUMBER,LABEL,NAME,MOUNT_STATUS,state,FAILGROUP,MODE_STATUS,PATH from v$asm_disk where name like '%CD_03_DMORLCEL08'; 
  2.  
  3. GROUP_NUMBER DISK_NUMBER LABEL                           NAME                           MOUNT_S STATE    FAILGROUP                      MODE_ST PATH  
  4. ------------ ----------- ------------------------------- ------------------------------ ------- -------- ------------------------------ -------  
  5.  
  6.            1           3 DATA_CD_03_DMORLCEL08           DATA_CD_03_DMORLCEL08          CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/DATA_CD_03_dmorlcel08  
  7.            4           6 RECO_CD_03_DMORLCEL08           RECO_CD_03_DMORLCEL08          CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/RECO_CD_03_dmorlcel08  
  8.            2           6 DBFS_DG_CD_03_DMORLCEL08        DBFS_DG_CD_03_DMORLCEL08       CACHED  NORMAL   DMORLCEL08                     ONLINE  o/192.168.10.16/DBFS_DG_CD_03_dmorlcel08 
  9.  
  10. 查询griddisk信息,可以看到asmDiskGroupName,asmDiskName都已经有了。 
  11.  
  12. CellCLI>  list griddisk where celldisk=CD_03_dmorlcel08 detail  
  13.          name:                   DATA_CD_03_dmorlcel08  
  14.          asmDiskGroupName:       DATA  
  15.          asmDiskName:            DATA_CD_03_DMORLCEL08  
  16.          availableTo:  
  17.          cellDisk:               CD_03_dmorlcel08  
  18.          comment:  
  19.          creationTime:           2013-02-07T02:14:17-05:00  
  20.          diskType:               HardDisk  
  21.          errorCount:             0  
  22.          id:                     6f9cb08e-fd8f-4063-b902-439387237f5d  
  23.          offset:                 32M  
  24.          size:                   423G  
  25.          status:                 active 
  26.  
  27.          name:                   DBFS_DG_CD_03_dmorlcel08  
  28.          asmDiskGroupName:       DBFS_DG  
  29.          asmDiskName:            DBFS_DG_CD_03_DMORLCEL08  
  30.          availableTo:  
  31.          cellDisk:               CD_03_dmorlcel08  
  32.          comment:  
  33.          creationTime:           2013-02-07T02:14:26-05:00  
  34.          diskType:               HardDisk  
  35.          errorCount:             0  
  36.          id:                     055710ce-216a-4b10-a215-b38763ea65df  
  37.          offset:                 423.046875G  
  38.          size:                   29.125G  
  39.          status:                 active 
  40.  
  41.          name:                   RECO_CD_03_dmorlcel08  
  42.          asmDiskGroupName:       RECO  
  43.          asmDiskName:            RECO_CD_03_DMORLCEL08  
  44.          availableTo:  
  45.          cellDisk:               CD_03_dmorlcel08  
  46.          comment:  
  47.          creationTime:           2013-02-07T02:14:33-05:00  
  48.          diskType:               HardDisk  
  49.          errorCount:             0  
  50.          id:                     fdf9a255-0a0d-4152-a557-de80b112ddff  
  51.          offset:                 452.171875G  
  52.          size:                   105.6875G  
  53.          status:                 active 
  54.  
  55.   

       至此,全部的实验已经完成,如果在更换磁盘后没有正常添加,可以参考这个实验。