在安装GUI时，创建了第一块ASM磁盘，命名为DATA1，上面存放了spfile文件，ocrfile文件，并且作为了vote盘。感觉名字和实际不符，容易搞混，所以想删除这个磁盘，直接删除会报错：
ORA-15039: diskgroup not dropped
ORA-15053: diskgroup "DATA1" contains existing files
经过查询，发现是因为这块ASM磁盘为第一块磁盘，会默认将spfile，ocrfile文件放在上面，所以需要迁移，以下为整个迁移过程，先asmca创建一块VOTE磁盘，将所有东西迁移至VOTE盘上：
[root@RAC1 bin]# export DISPLAY=192.168.137.1:0.0
[root@RAC1 bin]# xhost +
access control disabled, clients can connect from any host
xhost: must be on local machine to enable or disable access control.
[root@RAC1 bin]# su - grid
[grid@RAC1 ~]$ asmca
[grid@RAC1 ~]$ asmcmd
ASMCMD> lsdg
State Type Rebal Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED EXTERN N 512 4096 1048576 390144 389741 0 389741 0 Y DATA1/
MOUNTED HIGH N 512 4096 1048576 10240 9951 4096 1951 0 N VOTE/
ASMCMD> exit
[grid@RAC1 ~]$ cd /u01/app/11.2.0/grid/bin/
[grid@RAC1 bin]$ ./crsctl query css votedisk;
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE ac2441da97ee4fe9bf213a4f04883ddc (/dev/mapper/mpathe) [DATA1]
Located 1 voting disk(s).
[grid@RAC1 bin]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.4.0 Production on Thu Jan 5 10:58:29 2017 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options SQL> show parameter spfile; NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
spfile string +DATA1/rac-scan/asmparameterfi
le/registry.253.932423991
SQL> create pfile='$ORACLE_HOME/dbs/init+ASM.ora' from spfile; File created. SQL> shutdown abort
ASM instance shutdown
SQL> startup pfile=$ORACLE_HOME/dbs/init+ASM.ora;
ASM instance started Total System Global Area 1135747072 bytes
Fixed Size 2260728 bytes
Variable Size 1108320520 bytes
ASM Cache 25165824 bytes
ASM diskgroups mounted
ASM diskgroups volume enabled
SQL> show parameter spfile; NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
spfile string SQL> create spfile='+VOTE' from pfile='$ORACLE_HOME/dbs/init+ASM.ora'; File created. SQL> shutdown abort
ASM instance shutdown
SQL> startup
ASM instance started Total System Global Area 1135747072 bytes
Fixed Size 2260728 bytes
Variable Size 1108320520 bytes
ASM Cache 25165824 bytes
ASM diskgroups mounted
ASM diskgroups volume enabled
SQL> show parameter spfile; NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
spfile string +VOTE/rac-scan/asmparameterfil
e/registry.253.932469773
SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@RAC1 bin]$ ./crsctl query css votedisk;
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE ac2441da97ee4fe9bf213a4f04883ddc (/dev/mapper/mpathe) [DATA1]
Located 1 voting disk(s). [grid@RAC1 bin]$ crsctl replace votedisk +VOTE
Successful addition of voting disk 7ecf201998094fb1bf219f39752209bb.
Successful addition of voting disk 86e35de49d044f23bfdebda27b7caa91.
Successful addition of voting disk 52544b8c0f4e4f75bfe9d075025607ce.
Successful addition of voting disk 53bfc36bc0954f39bf912f190c5788e0.
Successful addition of voting disk 9b1772ca5d224f2bbfd35ce48a204777.
Successful deletion of voting disk ac2441da97ee4fe9bf213a4f04883ddc.
Successfully replaced voting disk group with +VOTE.
CRS-4266: Voting file(s) successfully replaced
[grid@RAC1 bin]$ ./crsctl query css votedisk;
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE 7ecf201998094fb1bf219f39752209bb (/dev/mapper/mpathb) [VOTE]
2. ONLINE 86e35de49d044f23bfdebda27b7caa91 (/dev/mapper/mpathc) [VOTE]
3. ONLINE 52544b8c0f4e4f75bfe9d075025607ce (/dev/mapper/mpathd) [VOTE]
4. ONLINE 53bfc36bc0954f39bf912f190c5788e0 (/dev/mapper/mpathf) [VOTE]
5. ONLINE 9b1772ca5d224f2bbfd35ce48a204777 (/dev/mapper/mpathg) [VOTE]
Located 5 voting disk(s).
[grid@RAC1 bin]$ ./ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 2760
Available space (kbytes) : 259360
ID : 1780865708
Device/File Name : +DATA1
Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check bypassed due to non-privileged user [grid@RAC1 bin]$ ./ocrconfig -add +VOTE
PROT-20: Insufficient permission to proceed. Require privileged user
权限不足，需要使用root用户
[grid@RAC1 bin]$ exit
logout
[root@RAC1 bin]# ./ocrconfig -add +VOTE
[root@RAC1 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 2760
Available space (kbytes) : 259360
ID : 1780865708
Device/File Name : +DATA1
Device/File integrity check succeeded
Device/File Name : +VOTE
Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check succeeded [root@RAC1 bin]# ./ocrconfig -replace +DATA1 -replacement +VOTE
PROT-29: The Oracle Cluster Registry location is already configured
此处报错说明已经添加进来，无法再替换
[root@RAC1 bin]# ./ocrconfig -delete +DATA1
[root@RAC1 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 2760
Available space (kbytes) : 259360
ID : 1780865708
Device/File Name : +VOTE
Device/File integrity check succeeded Device/File not configured Device/File not configured Device/File not configured Device/File not configured Cluster registry integrity check succeeded Logical corruption check succeeded [root@RAC1 bin]# su - grid
[grid@RAC1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.4.0 Production on Thu Jan 5 12:30:51 2017 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options SQL> drop diskgroup DATA1;
drop diskgroup DATA1
*
ERROR at line 1:
ORA-15039: diskgroup not dropped
ORA-15053: diskgroup "DATA1" contains existing files SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@RAC1 ~]$ asmcmd
ASMCMD> ls
DATA1/
VOTE/
ASMCMD> cd DATA1
ASMCMD> ls
rac-scan/
ASMCMD> rm -rf rac-scan （注意操作，千万不要误删，此处删除，是因为已经将spfile和ocrfile成功迁移至vote盘）
ASMCMD> ls
ASMCMD> exit
[grid@RAC1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.4.0 Production on Thu Jan 5 12:32:24 2017 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options SQL> drop diskgroup DATA1;
drop diskgroup DATA1
*
ERROR at line 1:
ORA-15039: diskgroup not dropped
ORA-15073: diskgroup DATA1 is mounted by another ASM instance
此处说明在另外一个节点，磁盘DATA1还仍处于挂载状态，需要先dismount掉： 在节点2上执行：
SQL> alter diskgroup DATA1 dismount; 返回节点1
SQL> drop diskgroup DATA1; Diskgroup dropped. SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@RAC1 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....ER.lsnr ora....er.type ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type ONLINE ONLINE rac2
ora.VOTE.dg ora....up.type ONLINE ONLINE rac1
ora.asm ora.asm.type ONLINE ONLINE rac1
ora.cvu ora.cvu.type ONLINE ONLINE rac1
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac1
ora.oc4j ora.oc4j.type ONLINE ONLINE rac1
ora.ons ora.ons.type ONLINE ONLINE rac1
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application OFFLINE OFFLINE
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip ora....t1.type ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application OFFLINE OFFLINE
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora....ry.acfs ora....fs.type ONLINE ONLINE rac1
ora.scan1.vip ora....ip.type ONLINE ONLINE rac2
[grid@RAC1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.4.0 Production on Thu Jan 5 12:35:28 2017 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options SQL> col path format a30
SQL> select path,mount_status from v$asm_disk; PATH MOUNT_S
------------------------------ -------
/dev/mapper/mpathh CLOSED
/dev/mapper/mpathi CLOSED
/dev/mapper/mpathe CLOSED
/dev/mapper/mpathc CACHED
/dev/mapper/mpathb CACHED
/dev/mapper/mpathd CACHED
/dev/mapper/mpathf CACHED
/dev/mapper/mpathg CACHED 8 rows selected.
可以看到挂载的三块磁盘已经处于CLOSED状态，可用于重新创建磁盘组 SQL> create diskgroup DATA normal redundancy disk '/dev/mapper/mpathh','/dev/mapper/mpathi'; Diskgroup created. SQL> alter diskgroup DATA add disk '/dev/mapper/mpathe'; Diskgroup altered. SQL> select path,mount_status from v$asm_disk; PATH MOUNT_S
------------------------------ -------
/dev/mapper/mpathh CACHED
/dev/mapper/mpathi CACHED
/dev/mapper/mpathe CACHED
/dev/mapper/mpathc CACHED
/dev/mapper/mpathb CACHED
/dev/mapper/mpathd CACHED
/dev/mapper/mpathf CACHED
/dev/mapper/mpathg CACHED 8 rows selected.
SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@RAC1 ~]$ asmcmd
ASMCMD> lsdg
State Type Rebal Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
MOUNTED NORMAL N 512 4096 1048576 390144 389988 130048 129970 0 N DATA/
MOUNTED HIGH N 512 4096 1048576 10240 8984 4096 1629 0 Y VOTE/