处理11gR2 RAC集群资源状态异常INTERMEDIATE,CHECK TIMED OUT

时间:2023-03-09 17:48:50
处理11gR2 RAC集群资源状态异常INTERMEDIATE,CHECK TIMED OUT

注意节点6,7的磁盘CRSDG的状态明显不正常。
oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> crsctl status resource -t |less
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRSDG.dg
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    1-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    2-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    3-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    4-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    5-db-sd                 
               ONLINE  INTERMEDIATE zjhz-ps-cmread-sv-rptdw0 CHECK TIMED OUT    
                                    6-db-sd                 
               ONLINE  INTERMEDIATE zjhz-ps-cmread-sv-rptdw0 CHECK TIMED OUT    
                                    7-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    8-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    9-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw1                    
                                    0-db-sd

oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> srvctl stop diskgroup -g CRSDG -n ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD
 PRCR-1014 : Failed to stop resource ora.CRSDG.dg
PRCR-1065 : Failed to stop resource ora.CRSDG.dg
CRS-2675: Stop of 'ora.CRSDG.dg' on 'zjhz-ps-cmread-sv-rptdw06-db-sd' failed

oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> srvctl start diskgroup -g CRSDG -n ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD
PRCC-1015 : CRSDG was already running on zjhz-ps-cmread-sv-rptdw06-db-sd
PRCR-1004 : Resource ora.CRSDG.dg is already running
执行后,CHECK TIMED OUT消失,但是target变成了OFFLINE,如下所示
oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> crsctl status res -t |less
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRSDG.dg
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    1-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    2-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    3-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    4-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    5-db-sd                 
               OFFLINE ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    6-db-sd                 
               ONLINE  INTERMEDIATE zjhz-ps-cmread-sv-rptdw0 CHECK TIMED OUT    
                                    7-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    8-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    9-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw1                    
                                    0-db-sd

执行crsctl启动资源,恢复target成ONLINE
oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> crsctl start resource ora.CRSDG.dg
CRS-5702: Resource 'ora.CRSDG.dg' is already running on 'zjhz-ps-cmread-sv-rptdw01-db-sd'
CRS-4000: Command Start failed, or completed with errors.

oracle@ZJHZ-PS-CMREAD-SV-RPTDW06-DB-SD:~> crsctl status res -t |less
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.CRSDG.dg
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    1-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    2-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    3-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    4-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    5-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    6-db-sd                 
               ONLINE  INTERMEDIATE zjhz-ps-cmread-sv-rptdw0 CHECK TIMED OUT    
                                    7-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    8-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw0                    
                                    9-db-sd                 
               ONLINE  ONLINE       zjhz-ps-cmread-sv-rptdw1                    
                                    0-db-sd                 
节点6的资源状态恢复正常。
报错具体原因分析,可能是BUG引起的,CRS,CSS日志均无异常。