XX平台数据库无法启动CRS-2674 HAIP
|
数据库信息 |
数据库 名称 |
检查单位 |
问题报告人 |
检查日期 |
2017-06-30 |
|
xx集成调度平台 |
yf |
段亚东 |
报告日期 |
2017-06-30 |
|
|
发现问题 |
数据库无法启动,集群服务无法启动CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'xxxx' failed |
||||
|
问题分析 |
|||||
|
处理方法 |
查看集群状态 报错,说明集群没有启动 [root@xxxx-xxxx1-7 ~]# crs_stat -t -v CRS-0184: Cannot communicate with the CRS daemon. 查看has服务状态 正常 [root@xxxx-xxxx1-7 ~]# ps -ef |grep has root 22478 1 0 Jun29 ? 00:00:00 /bin/sh /etc/init.d/init.ohasd run root 33450 1 0 Jun29 ? 00:01:53 /u01/app/11.2.0/grid/bin/ohasd.bin reboot root 102308 102256 0 08:05 pts/1 00:00:00 grep has 启动集群服务,看到有报错 [root@xxxx-xxxx1-7 ~]# crsctl start cluster -all CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'xxxx-xxxx1-7' CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error: Start action for HAIP aborted. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/xxxx-xxxx1-7/agent/ohasd/orarootagent_root/orarootagent_root.log". CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'xxxx-xxxx1-7' failed CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'xxxx-xxxx1-7' CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'xxxx-xxxx1-7' succeeded CRS-4705: Start of Clusterware failed on node xxxx-xxxx1-7. CRS-4000: Command Start failed, or completed with errors.
这个报错haip是和集群的高可用IP相关的,查看心跳网络 [root@xxxx-xxxx1-7 ~]# cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 #public 10.1.1.7 xxxx-xxxx1-7 10.1.1.8 xxxx-xxxx2-8
#vip 10.1.1.9 xxxx-xxxx1-vip 10.1.1.10 xxxx-xxxx2-vip
#private 172.16.1.1 xxxx-xxxx1-priv 172.16.1.2 xxxx-xxxx2-priv
#scan-ip 10.1.1..11 xxxxrm-scan
Ping测试心跳网络 [root@xxxx-xxxx1-7 ~]# ping xxxx-xxxx1-priv PING xxxx-xxxx1-priv (172.16.1.1) 56(84) bytes of data. 64 bytes from xxxx-xxxx1-priv (172.16.1.1): icmp_seq=1 ttl=64 time=0.020 ms 64 bytes from xxxx-xxxx1-priv (172.16.1.1): icmp_seq=2 ttl=64 time=0.019 ms ^C --- xxxx-xxxx1-priv ping statistics --- 2 packets transmitted, 2 received, 0% packet loss, time 1490ms rtt min/avg/max/mdev = 0.019/0.019/0.020/0.004 ms 查看网卡信息,之前配置的时eth0接口,现在被配置到了eth1上. [root@xxxx-xxxx1-7 ~]# ifconfig bond0 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx inet addr:10.1.1.7 Bcast:10.1.1.127 Mask:255.255.255.128 inet6 addr: xxxx::xxxx:xxxx:xxxx:xxxx/64 Scope:Link UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1 RX packets:389243 errors:0 dropped:0 overruns:0 frame:0 TX packets:56074 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:32426461 (30.9 MiB) TX bytes:4521495 (4.3 MiB)
eth0 UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) Memory:da100000-da13ffff
eth1 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx
inet6 addr: xxxx::xxxx:xxxx:xxxx:xxxx/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:169 errors:0 dropped:0 overruns:0 frame:0 TX packets:194 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:23889 (23.3 KiB) TX bytes:23470 (22.9 KiB) Memory:da140000-da17ffff
修改后 启动集群和数据库正常 [oracle@xxxx-xxxx1-7 ~]$ ifconfig -a bond0 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx inet addr:10.1.1.7 Bcast:10.1.1..127 Mask:255.255.255.128 inet6 addr: xxxx::xxxx:xxxx:xxxx:xxxx/64 Scope:Link UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1 RX packets:62204 errors:0 dropped:0 overruns:0 frame:0 TX packets:18515 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:5098583 (4.8 MiB) TX bytes:2347345 (2.2 MiB)
bond0:2 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx inet addr:10.1.1..11 Bcast:10.1.1..127 Mask:255.255.255.128 UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
bond0:3 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx inet addr:10.1.1.9 Bcast:10.1.1..127 Mask:255.255.255.128 UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
eth0 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx
inet6 addr: xxxx::xxxx:xxxx:xxxx:xxxx/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:219132 errors:0 dropped:0 overruns:0 frame:0 TX packets:241062 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:109159397 (104.1 MiB) TX bytes:133750942 (127.5 MiB) Memory:da100000-da13ffff
eth0:1 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx inet addr:169.254.57.164 Bcast:169.254.255.255 Mask:255.255.0.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 Memory:da100000-da13ffff
eth1 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:2070 errors:0 dropped:0 overruns:0 frame:0 TX packets:2037 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:198528 (193.8 KiB) TX bytes:195998 (191.4 KiB) Memory:da140000-da17ffff
[root@xxxx-xxxx1-7 ~]# crs_stat -t -v Name Type R/RA F/FT Target State Host ----------------------- ----------------------------------------------- ora.ARCH.dg ora....up.type 0/5 0/ ONLINE ONLINE xxxx...x1-7 ora.DATA.dg ora....up.type 0/5 0/ ONLINE ONLINE xxxx...x1-7 ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE xxxx...x1-7 ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE xxxx...x1-7 ora.OCR.dg ora....up.type 0/5 0/ ONLINE ONLINE xxxx...x1-7 ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE xxxx...x1-7 ora.cvu ora.cvu.type 0/5 0/0 ONLINE ONLINE xxxx...x1-7 ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINE ora....SM1.asm application 0/5 0/0 ONLINE ONLINE xxxx...x1-7 ora....-7.lsnr application 0/5 0/0 ONLINE ONLINE xxxx...x1-7 ora....1-7.gsd application 0/5 0/0 OFFLINE OFFLINE ora....1-7.ons application 0/3 0/0 ONLINE ONLINE xxxx...x1-7 ora....1-7.vip ora....t1.type 0/0 0/0 ONLINE ONLINE xxxx...x1-7 ora....SM2.asm application 0/5 0/0 ONLINE ONLINE xxxx...x2-8 ora....-8.lsnr application 0/5 0/0 ONLINE ONLINE xxxx...x2-8 ora....2-8.gsd application 0/5 0/0 OFFLINE OFFLINE ora....2-8.ons application 0/3 0/0 ONLINE ONLINE xxxx...x2-8 ora....2-8.vip ora....t1.type 0/0 0/0 ONLINE ONLINE xxxx...x2-8 ora....network ora....rk.type 0/5 0/ ONLINE ONLINE xxxx...x1-7 ora.oc4j ora.oc4j.type 0/1 0/2 ONLINE ONLINE xxxx...x1-7 ora.ons ora.ons.type 0/3 0/ ONLINE ONLINE xxxx...x1-7 ora.orcl.db ora....se.type 0/2 0/1 ONLINE ONLINE xxxx...x1-7 ora....ry.acfs ora....fs.type 0/5 0/ ONLINE ONLINE xxxx...x1-7 ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE xxxx...x1-7
|
||||
|
完成情况跟踪 |
实例检测运行正常,使用正常 |
||||
|
领导审核 |
|
||||
|
备注 |
|
||||
沙发空闲中，快来抢！