Focus On Oracle

Installing, Backup & Recovery, Performance Tuning,
Troubleshooting, Upgrading, Patching

Oracle Engineered System


当前位置： 首页 » 技术文章 » Exadata

Recreate quorum disk on X6-2

时间: 2017-08-13 18:37:20  | 作者: ohsdba  | 
如非注明，本站文章皆为原创。欢迎转载，转载时请注明出处和作者信息。
在Exadata上，准备做级联时发现IB地址冲突，修改IB地址后，发现系统出现了一些关于iscsi的错误，刚开始想怎么会出现这些错误呢，后来在asmcmd中发现有OCR所在的磁盘组有offline的disk，查询后发现了quorum disk（在12.1.2.3.0中，引入了Quorum Disk Manager这个功能）的问题。所以就把原来的在操作系统上quorum disk删除，重建后问题消失。下面是详细的步骤。

文件系统信息 

[root@dm06dbadm01 iscsi]# pvs
  PV         VG      Fmt  Attr PSize PFree  
  /dev/sda2  VGExaDb lvm2 a--u 1.63t 464.08g
[root@dm06dbadm01 iscsi]# lvs
  LV                 VG      Attr       LSize   Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  LVDbOra1           VGExaDb -wi-ao---- 100.00g                                                    
  LVDbSwap1          VGExaDb -wi-ao----  24.00g                                                    
  LVDbSys1           VGExaDb -wi-ao----  30.00g                                                    
  LVDbSys2           VGExaDb -wi-a-----  30.00g                                                    
  LVDoNotRemoveOrUse VGExaDb -wi-a-----   1.00g                                                    
  ogg                VGExaDb -wi-a-----   1.00t                                                    
[root@dm06dbadm01 iscsi]# vgs
  VG      #PV #LV #SN Attr   VSize VFree  
  VGExaDb   1   6   0 wz--n- 1.63t 464.08g
[root@dm06dbadm01 iscsi]#
创建配置文件（在两个计算节点上都执行） 
[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --create --config --owner=grid --group=asmadmin --network-iface-list="ib0, ib1"
[Info] Successfully created iface exadata_ib0 with iface.net_ifacename ib0
[Info] Successfully created iface exadata_ib1 with iface.net_ifacename ib1
[Success] Successfully created quorum disk configurations

[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --list --config
Owner: grid
Group: asmadmin
ifaces: exadata_ib1 exadata_ib0
创建target（在两个计算节点上都执行）
[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --create --target --asm-disk-group=SYSTEMDG --visible-to="192.168.10.21, 192.168.10.22, 192.168.10.23, 192.168.10.24"
[Success] Successfully created target iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01.

[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --list --target
Name: iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01
Host name: DM06DBADM01
ASM disk group name: SYSTEMDG
Size: 128 MB
Visible to: 192.168.10.21, 192.168.10.22, 192.168.10.23, 192.168.10.24
Discovered by:
创建device（在两个计算节点上都执行）
[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --create --device --target-ip-list="192.168.10.21, 192.168.10.22, 192.168.10.23, 192.168.10.24"
[Success] Successfully created all device(s) from target(s) on machine with IP address 192.168.10.21
[Success] Successfully created all device(s) from target(s) on machine with IP address 192.168.10.22
[Success] Successfully created all device(s) from target(s) on machine with IP address 192.168.10.23
[Success] Successfully created all device(s) from target(s) on machine with IP address 192.168.10.24
[root@dm06dbadm01 iscsi]# /opt/oracle.SupportTools/quorumdiskmgr --list --device
Device path: /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01
Host name: DM06DBADM01
ASM disk group name: SYSTEMDG
Size: 128 MB
Device path: /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02
Host name: DM06DBADM02
ASM disk group name: SYSTEMDG
Size: 128 MB

查看iscsi信息 

[root@dm06dbadm01 iscsi]# cat /etc/tgt/targets.conf
default-driver iscsi
<target iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01>
        backing-store /dev/VGExaDb/LVDbVdDM06DBADM01SYSTEMDG
        initiator-address 192.168.10.21
        initiator-address 192.168.10.22
        initiator-address 192.168.10.23
        initiator-address 192.168.10.24
</target>

[root@dm06dbadm01 iscsi]# iscsiadm -m node
192.168.10.21:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01
192.168.10.22:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01
192.168.10.22:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01
192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02
[root@dm06dbadm01 iscsi]# iscsiadm -m session
tcp: [40406] 192.168.10.21:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01 (non-flash)
tcp: [40407] 192.168.10.22:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01 (non-flash)
tcp: [40408] 192.168.10.22:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM01 (non-flash)
tcp: [40409] 192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40410] 192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40411] 192.168.10.23:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40412] 192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40413] 192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
tcp: [40414] 192.168.10.24:3260,1 iqn.2015-05.com.oracle:QD_SYSTEMDG_DM06DBADM02 (non-flash)
查看quorum disk设备 
SQL> set linesize 200
SQL> col path format a50
SQL> select inst_id, label, path, mode_status, header_status
  2  from gv$asm_disk where path like '/dev/exadata_quorum/%';

   INST_ID LABEL                           PATH                                               MODE_ST HEADER_STATU
---------- ------------------------------- -------------------------------------------------- ------- ------------
         2 QD_SYSTEMDG_DM06DBADM01         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01        ONLINE  CANDIDATE
         2 QD_SYSTEMDG_DM06DBADM02         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02        ONLINE  CANDIDATE
         1 QD_SYSTEMDG_DM06DBADM01         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01        ONLINE  CANDIDATE
         1 QD_SYSTEMDG_DM06DBADM02         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02        ONLINE  CANDIDATE

SQL>

将设备加入OCR磁盘组 

alter diskgroup SYSTEMDG add quorum failgroup dm06dbadm01 disk '/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01' quorum failgroup dm06dbadm02 disk '/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02';
SQL> alter diskgroup SYSTEMDG add quorum failgroup dm06dbadm01 disk '/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01' quorum failgroup dm06dbadm02 disk '/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02';

Diskgroup altered.

SQL> select inst_id, label, path, mode_status, header_status
  2  from gv$asm_disk where path like '/dev/exadata_quorum/%';

   INST_ID LABEL                           PATH                                               MODE_ST HEADER_STATU
---------- ------------------------------- -------------------------------------------------- ------- ------------
         2 QD_SYSTEMDG_DM06DBADM01         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01        ONLINE  MEMBER
         2 QD_SYSTEMDG_DM06DBADM02         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02        ONLINE  MEMBER
         1 QD_SYSTEMDG_DM06DBADM02         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02        ONLINE  MEMBER
         1 QD_SYSTEMDG_DM06DBADM01         /dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01        ONLINE  MEMBER

SQL>
查看voting disk信息 
[grid@dm06dbadm01 ~]$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   40811a83d0f74f5abf1d60f185d49f28 (o/192.168.10.29;192.168.10.30/SYSTEMDG_CD_09_dm06celadm03) [SYSTEMDG]
 2. ONLINE   ea7c8ec508e54fc1bfb17bde01b35f29 (o/192.168.10.25;192.168.10.26/SYSTEMDG_CD_10_dm06celadm01) [SYSTEMDG]
 3. ONLINE   a14e23d77f0d4f60bf9fe4678aa67009 (o/192.168.10.27;192.168.10.28/SYSTEMDG_CD_02_dm06celadm02) [SYSTEMDG]
 4. ONLINE   748cc9da6c544f28bf439a3f7dca3398 (/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM02) [SYSTEMDG]
 5. ONLINE   56324b85a3af4f23bf8c592641839cde (/dev/exadata_quorum/QD_SYSTEMDG_DM06DBADM01) [SYSTEMDG]
Located 5 voting disk(s).

[grid@dm06dbadm01 ~]$

Reference

http://docs.oracle.com/cd/E80920_01/DBMMN/maintaining-exadata-database-servers.htm#DBMMN22868


关键词:exadata 

相关文章

Exadata exafusion参数在不同版本的变化
19c新特性之实时统计信息收集
Oracle Exadata x8m-2的更新
Oracle Exadata十年
Oracle Exadata x8-2的更新
终于等到你，Oracle 19c真的来了
useful mos note for exadata
Exadata最权威最完整的学习资料
Exadata上收集Cell节点的日志
Exadata上如何重置Cell节点root密码当你忘记时
Oracle性能加速之Write-Back Flash Cache
Exadata and ASM

推荐文章

联系我们

Oracle Software Download Index

Oracle Database Upgrade

Oracle SQLMaria

Oracle Database Document

Oracle Cloud Document

Oracle Cloud中文链接

eDelivery

GoldenGate

My Oracle Support

Exadata Document

Oracle Linux

Oracle Fusion Middleware

MySQL Document

PostgreSQL

Python

Apache

Github

Sourceforge

CNCF

Ruby

Go

ipcheck

ipaddressguide

db-engines

Linux Kernel

Top