Centos 6.5 X86_64 安装oracle 11g rac，采用ASMlib创建asm磁盘

rac1-> ./runcluvfy.sh comp ssa -n rac1 -s /dev/sdb1,/dev/sdc1,/dev/sde1,/dev/sdf1


Verifying shared storage accessibility 


Checking shared storage accessibility...


PRVG-11110 : The specified database file location "/dev/sde" did not have read and write access to user "grid" on node "rac1"


PRVG-11110 : The specified database file location "/dev/sdc" did not have read and write access to user "grid" on node "rac1"


PRVG-11110 : The specified database file location "/dev/sdf" did not have read and write access to user "grid" on node "rac1"


PRVG-11110 : The specified database file location "/dev/sdb" did not have read and write access to user "grid" on node "rac1"


"/dev/sdb1" is shared


"/dev/sdc1" is shared


"/dev/sde1" is shared


"/dev/sdf1" is shared




Shared storage check was successful on nodes "rac1"


Verification of shared storage accessibility was unsuccessful on all the specified nodes. 
rac1-> ./runcluvfy.sh comp ssa -n rac2 -s /dev/sdb1,/dev/sdc1,/dev/sde1,/dev/sdf1 


Verifying shared storage accessibility 


Checking shared storage accessibility...


PRVG-11110 : The specified database file location "/dev/sde" did not have read and write access to user "grid" on node "rac2"


PRVG-11110 : The specified database file location "/dev/sdb" did not have read and write access to user "grid" on node "rac2"


PRVG-11110 : The specified database file location "/dev/sdf" did not have read and write access to user "grid" on node "rac2"


PRVG-11110 : The specified database file location "/dev/sdc" did not have read and write access to user "grid" on node "rac2"


"/dev/sdb1" is shared


"/dev/sdc1" is shared


"/dev/sde1" is shared


"/dev/sdf1" is shared




Shared storage check was successful on nodes "rac2"


Verification of shared storage accessibility was unsuccessful on all the specified nodes. 

rac1-> 

原因：没有安装asmlib，没有配置asm磁盘

百度搜索：Oracle ASMLib Downloads for Red Hat Enterprise Linux  6

下载rpm包

[root@rac1 grid]# wget http://oss.oracle.com/projects/oracleasm-support/dist/files/RPMS/rhel6/amd64/2.1.8/oracleasm-support-2.1.8-1.el6.x86_64.rpm

[root@rac1 grid]# wget http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.4-1.el6.x86_64.rpm

安装：

[root@rac1 grid]# rpm -Uvh oracleasmlib-2.0.4-1.el6.x86_64.rpm \
> oracleasm-support-2.1.8-1.el6.x86_64.rpm \
> 
Preparing...                ########################################### [100%]
   1:oracleasm-support      ########################################### [ 50%]
   2:oracleasmlib           ########################################### [100%]

问题：

系统CentOS 6.5 x86_64 

[root@rac1 grid]# uname -a
Linux rac1.localdomain 2.6.32-431.el6.x86_64 #1 SMP Fri Nov 22 03:15:09 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

[root@rac1 grid]# cat /etc/issue
CentOS release 6.5 (Final)
Kernel \r on an \m

[root@rac1 grid]# lsb_release -a
LSB Version:    :base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch:graphics-4.0-amd64:graphics-4.0-noarch:printing-4.0-amd64:printing-4.0-noarch
Distributor ID: CentOS
Description:    CentOS release 6.5 (Final)
Release:        6.5
Codename:       Final
[root@rac1 grid]# 

因为/sbin/scsi_id -g -u -d /dev/sdb返回为空，考虑用raw，创建asm磁盘

但只在官网中下载到
oracleasm-support-2.1.8-1.el6.x86_64.rpmoracleasmlib-2.0.4-1.el6.x86_64.rpm
这两个rpm包，已经安装，但创建asm磁盘失败，



官方说明:
oracleasm driver for RHEL 6

The kernel driver package 'kmod-oracleasm' is available directly from Red Hat, and can be installed from the "RHEL Server Supplementary (v. 6 64-bit x86_64)" channel on Red Hat Network (RHN).   

这个kmod-oracleasm是哪里可以下载？


下载kmod-oracleasm-2.0.6.rh1-3.el6.x86_64这个版本才可以安装上

升级内核（其他可以不用升级）RAC2没有升级，他可以安装成功

rpm --import https://www.elrepo.org/RPM-GPG-KEY-elrepo.org
rpm -Uvh http://www.elrepo.org/elrepo-release-6-6.el6.elrepo.noarch.rpm
yum --enablerepo=elrepo-kernel install kernel-lt -y


配置ASM磁盘
/usr/sbin/oracleasm configure -i
/etc/init.d/oracleasm enable
/usr/sbin/oracleasm createdisk DATA1 /dev/sdb1
/usr/sbin/oracleasm listdisks


/etc/init.d/oracleasm createdisk VOL1 /dev/sdb1
/etc/init.d/oracleasm createdisk VOL2 /dev/sdc1
/etc/init.d/oracleasm createdisk VOL3 /dev/sdd1
/etc/init.d/oracleasm createdisk VOL4 /dev/sde1
/etc/init.d/oracleasm createdisk VOL5 /dev/sdf1
  /etc/init.d/oracleasm createdisk VOL6 /dev/sdg1




问题：
[root@rac2 ~]# rpm -ivh oracleasmlib-2.0.4-1.el6.x86_64.rpm 
warning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
error: Failed dependencies:
        oracleasm >= 1.0.4 is needed by oracleasmlib-2.0.4-1.el6.x86_64




解决：
先安装rpm -ivh kmod-oracleasm-2.0.6.rh1-3.el6.x86_64.rpm 
[root@rac2 ~]# rpm -ivh kmod-oracleasm-2.0.6.rh1-3.el6.x86_64.rpm 
Preparing...                ########################################### [100%]
   1:kmod-oracleasm         ########################################### [100%]


再安装
[root@rac2 ~]# rpm -ivh oracleasmlib-2.0.4-1.el6.x86_64.rpm       
warning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
Preparing...                ########################################### [100%]
   1:oracleasmlib           ########################################### [100%]
[root@rac2 ~]# 

安装向导发现磁盘路径：

/dev/oracleasm/disks/*