目录
 一.主机系统配置及软件规划 ....................................................................................................... 3
 1.1 硬件 .................................................................................................................................... 3
 1.2 软件规划 ............................................................................................................................. 3
 1.3 硬件连接示意图 ................................................................................................................. 4
 二.安装操作系统 ........................................................................................................................... 4
 2.1 操作系统安装步骤 ............................................................................................................. 4
 2.2RDAC 安装步骤 .................................................................................................................... 5
 三.安装ORACLE ............................................................................................................................. 5
 3.1 创建用户组和用户 ............................................................................................................. 5
 3.2 创建目录 ............................................................................................................................. 6
 3.3 修改hosts 文件 .................................................................................................................. 7
 3.4 修改limits.conf 文件 .......................................................................................................... 8
 3.5 添加pam_limits.so 模块 .................................................................................................... 8
 3.6 修改linux 内核参数 ........................................................................................................... 8
 3.7 修改profile ......................................................................................................................... 9
 3.8 停ntp 时间同步(11G 新增检查选项) ............................................................................... 9
 3.9 查看tmpfs 大小是否大于1G ............................................................................................ 9
 3.10 磁盘划分........................................................................................................................... 9
 3.11 下载ASM ........................................................................................................................ 12
 3.12 安装ASM ........................................................................................................................ 13
 3.13 配置ASM ........................................................................................................................ 13
 3.14 创建ASM ........................................................................................................................ 14
 3.15 为用户等效性配置SSH ................................................................................................. 15
 3.16 修改gird、oracle 用户的.bash_profile 文件 ................................................................ 17
 3.17 校验能否安装grid ......................................................................................................... 18
 3.18 安装grid ......................................................................................................................... 33
 3.19 安装Oracle 软件 ............................................................................................................ 54
 3.20 创建ASM 磁盘组 ........................................................................................................... 64
 3.21 创建数据库 ..................................................................................................................... 67
 四.维护ORACLE RAC ................................................................................................................... 74
 4.1 查看RAC 运行状态 .......................................................................................................... 74
 4.2 启动oracle rac .................................................................................................................. 75
 4.3 关闭oracle rac .................................................................................................................. 75
 4.4 查看各资源状态 ............................................................................................................... 75
 4.5 启用各资源 ....................................................................................................................... 75
 4.6 启动各资源 ....................................................................................................................... 76
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 3 / 76
 一.主机系统配置及软件规划
 1.1 硬件
 产品名称 产品描述 数量
 IBM X3850X5 2 个Intel 四核Xeon E7520 处理器(1.86GHz),32GB
 1066MHz DDR3 内存,2 块300GB 2.5 寸10K SAS10K SAS
 硬盘RAID0+1
 2
 IBM DS4700 双控制器16 块FC 300GB 硬盘 1
 1.2 软件规划
 分类 项目 说明 备注
 主机 主机名 cmsnmdb1, cmsnmdb2
 操作系统 Red Hat Enterprise Linux 5 release
 5.5
 (Tikanga)
 网卡 cmsnmdb1 eth0: 172.16.60.1
 cmsnmdb1 eth1: 150.150.1.1
 cmsnmdb2 eth0: 172.16.60.2
 cmsnmdb2 eth1: 150.150.1.2
 数据库 数据库版本 Oracle Database 11g Release 2
 (11.2.0.1.0) for Linux x86-64
 运行模式 RAC
 ORACLE ASM +DATA,+ARCH
 数据库名 cmsnm
 实例名 cmsnm1/cmsnm2
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 4 / 76
 1.3 硬件连接示意图
 二.安装操作系统
 2.1 操作系统安装步骤
 具体可以操作可以参考文件安装
 http://www.linknat.com/chs/support/guide/redhat-as5-install-guide.pdf
 注意安装软件选择定制要安装的软件包,选择全部安装
 安装完成后
 需要补安装oracle11g rac 必要的操作系统包
 rpm –ivh libaio-devel-0.3.106-5.i386.rpm
 rpm –ivh libaio-devel-0.3.106-5.x86_64.rpm
 rpm –ivh unixODBC-devel-2.2.11-7.1.i386.rpm
 rpm –ivh unixODBC-devel-2.2.11-7.1.x86_64.rpm
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 5 / 76
 2.2RDAC 安装步骤
 如果是双HBA 卡,还需要安装RDAC 多路径的软件
 rdac-LINUX-09.03.0C05.0439-source.tar.gz
 tar zxvf rdac-LINUX-09.03.0C05.0439-source.tar.gz
 cd linuxrdac-09.03.0C05.0439/
 make
 make install
 vi /etc/grub.conf
 修改
 default=1
 添加
 title Red Hat Enterprise Linux Server (2.6.18-194.el5)
 root (hd0,0)
 kernel /vmlinuz-2.6.18-194.el5 ro root=/dev/VolGroup00/LogVol00 rhgb
 quiet
 initrd /mpp-2.6.18-194.el5.img
 三.安装ORACLE
 3.1 创建用户组和用户
 注意(11G 需要多建一个用户grid 原来的CRS 软件安装在这个用户下)
 /usr/sbin/groupadd -g 501 oinstall
 /usr/sbin/groupadd -g 502 dba
 /usr/sbin/groupadd -g 503 oper
 /usr/sbin/groupadd -g 504 asmadmin
 /usr/sbin/groupadd -g 505 asmoper
 /usr/sbin/groupadd -g 506 asmdba
 /usr/sbin/useradd -g oinstall -G dba,asmdba,oper oracle
 /usr/sbin/useradd -g oinstall -G asmadmin,asmdba,asmoper,oper,dba grid
 [root@cmsnmdb1 ~]# /usr/sbin/groupadd -g 501 oinstall
 /usr/sbin/groupadd -g 502 dba
 /usr/sbin/groupadd -g 503 oper
 /usr/sbin/groupadd -g 504 asmadmin
 /usr/sbin/groupadd -g 505 asmoper
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 6 / 76
 /usr/sbin/groupadd -g 506 asmdba
 [root@cmsnmdb1 ~]# /usr/sbin/groupadd -g 502 dba
 [root@cmsnmdb1 ~]# /usr/sbin/groupadd -g 503 oper
 [root@cmsnmdb1 ~]# /usr/sbin/groupadd -g 504 asmadmin
 [root@cmsnmdb1 ~]# /usr/sbin/groupadd -g 505 asmoper
 [root@cmsnmdb1 ~]# /usr/sbin/groupadd -g 506 asmdba
 [root@cmsnmdb1 ~]#
 [root@cmsnmdb1 ~]#
 [root@cmsnmdb1 ~]# /usr/sbin/useradd -g oinstall -G dba,asmdba,oper oracle
 [root@cmsnmdb1 ~]# /usr/sbin/useradd -g oinstall -G
 asmadmin,asmdba,asmoper,oper,dba grid
 [root@cmsnmdb1 ~]# id oracle
 uid=500(oracle) gid=501(oinstall)
 groups=501(oinstall),502(dba),503(oper),506(asmdba)
 [root@cmsnmdb1 ~]# passwd oracle
 Changing password for user oracle.
 New UNIX password:
 BAD PASSWORD: it is based on a dictionary word
 Retype new UNIX password:
 passwd: all authentication tokens updated successfully.
 [root@cmsnmdb1 ~]# id grid
 uid=501(grid) gid=501(oinstall)
 groups=501(oinstall),502(dba),503(oper),504(asmadmin),505(asmoper),506(asmdba)
 [root@cmsnmdb1 ~]# passwd grid
 Changing password for user grid.
 New UNIX password:
 BAD PASSWORD: it is too short
 Retype new UNIX password:
 passwd: all authentication tokens updated successfully.
 [root@cmsnmdb1 ~]#
 3.2 创建目录
 mkdir -p /u01/app/oraInventory
 chown -R grid:oinstall /u01/app/oraInventory
 chmod -R 775 /u01/app/oraInventory
 mkdir -p /u01/11.2/grid
 chown -R grid:oinstall /u01/app/grid
 chmod -R 775 /u01/app/grid
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 7 / 76
 mkdir -p /u01/app/oracle
 mkdir /u01/app/oracle/cfgtoollogs --needed to ensure that dbca is able to run after
 the rdbms installation.
 chown -R oracle:oinstall /u01/app/oracle
 chmod -R 775 /u01/app/oracle
 mkdir -p /u01/app/oracle/product/11.2.0/db_1
 chown -R oracle:oinstall /u01/app/oracle/product/11.2.0/db_1
 chmod -R 775 /u01/app/oracle/product/11.2.0/db_1
 [root@cmsnmdb2 ~]# mkdir -p /u01/app/oraInventory
 chown -R grid:oinstall /u01/app/oraInventory
 [root@cmsnmdb2 ~]# chown -R grid:oinstall /u01/app/oraInventory
 [root@cmsnmdb2 ~]# chmod -R 775 /u01/app/oraInventory
 [root@cmsnmdb2 ~]# mkdir -p /u01/11.2.0/grid
 [root@cmsnmdb2 ~]# chown -R grid:oinstall /u01/11.2.0/grid
 [root@cmsnmdb2 ~]# chmod -R 775 /u01/11.2.0/grid
 [root@cmsnmdb2 ~]# mkdir -p /u01/app/oracle
 [root@cmsnmdb2 ~]# chown -R oracle:oinstall /u01/app/oracle
 [root@cmsnmdb2 ~]# chmod -R 775 /u01/app/oracle
 [root@cmsnmdb2 ~]# mkdir -p /u01/app/oracle/product/11.2.0/db_1
 [root@cmsnmdb2 ~]# chown -R oracle:oinstall /u01/app/oracle/product/11.2.0/db_1
 [root@cmsnmdb2 ~]# chmod -R 775 /u01/app/oracle/product/11.2.0/db_1
 [root@cmsnmdb2 ~]#
 3.3 修改hosts 文件
 vi /etc/hosts
 #Public ip
 172.16.60.1 cmsnmdb1
 172.16.60.2 cmsnmdb2
 #Private ip
 150.150.1.1 cmsnmdb1-priv
 150.150.1.2 cmsnmdb2-priv
 #Virtual ip
 172.16.60.3 cmsnmdb1-vip
 172.16.60.4 cmsnmdb2-vip
 #Scan ip
 172.16.60.5 rac-scan
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 8 / 76
 3.4 修改limits.conf 文件
 vi /etc/security/limits.conf
 #ORACLE SETTING
 grid soft nproc 2047
 grid hard nproc 16384
 grid soft nofile 1024
 grid hard nofile 65536
 oracle soft nproc 2047
 oracle hard nproc 16384
 oracle soft nofile 1024
 oracle hard nofile 65536
 3.5 添加pam_limits.so 模块
 vi /etc/pam.d/login
 #ORACLE SETTING
 session required pam_limits.so
 3.6 修改linux 内核参数
 vi /etc/sysctl.conf
 #ORACLE SETTING
 fs.aio-max-nr = 1048576
 fs.file-max = 6815744
 kernel.shmall = 8388608
 kernel.shmmax = 536870912
 kernel.shmmax = 1073741824
 kernel.shmmni = 4096
 kernel.sem = 250 32000 100 128
 net.ipv4.ip_local_port_range = 9000 65500
 net.core.rmem_default = 262144
 net.core.rmem_max = 4194304
 net.core.wmem_default = 262144
 net.core.wmem_max = 1048586
 #/sbin/sysctl –p
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 9 / 76
 3.7 修改profile
 vi /etc/profile
 #ORACLE SETTING
 if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
 if [ $SHELL = "/bin/ksh" ]; then
 ulimit -p 16384
 ulimit -n 65536
 else
 ulimit -u 16384 -n 65536
 fi
 umask 022
 fi
 3.8 停ntp 时间同步(11G 新增检查选项)
 /etc/init.d/ntpd stop
 chkconfig ntpd off
 mv /etc/ntp.conf /etc/ntp.conf.org
 rm /etc/ntp.conf
 3.9 查看tmpfs 大小是否大于1G
 [root@cmsnmdb2 ~]# df -h /dev/shm
 Filesystem Size Used Avail Use% Mounted on
 tmpfs 16G 224M 16G 2% /dev/shm
 [root@cmsnmdb2 ~]#
 3.10 磁盘划分
 +OCR_VOTE 三个1G 盘
 +DATA 两个100G 盘
 +ARCH 两个100G 盘
 [root@cmsnmdb1 ~]# fdisk -l
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 10 / 76
 Disk /dev/sda: 298.9 GB, 298999349248 bytes
 255 heads, 63 sectors/track, 36351 cylinders
 Units = cylinders of 16065 * 512 = 8225280 bytes
 Device Boot Start End Blocks Id System
 /dev/sda1 * 1 13 104391 83 Linux
 /dev/sda2 14 36351 291884985 8e Linux LVM
 Disk /dev/sdb: 858.9 GB, 858993459200 bytes
 255 heads, 63 sectors/track, 104433 cylinders
 Units = cylinders of 16065 * 512 = 8225280 bytes
 Disk /dev/sdb doesn't contain a valid partition table
 [root@cmsnmdb1 ~]# fdisk /dev/sdb
 Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel
 Building a new DOS disklabel. Changes will remain in memory only,
 until you decide to write them. After that, of course, the previous
 content won't be recoverable.
 The number of cylinders for this disk is set to 104433.
 There is nothing wrong with that, but this is larger than 1024,
 and could in certain setups cause problems with:
 1) software that runs at boot time (e.g., old versions of LILO)
 2) booting and partitioning software from other OSs
 (e.g., DOS FDISK, OS/2 FDISK)
 Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)
 Command (m for help): n
 Command action
 e extended
 p primary partition (1-4)
 p
 Partition number (1-4): 1
 First cylinder (1-104433, default 1): 1
 Last cylinder or +size or +sizeM or +sizeK (1-104433, default 104433): +1024M
 Command (m for help): n
 Command action
 e extended
 p primary partition (1-4)
 p
 Partition number (1-4): 1
 Partition 1 is already defined. Delete it before re-adding it.
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 11 / 76
 Command (m for help): n
 Command action
 e extended
 p primary partition (1-4)
 p
 Partition number (1-4): 2
 First cylinder (126-104433, default 126):
 Using default value 126
 Last cylinder or +size or +sizeM or +sizeK (126-104433, default 104433): +1024M
 Command (m for help): n
 Command action
 e extended
 p primary partition (1-4)
 p
 Partition number (1-4): 3
 First cylinder (251-104433, default 251):
 Using default value 251
 Last cylinder or +size or +sizeM or +sizeK (251-104433, default 104433): +1024M
 Command (m for help): n
 Command action
 e extended
 p primary partition (1-4)
 e
 Selected partition 4
 First cylinder (376-104433, default 376):
 Using default value 376
 Last cylinder or +size or +sizeM or +sizeK (376-104433, default 104433):
 Using default value 104433
 Command (m for help): n
 First cylinder (376-104433, default 376):
 Using default value 376
 Last cylinder or +size or +sizeM or +sizeK (376-104433, default 104433): +102400M
 Command (m for help): n
 First cylinder (12826-104433, default 12826):
 Using default value 12826
 Last cylinder or +size or +sizeM or +sizeK (12826-104433, default 104433): +102400M
 Command (m for help): n
 First cylinder (25276-104433, default 25276):
 Using default value 25276
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 12 / 76
 Last cylinder or +size or +sizeM or +sizeK (25276-104433, default 104433): +102400M
 Command (m for help): n
 First cylinder (37726-104433, default 37726):
 Using default value 37726
 Last cylinder or +size or +sizeM or +sizeK (37726-104433, default 104433): +102400M
 Command (m for help): w
 The partition table has been altered!
 Calling ioctl() to re-read partition table.
 Syncing disks.
 [root@cmsnmdb1 ~]# fdisk -l
 Disk /dev/sda: 298.9 GB, 298999349248 bytes
 255 heads, 63 sectors/track, 36351 cylinders
 Units = cylinders of 16065 * 512 = 8225280 bytes
 Device Boot Start End Blocks Id System
 /dev/sda1 * 1 13 104391 83 Linux
 /dev/sda2 14 36351 291884985 8e Linux LVM
 Disk /dev/sdb: 858.9 GB, 858993459200 bytes
 255 heads, 63 sectors/track, 104433 cylinders
 Units = cylinders of 16065 * 512 = 8225280 bytes
 Device Boot Start End Blocks Id System
 /dev/sdb1 1 125 1004031 83 Linux
 /dev/sdb2 126 250 1004062+ 83 Linux
 /dev/sdb3 251 375 1004062+ 83 Linux
 /dev/sdb4 376 104433 835845885 5 Extended
 /dev/sdb5 376 12825 100004593+ 83 Linux
 /dev/sdb6 12826 25275 100004593+ 83 Linux
 /dev/sdb7 25276 37725 100004593+ 83 Linux
 /dev/sdb8 37726 50175 100004593+ 83 Linux
 [root@cmsnmdb1 ~]# /sbin/partprobe
 [root@cmsnmdb1 ~]#
 3.11 下载ASM
 http://www.oracle.com/technology/global/cn/tech/linux/asmlib/install.html
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 13 / 76
 oracleasm-support-2.1.3-1.el5.x86_64.rpm
 oracleasmlib-2.0.4-1.el5.x86_64.rpm
 oracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpm
 3.12 安装ASM
 rpm -Uvh oracleasm-support-2.1.3-1.el5.x86_64.rpm \
 oracleasmlib-2.0.4-1.el5.x86_64.rpm \
 oracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpm
 [root@cmsnmdb1 oracle]# rpm -Uvh oracleasm-support-2.1.3-1.el5.x86_64.rpm \
 > oracleasmlib-2.0.4-1.el5.x86_64.rpm \
 > oracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpm
 warning: oracleasm-support-2.1.3-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY,
 key ID 1e5e0159
 Preparing... ########################################### [100%]
 1:oracleasm-support ########################################### [ 33%]
 2:oracleasm-2.6.18-194.el########################################### [ 67%]
 3:oracleasmlib ########################################### [100%]
 [root@cmsnmdb1 oracle]#
 3.13 配置ASM
 /etc/init.d/oracleasm configure
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm configure
 Configuring the Oracle ASM library driver.
 This will configure the on-boot properties of the Oracle ASM library
 driver. The following questions will determine whether the driver is
 loaded on boot and what permissions it will have. The current values
 will be shown in brackets ('[]'). Hitting <ENTER> without typing an
 answer will keep that current value. Ctrl-C will abort.
 Default user to own the driver interface []: grid
 Default group to own the driver interface []: asmadmin
 Start Oracle ASM library driver on boot (y/n) [n]: y
 Scan for Oracle ASM disks on boot (y/n) [y]: y
 Writing Oracle ASM library driver configuration: done
 Initializing the Oracle ASMLib driver: [ OK ]
 Scanning the system for Oracle ASMLib disks: [ OK ]
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 14 / 76
 [root@cmsnmdb1 oracle]#
 3.14 创建ASM
 /etc/init.d/oracleasm createdisk OCR_VOTE01 /dev/sdb1
 /etc/init.d/oracleasm createdisk OCR_VOTE02 /dev/sdb2
 /etc/init.d/oracleasm createdisk OCR_VOTE03 /dev/sdb3
 /etc/init.d/oracleasm createdisk VOL1 /dev/sdb5
 /etc/init.d/oracleasm createdisk VOL2 /dev/sdb6
 /etc/init.d/oracleasm createdisk VOL3 /dev/sdb7
 /etc/init.d/oracleasm createdisk VOL4 /dev/sdb8
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm createdisk OCR_VOTE01 /dev/sdb1
 Marking disk "OCR_VOTE01" as an ASM disk: [ OK ]
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm createdisk OCR_VOTE02 /dev/sdb2
 Marking disk "OCR_VOTE02" as an ASM disk: [ OK ]
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm createdisk OCR_VOTE03 /dev/sdb3
 Marking disk "OCR_VOTE03" as an ASM disk: [ OK ]
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm createdisk VOL1 /dev/sdb5
 Marking disk "VOL1" as an ASM disk: [ OK ]
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm createdisk VOL2 /dev/sdb6
 Marking disk "VOL2" as an ASM disk: [ OK ]
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm createdisk VOL3 /dev/sdb7
 Marking disk "VOL3" as an ASM disk: [ OK ]
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm createdisk VOL4 /dev/sdb8
 Marking disk "VOL4" as an ASM disk: [ OK ]
 [root@cmsnmdb1 oracle]#
 /etc/init.d/oracleasm scandisks
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm scandisks
 Scanning the system for Oracle ASMLib disks: [ OK ]
 /etc/init.d/oracleasm listdisks
 [root@cmsnmdb1 oracle]# /etc/init.d/oracleasm listdisks
 OCR_VOTE01
 OCR_VOTE02
 OCR_VOTE03
 VOL1
 VOL2
 VOL3
 VOL4
 [root@cmsnmdb1 oracle]#
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 15 / 76
 3.15 为用户等效性配置SSH
 两个节点
 su - oracle
 mkdir ~/.ssh
 chmod 755 ~/.ssh
 ssh-keygen -t rsa
 ssh-keygen -t dsa
 在一个节点1 上
 cat ~/.ssh/id_rsa.pub >> ./.ssh/authorized_keys
 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
 在传到另一个节点
 ssh cmsnmdb2 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
 ssh cmsnmdb2 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
 scp ~/.ssh/authorized_keys cmsnmdb2:~/.ssh/authorized_keys
 在一个节点2 上
 cat ~/.ssh/id_rsa.pub >> ./.ssh/authorized_keys
 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
 在传到另一个节点
 ssh cmsnmdb1 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
 ssh cmsnmdb1 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
 scp ~/.ssh/authorized_keys cmsnmdb1:~/.ssh/authorized_keys
 验证等效性
 exec /usr/bin/ssh-agent $SHELL
 /usr/bin/ssh-add
 ssh cmsnmdb1 date
 ssh cmsnmdb2 date
 ssh cmsnmdb1-priv date
 ssh cmsnmdb2-priv date
 [root@cmsnmdb1 ~]# su - oracle
 [oracle@cmsnmdb1 ~]$ mkdir ~/.ssh
 [oracle@cmsnmdb1 ~]$ chmod 755 ~/.ssh
 [oracle@cmsnmdb1 ~]$ ssh-keygen -t rsa
 Generating public/private rsa key pair.
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 16 / 76
 Enter file in which to save the key (/home/oracle/.ssh/id_rsa):
 Enter passphrase (empty for no passphrase):
 Enter same passphrase again:
 Your identification has been saved in /home/oracle/.ssh/id_rsa.
 Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.
 The key fingerprint is:
 c1:bb:a9:28:7c:ec:98:17:93:00:f7:89:5c:f9:c5:0c oracle@cmsnmdb1
 [oracle@cmsnmdb1 ~]$ ssh-keygen -t dsa
 Generating public/private dsa key pair.
 Enter file in which to save the key (/home/oracle/.ssh/id_dsa):
 Enter passphrase (empty for no passphrase):
 Enter same passphrase again:
 Your identification has been saved in /home/oracle/.ssh/id_dsa.
 Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.
 The key fingerprint is:
 5d:42:b0:d0:f4:0e:26:73:a6:b5:81:5c:e7:76:64:cb oracle@cmsnmdb1
 [oracle@cmsnmdb1 ~]$ cat ~/.ssh/id_rsa.pub >> ./.ssh/authorized_keys
 [oracle@cmsnmdb1 ~]$ cat ~/.ssh/id_dsa.pub >> ./.ssh/authorized_keys
 [oracle@cmsnmdb1 ~]$ ssh cmsnmdb2 cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys
 The authenticity of host 'cmsnmdb2 (172.16.60.2)' can't be established.
 RSA key fingerprint is 78:b1:fc:a7:a2:58:0f:ef:14:75:b2:f9:3f:ad:4f:e5.
 Are you sure you want to continue connecting (yes/no)? yes
 Warning: Permanently added 'cmsnmdb2,172.16.60.2' (RSA) to the list of known hosts.
 oracle@cmsnmdb2's password:
 [oracle@cmsnmdb1 ~]$ ssh cmsnmdb2 cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys
 oracle@cmsnmdb2's password:
 [oracle@cmsnmdb1 ~]$ scp ~/.ssh/authorized_keys cmsnmdb2:~/.ssh/authorized_keys
 oracle@cmsnmdb2's password:
 authorized_keys
 100% 2004 2.0KB/s
 00:00
 [oracle@cmsnmdb1 ~]$ ssh cmsnmdb2 date
 Thu Dec 30 17:18:20 CST 2010
 [oracle@cmsnmdb1 ~]$ ssh cmsnmdb1 date
 The authenticity of host 'cmsnmdb1 (127.0.0.1)' can't be established.
 RSA key fingerprint is 16:83:72:3b:f0:fe:ca:73:26:f0:3b:6c:a5:47:43:ce.
 Are you sure you want to continue connecting (yes/no)? yes
 Warning: Permanently added 'cmsnmdb1' (RSA) to the list of known hosts.
 Thu Dec 30 17:18:45 CST 2010
 [oracle@cmsnmdb1 ~]$ ssh cmsnmdb1 date
 Thu Dec 30 17:18:49 CST 2010
 [oracle@cmsnmdb1 ~]$ ssh cmsnmdb1-priv date
 Thu Dec 30 17:19:36 CST 2010
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 17 / 76
 [oracle@cmsnmdb1 ~]$ ssh cmsnmdb2-priv date
 The authenticity of host 'cmsnmdb2-priv (150.150.1.2)' can't be established.
 RSA key fingerprint is 78:b1:fc:a7:a2:58:0f:ef:14:75:b2:f9:3f:ad:4f:e5.
 Are you sure you want to continue connecting (yes/no)? yes
 Warning: Permanently added 'cmsnmdb2-priv,150.150.1.2' (RSA) to the list of known
 hosts.
 Thu Dec 30 17:19:28 CST 2010
 [oracle@cmsnmdb1 ~]$ ssh cmsnmdb2-priv date
 Thu Dec 30 17:19:31 CST 2010
 [oracle@cmsnmdb1 ~]$
 grid 用户同oracle 用户一样设置
 3.16 修改gird、oracle 用户的.bash_profile 文件
 su - grid
 vi .bash_profile
 #Grid Settings
 TMP=/tmp; export TMP
 TMPDIR=$TMP; export TMPDIR
 ORACLE_SID=+ASM1; export ORACLE_SID
 ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE
 ORACLE_HOME=/u01/11.2.0/grid; export ORACLE_HOME
 GRID_HOME=/u01/11.2.0/grid; export GRID_HOME
 NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"; export NLS_DATE_FORMAT
 THREADS_FLAG=native; export THREADS_FLAG
 PATH=$ORACLE_HOME/bin:$PATH; export PATH
 THREADS_FLAG=native; export THREADS_FLAG
 PATH=$ORACLE_HOME/bin:$PATH; export PATH
 if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
 if [ $SHELL = "/bin/ksh" ]; then
 ulimit -p 16384
 ulimit -n 65536
 else
 ulimit -u 16384 -n 65536
 fi
 umask 022
 fi
 su - oracle
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 18 / 76
 vi .bash_profile
 #Oracle Settings
 TMP=/tmp; export TMP
 TMPDIR=$TMP; export TMPDIR
 ORACLE_HOSTNAME=cmsnmdb1; export ORACLE_HOSTNAME
 ORACLE_UNQNAME=CMSNM; export ORACLE_UNQNAME
 ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE
 ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1; export ORACLE_HOME
 ORACLE_SID=cmsnm1; export ORACLE_SID
 ORACLE_TERM=xterm; export ORACLE_TERM
 PATH=/usr/sbin:$PATH; export PATH
 PATH=$ORACLE_HOME/bin:$PATH; export PATH
 export NLS_LANG="SIMPLIFIED CHINESE_CHINA.ZHS16GBK"
 export NLS_DATE_FORMAT="yyyy-mm-dd hh24:mi:ss"
 LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib; export LD_LIBRARY_PATH
 CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib; export
 CLASSPATH
 if [ $USER = "oracle" ]; then
 if [ $SHELL = "/bin/ksh" ]; then
 ulimit -p 16384
 ulimit -n 65536
 else
 ulimit -u 16384 -n 65536
 fi
 fi
 3.17 校验能否安装grid
 ./runcluvfy.sh stage -pre crsinst -n cmsnmdb1,cmsnmdb2 -fixup -verbose
 [root@cmsnmdb1 ~]# su - grid
 [grid@cmsnmdb1 ~]$ unzip linux.x64_11gR2_grid.zip
 [grid@cmsnmdb1 ~]$ cd grid/
 [grid@cmsnmdb1 grid]$ ls
 doc install response rpm runcluvfy.sh runInstaller sshsetup stage
 welcome.html
 [grid@cmsnmdb1 grid]$ ./runcluvfy.sh stage -pre crsinst -n cmsnmdb1,cmsnmdb2 -fixup
 -verbose
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 19 / 76
 Performing pre-checks for cluster services setup
 Checking node reachability...
 Check: Node reachability from node "cmsnmdb1"
 Destination Node Reachable?
 ------------------------------------ ------------------------
 cmsnmdb2 yes
 cmsnmdb1 yes
 Result: Node reachability check passed from node "cmsnmdb1"
 Checking user equivalence...
 Check: User equivalence for user "grid"
 Node Name Comment
 ------------------------------------ ------------------------
 cmsnmdb2 passed
 cmsnmdb1 passed
 Result: User equivalence check passed for user "grid"
 Checking node connectivity...
 Checking hosts config file...
 Node Name Status Comment
 ------------ ------------------------ ------------------------
 cmsnmdb2 passed
 cmsnmdb1 passed
 Verification of the hosts config file successful
 Interface information for node "cmsnmdb2"
 Name IP Address Subnet Gateway Def. Gateway HW
 Address MTU
 ------ --------------- --------------- --------------- ---------------
 ----------------- ------
 eth0 172.16.60.2 172.16.60.0 0.0.0.0 172.16.60.254
 E4:1F:13:E3:35:E0 1500
 eth0 172.16.60.5 172.16.60.0 0.0.0.0 172.16.60.254
 E4:1F:13:E3:35:E0 1500
 eth0 172.16.60.4 172.16.60.0 0.0.0.0 172.16.60.254
 E4:1F:13:E3:35:E0 1500
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 20 / 76
 eth1 150.150.1.2 150.150.1.0 0.0.0.0 172.16.60.254
 E4:1F:13:E3:35:E2 1500
 usb0 169.254.95.120 169.254.95.0 0.0.0.0 172.16.60.254
 E6:1F:13:E4:35:E3 1500
 Interface information for node "cmsnmdb1"
 Name IP Address Subnet Gateway Def. Gateway HW
 Address MTU
 ------ --------------- --------------- --------------- ---------------
 ----------------- ------
 eth0 172.16.60.1 172.16.60.0 0.0.0.0 172.16.60.254
 E4:1F:13:E3:34:24 1500
 eth0 172.16.60.3 172.16.60.0 0.0.0.0 172.16.60.254
 E4:1F:13:E3:34:24 1500
 eth1 150.150.1.1 150.150.1.0 0.0.0.0 172.16.60.254
 E4:1F:13:E3:34:26 1500
 usb0 169.254.95.120 169.254.95.0 0.0.0.0 172.16.60.254
 E6:1F:13:E4:34:27 1500
 Check: Node connectivity of subnet "172.16.60.0"
 Source Destination Connected?
 ------------------------------ ------------------------------
 ----------------
 cmsnmdb2:eth0 cmsnmdb2:eth0 yes
 cmsnmdb2:eth0 cmsnmdb2:eth0 yes
 cmsnmdb2:eth0 cmsnmdb1:eth0 yes
 cmsnmdb2:eth0 cmsnmdb1:eth0 yes
 cmsnmdb2:eth0 cmsnmdb2:eth0 yes
 cmsnmdb2:eth0 cmsnmdb1:eth0 yes
 cmsnmdb2:eth0 cmsnmdb1:eth0 yes
 cmsnmdb2:eth0 cmsnmdb1:eth0 yes
 cmsnmdb2:eth0 cmsnmdb1:eth0 yes
 cmsnmdb1:eth0 cmsnmdb1:eth0 yes
 Result: Node connectivity passed for subnet "172.16.60.0" with node(s)
 cmsnmdb2,cmsnmdb1
 Check: TCP connectivity of subnet "172.16.60.0"
 Source Destination Connected?
 ------------------------------ ------------------------------
 ----------------
 cmsnmdb1:172.16.60.1 cmsnmdb2:172.16.60.2 passed
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 21 / 76
 cmsnmdb1:172.16.60.1 cmsnmdb2:172.16.60.5 passed
 cmsnmdb1:172.16.60.1 cmsnmdb2:172.16.60.4 passed
 cmsnmdb1:172.16.60.1 cmsnmdb1:172.16.60.3 passed
 Result: TCP connectivity check passed for subnet "172.16.60.0"
 Check: Node connectivity of subnet "150.150.1.0"
 Source Destination Connected?
 ------------------------------ ------------------------------
 ----------------
 cmsnmdb2:eth1 cmsnmdb1:eth1 yes
 Result: Node connectivity passed for subnet "150.150.1.0" with node(s)
 cmsnmdb2,cmsnmdb1
 Check: TCP connectivity of subnet "150.150.1.0"
 Source Destination Connected?
 ------------------------------ ------------------------------
 ----------------
 cmsnmdb1:150.150.1.1 cmsnmdb2:150.150.1.2 passed
 Result: TCP connectivity check passed for subnet "150.150.1.0"
 Check: Node connectivity of subnet "169.254.95.0"
 Source Destination Connected?
 ------------------------------ ------------------------------
 ----------------
 cmsnmdb2:usb0 cmsnmdb1:usb0 yes
 Result: Node connectivity passed for subnet "169.254.95.0" with node(s)
 cmsnmdb2,cmsnmdb1
 Check: TCP connectivity of subnet "169.254.95.0"
 Result: TCP connectivity check failed for subnet "169.254.95.0"
 Interfaces found on subnet "172.16.60.0" that are likely candidates for VIP are:
 cmsnmdb2 eth0:172.16.60.2 eth0:172.16.60.5 eth0:172.16.60.4
 cmsnmdb1 eth0:172.16.60.1 eth0:172.16.60.3
 Interfaces found on subnet "150.150.1.0" that are likely candidates for VIP are:
 cmsnmdb2 eth1:150.150.1.2
 cmsnmdb1 eth1:150.150.1.1
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 22 / 76
 Interfaces found on subnet "169.254.95.0" that are likely candidates for VIP are:
 cmsnmdb2 usb0:169.254.95.120
 cmsnmdb1 usb0:169.254.95.120
 WARNING:
 Could not find a suitable set of interfaces for the private interconnect
 Result: Node connectivity check passed
 Check: Total memory
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 31.37GB (3.2897816E7KB) 1.5GB (1572864.0KB) passed
 cmsnmdb1 31.37GB (3.2897816E7KB) 1.5GB (1572864.0KB) passed
 Result: Total memory check passed
 Check: Available memory
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 29.11GB (3.0519688E7KB) 50MB (51200.0KB) passed
 cmsnmdb1 28.28GB (2.9654156E7KB) 50MB (51200.0KB) passed
 Result: Available memory check passed
 Check: Swap space
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 33.31GB (3.493068E7KB) 16GB (1.6777216E7KB) passed
 cmsnmdb1 33.31GB (3.493068E7KB) 16GB (1.6777216E7KB) passed
 Result: Swap space check passed
 Check: Free disk space for "cmsnmdb2:/tmp"
 Path Node Name Mount point Available Required
 Comment
 ---------------- ------------ ------------ ------------ ------------
 ------------
 /tmp cmsnmdb2 / 220.99GB 1GB
 passed
 Result: Free disk space check passed for "cmsnmdb2:/tmp"
 Check: Free disk space for "cmsnmdb1:/tmp"
 Path Node Name Mount point Available Required
 Comment
 ---------------- ------------ ------------ ------------ ------------
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 23 / 76
 ------------
 /tmp cmsnmdb1 / 189.8GB 1GB
 passed
 Result: Free disk space check passed for "cmsnmdb1:/tmp"
 Check: User existence for "grid"
 Node Name Status Comment
 ------------ ------------------------ ------------------------
 cmsnmdb2 exists passed
 cmsnmdb1 exists passed
 Result: User existence check passed for "grid"
 Check: Group existence for "oinstall"
 Node Name Status Comment
 ------------ ------------------------ ------------------------
 cmsnmdb2 exists passed
 cmsnmdb1 exists passed
 Result: Group existence check passed for "oinstall"
 Check: Group existence for "dba"
 Node Name Status Comment
 ------------ ------------------------ ------------------------
 cmsnmdb2 exists passed
 cmsnmdb1 exists passed
 Result: Group existence check passed for "dba"
 Check: Membership of user "grid" in group "oinstall" [as Primary]
 Node Name User Exists Group Exists User in Group Primary
 Comment
 ---------------- ------------ ------------ ------------ ------------
 ------------
 cmsnmdb2 yes yes yes yes
 passed
 cmsnmdb1 yes yes yes yes
 passed
 Result: Membership check for user "grid" in group "oinstall" [as Primary] passed
 Check: Membership of user "grid" in group "dba"
 Node Name User Exists Group Exists User in Group Comment
 ---------------- ------------ ------------ ------------ ----------------
 cmsnmdb2 yes yes yes passed
 cmsnmdb1 yes yes yes passed
 Result: Membership check for user "grid" in group "dba" passed
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 24 / 76
 Check: Run level
 Node Name run level Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 5 3,5 passed
 cmsnmdb1 5 3,5 passed
 Result: Run level check passed
 Check: Hard limits for "maximum open file descriptors"
 Node Name Type Available Required Comment
 ---------------- ------------ ------------ ------------ ----------------
 cmsnmdb2 hard 65536 65536 passed
 cmsnmdb1 hard 65536 65536 passed
 Result: Hard limits check passed for "maximum open file descriptors"
 Check: Soft limits for "maximum open file descriptors"
 Node Name Type Available Required Comment
 ---------------- ------------ ------------ ------------ ----------------
 cmsnmdb2 soft 1024 1024 passed
 cmsnmdb1 soft 1024 1024 passed
 Result: Soft limits check passed for "maximum open file descriptors"
 Check: Hard limits for "maximum user processes"
 Node Name Type Available Required Comment
 ---------------- ------------ ------------ ------------ ----------------
 cmsnmdb2 hard 16384 16384 passed
 cmsnmdb1 hard 16384 16384 passed
 Result: Hard limits check passed for "maximum user processes"
 Check: Soft limits for "maximum user processes"
 Node Name Type Available Required Comment
 ---------------- ------------ ------------ ------------ ----------------
 cmsnmdb2 soft 2047 2047 passed
 cmsnmdb1 soft 2047 2047 passed
 Result: Soft limits check passed for "maximum user processes"
 Check: System architecture
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 x86_64 x86_64 passed
 cmsnmdb1 x86_64 x86_64 passed
 Result: System architecture check passed
 Check: Kernel version
 Node Name Available Required Comment
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 25 / 76
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 2.6.18-194.el5 2.6.18 passed
 cmsnmdb1 2.6.18-194.el5 2.6.18 passed
 Result: Kernel version check passed
 Check: Kernel parameter for "semmsl"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 250 250 passed
 cmsnmdb1 250 250 passed
 Result: Kernel parameter check passed for "semmsl"
 Check: Kernel parameter for "semmns"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 32000 32000 passed
 cmsnmdb1 32000 32000 passed
 Result: Kernel parameter check passed for "semmns"
 Check: Kernel parameter for "semopm"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 100 100 passed
 cmsnmdb1 100 100 passed
 Result: Kernel parameter check passed for "semopm"
 Check: Kernel parameter for "semmni"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 128 128 passed
 cmsnmdb1 128 128 passed
 Result: Kernel parameter check passed for "semmni"
 Check: Kernel parameter for "shmmax"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 68719476736 536870912 passed
 cmsnmdb1 68719476736 536870912 passed
 Result: Kernel parameter check passed for "shmmax"
 Check: Kernel parameter for "shmmni"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 4096 4096 passed
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 26 / 76
 cmsnmdb1 4096 4096 passed
 Result: Kernel parameter check passed for "shmmni"
 Check: Kernel parameter for "shmall"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 4294967296 2097152 passed
 cmsnmdb1 4294967296 2097152 passed
 Result: Kernel parameter check passed for "shmall"
 Check: Kernel parameter for "file-max"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 6815744 6815744 passed
 cmsnmdb1 6815744 6815744 passed
 Result: Kernel parameter check passed for "file-max"
 Check: Kernel parameter for "ip_local_port_range"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 between 9000 & 65500 between 9000 & 65500 passed
 cmsnmdb1 between 9000 & 65500 between 9000 & 65500 passed
 Result: Kernel parameter check passed for "ip_local_port_range"
 Check: Kernel parameter for "rmem_default"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 262144 262144 passed
 cmsnmdb1 262144 262144 passed
 Result: Kernel parameter check passed for "rmem_default"
 Check: Kernel parameter for "rmem_max"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 4194304 4194304 passed
 cmsnmdb1 4194304 4194304 passed
 Result: Kernel parameter check passed for "rmem_max"
 Check: Kernel parameter for "wmem_default"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 262144 262144 passed
 cmsnmdb1 262144 262144 passed
 Result: Kernel parameter check passed for "wmem_default"
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 27 / 76
 Check: Kernel parameter for "wmem_max"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 1048586 1048576 passed
 cmsnmdb1 1048586 1048576 passed
 Result: Kernel parameter check passed for "wmem_max"
 Check: Kernel parameter for "aio-max-nr"
 Node Name Configured Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 1048576 1048576 passed
 cmsnmdb1 1048576 1048576 passed
 Result: Kernel parameter check passed for "aio-max-nr"
 Check: Package existence for "make-3.81"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 make-3.81-3.el5 make-3.81 passed
 cmsnmdb1 make-3.81-3.el5 make-3.81 passed
 Result: Package existence check passed for "make-3.81"
 Check: Package existence for "binutils-2.17.50.0.6"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 binutils-2.17.50.0.6-14.el5 binutils-2.17.50.0.6 passed
 cmsnmdb1 binutils-2.17.50.0.6-14.el5 binutils-2.17.50.0.6 passed
 Result: Package existence check passed for "binutils-2.17.50.0.6"
 Check: Package existence for "gcc-4.1"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 gcc-4.1.2-48.el5 gcc-4.1 passed
 cmsnmdb1 gcc-4.1.2-48.el5 gcc-4.1 passed
 Result: Package existence check passed for "gcc-4.1"
 Check: Package existence for "libaio-0.3.106 (i386)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 libaio-0.3.106-5 (i386) libaio-0.3.106 (i386) passed
 cmsnmdb1 libaio-0.3.106-5 (i386) libaio-0.3.106 (i386) passed
 Result: Package existence check passed for "libaio-0.3.106 (i386)"
 Check: Package existence for "libaio-0.3.106 (x86_64)"
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 28 / 76
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 libaio-0.3.106-5 (x86_64) libaio-0.3.106 (x86_64) passed
 cmsnmdb1 libaio-0.3.106-5 (x86_64) libaio-0.3.106 (x86_64) passed
 Result: Package existence check passed for "libaio-0.3.106 (x86_64)"
 Check: Package existence for "glibc-2.5-24 (i686)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 glibc-2.5-49 (i686) glibc-2.5-24 (i686) passed
 cmsnmdb1 glibc-2.5-49 (i686) glibc-2.5-24 (i686) passed
 Result: Package existence check passed for "glibc-2.5-24 (i686)"
 Check: Package existence for "glibc-2.5-24 (x86_64)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 glibc-2.5-49 (x86_64) glibc-2.5-24 (x86_64) passed
 cmsnmdb1 glibc-2.5-49 (x86_64) glibc-2.5-24 (x86_64) passed
 Result: Package existence check passed for "glibc-2.5-24 (x86_64)"
 Check: Package existence for "compat-libstdc++-33-3.2.3 (i386)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 compat-libstdc++-33-3.2.3-61 (i386) compat-libstdc++-33-3.2.3
 (i386) passed
 cmsnmdb1 compat-libstdc++-33-3.2.3-61 (i386) compat-libstdc++-33-3.2.3
 (i386) passed
 Result: Package existence check passed for "compat-libstdc++-33-3.2.3 (i386)"
 Check: Package existence for "compat-libstdc++-33-3.2.3 (x86_64)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 compat-libstdc++-33-3.2.3-61 (x86_64)
 compat-libstdc++-33-3.2.3 (x86_64) passed
 cmsnmdb1 compat-libstdc++-33-3.2.3-61 (x86_64)
 compat-libstdc++-33-3.2.3 (x86_64) passed
 Result: Package existence check passed for "compat-libstdc++-33-3.2.3 (x86_64)"
 Check: Package existence for "elfutils-libelf-0.125 (x86_64)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 elfutils-libelf-0.137-3.el5 (x86_64) elfutils-libelf-0.125
 (x86_64) passed
 cmsnmdb1 elfutils-libelf-0.137-3.el5 (x86_64) elfutils-libelf-0.125
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 29 / 76
 (x86_64) passed
 Result: Package existence check passed for "elfutils-libelf-0.125 (x86_64)"
 Check: Package existence for "elfutils-libelf-devel-0.125"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125
 passed
 cmsnmdb1 elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125
 passed
 Result: Package existence check passed for "elfutils-libelf-devel-0.125"
 Check: Package existence for "glibc-common-2.5"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 glibc-common-2.5-49 glibc-common-2.5 passed
 cmsnmdb1 glibc-common-2.5-49 glibc-common-2.5 passed
 Result: Package existence check passed for "glibc-common-2.5"
 Check: Package existence for "glibc-devel-2.5 (i386)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 glibc-devel-2.5-49 (i386) glibc-devel-2.5 (i386) passed
 cmsnmdb1 glibc-devel-2.5-49 (i386) glibc-devel-2.5 (i386) passed
 Result: Package existence check passed for "glibc-devel-2.5 (i386)"
 Check: Package existence for "glibc-devel-2.5 (x86_64)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 glibc-devel-2.5-49 (x86_64) glibc-devel-2.5 (x86_64) passed
 cmsnmdb1 glibc-devel-2.5-49 (x86_64) glibc-devel-2.5 (x86_64) passed
 Result: Package existence check passed for "glibc-devel-2.5 (x86_64)"
 Check: Package existence for "glibc-headers-2.5"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 glibc-headers-2.5-49 glibc-headers-2.5 passed
 cmsnmdb1 glibc-headers-2.5-49 glibc-headers-2.5 passed
 Result: Package existence check passed for "glibc-headers-2.5"
 Check: Package existence for "gcc-c++-4.1.2"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 gcc-c++-4.1.2-48.el5 gcc-c++-4.1.2 passed
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 30 / 76
 cmsnmdb1 gcc-c++-4.1.2-48.el5 gcc-c++-4.1.2 passed
 Result: Package existence check passed for "gcc-c++-4.1.2"
 Check: Package existence for "libaio-devel-0.3.106 (i386)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 libaio-devel-0.3.106-5 (i386) libaio-devel-0.3.106 (i386)
 passed
 cmsnmdb1 libaio-devel-0.3.106-5 (i386) libaio-devel-0.3.106 (i386)
 passed
 Result: Package existence check passed for "libaio-devel-0.3.106 (i386)"
 Check: Package existence for "libaio-devel-0.3.106 (x86_64)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 libaio-devel-0.3.106-5 (x86_64) libaio-devel-0.3.106 (x86_64)
 passed
 cmsnmdb1 libaio-devel-0.3.106-5 (x86_64) libaio-devel-0.3.106 (x86_64)
 passed
 Result: Package existence check passed for "libaio-devel-0.3.106 (x86_64)"
 Check: Package existence for "libgcc-4.1.2 (i386)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 libgcc-4.1.2-48.el5 (i386) libgcc-4.1.2 (i386) passed
 cmsnmdb1 libgcc-4.1.2-48.el5 (i386) libgcc-4.1.2 (i386) passed
 Result: Package existence check passed for "libgcc-4.1.2 (i386)"
 Check: Package existence for "libgcc-4.1.2 (x86_64)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 libgcc-4.1.2-48.el5 (x86_64) libgcc-4.1.2 (x86_64) passed
 cmsnmdb1 libgcc-4.1.2-48.el5 (x86_64) libgcc-4.1.2 (x86_64) passed
 Result: Package existence check passed for "libgcc-4.1.2 (x86_64)"
 Check: Package existence for "libstdc++-4.1.2 (i386)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 libstdc++-4.1.2-48.el5 (i386) libstdc++-4.1.2 (i386) passed
 cmsnmdb1 libstdc++-4.1.2-48.el5 (i386) libstdc++-4.1.2 (i386) passed
 Result: Package existence check passed for "libstdc++-4.1.2 (i386)"
 Check: Package existence for "libstdc++-4.1.2 (x86_64)"
 Node Name Available Required Comment
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 31 / 76
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 libstdc++-4.1.2-48.el5 (x86_64) libstdc++-4.1.2 (x86_64)
 passed
 cmsnmdb1 libstdc++-4.1.2-48.el5 (x86_64) libstdc++-4.1.2 (x86_64)
 passed
 Result: Package existence check passed for "libstdc++-4.1.2 (x86_64)"
 Check: Package existence for "libstdc++-devel-4.1.2 (x86_64)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 libstdc++-devel-4.1.2-48.el5 (x86_64) libstdc++-devel-4.1.2
 (x86_64) passed
 cmsnmdb1 libstdc++-devel-4.1.2-48.el5 (x86_64) libstdc++-devel-4.1.2
 (x86_64) passed
 Result: Package existence check passed for "libstdc++-devel-4.1.2 (x86_64)"
 Check: Package existence for "sysstat-7.0.2"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 sysstat-7.0.2-3.el5 sysstat-7.0.2 passed
 cmsnmdb1 sysstat-7.0.2-3.el5 sysstat-7.0.2 passed
 Result: Package existence check passed for "sysstat-7.0.2"
 Check: Package existence for "unixODBC-2.2.11 (i386)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 unixODBC-2.2.11-7.1 (i386) unixODBC-2.2.11 (i386) passed
 cmsnmdb1 unixODBC-2.2.11-7.1 (i386) unixODBC-2.2.11 (i386) passed
 Result: Package existence check passed for "unixODBC-2.2.11 (i386)"
 Check: Package existence for "unixODBC-2.2.11 (x86_64)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 unixODBC-2.2.11-7.1 (x86_64) unixODBC-2.2.11 (x86_64) passed
 cmsnmdb1 unixODBC-2.2.11-7.1 (x86_64) unixODBC-2.2.11 (x86_64) passed
 Result: Package existence check passed for "unixODBC-2.2.11 (x86_64)"
 Check: Package existence for "unixODBC-devel-2.2.11 (i386)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 unixODBC-devel-2.2.11-7.1 (i386) unixODBC-devel-2.2.11 (i386)
 passed
 cmsnmdb1 unixODBC-devel-2.2.11-7.1 (i386) unixODBC-devel-2.2.11 (i386)
 passed
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 32 / 76
 Result: Package existence check passed for "unixODBC-devel-2.2.11 (i386)"
 Check: Package existence for "unixODBC-devel-2.2.11 (x86_64)"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 unixODBC-devel-2.2.11-7.1 (x86_64) unixODBC-devel-2.2.11
 (x86_64) passed
 cmsnmdb1 unixODBC-devel-2.2.11-7.1 (x86_64) unixODBC-devel-2.2.11
 (x86_64) passed
 Result: Package existence check passed for "unixODBC-devel-2.2.11 (x86_64)"
 Check: Package existence for "ksh-20060214"
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 ksh-20100202-1.el5 ksh-20060214 passed
 cmsnmdb1 ksh-20100202-1.el5 ksh-20060214 passed
 Result: Package existence check passed for "ksh-20060214"
 Checking for multiple users with UID value 0
 Result: Check for multiple users with UID value 0 passed
 Check: Current group ID
 Result: Current group ID check passed
 Checking Core file name pattern consistency...
 Core file name pattern consistency check passed.
 Checking to make sure user "grid" is not in "root" group
 Node Name Status Comment
 ------------ ------------------------ ------------------------
 cmsnmdb2 does not exist passed
 cmsnmdb1 does not exist passed
 Result: User "grid" is not part of "root" group. Check passed
 Check default user file creation mask
 Node Name Available Required Comment
 ------------ ------------------------ ------------------------ ----------
 cmsnmdb2 0022 0022 passed
 cmsnmdb1 0022 0022 passed
 Result: Default user file creation mask check passed
 Starting Clock synchronization checks using Network Time Protocol(NTP)...
 NTP Configuration file check started...
 Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 33 / 76
 Cluster Time Synchronization Service
 (CTSS) can be used instead of NTP for time synchronization on the cluster nodes
 Result: Clock synchronization check using Network Time Protocol(NTP) passed
 Pre-check for cluster services setup was successful.
 [grid@cmsnmdb1 grid]$
 3.18 安装grid
 [grid@cmsnmdb1 grid]$ ./runInstaller
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 34 / 76
 选择高级安装
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 35 / 76
 选择下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 36 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 37 / 76
 添加vip 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 38 / 76
 修改网口IP 属性,下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 39 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 40 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 41 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 42 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 43 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 44 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 45 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 46 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 47 / 76
 开始安装
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 48 / 76
 执行脚本
 [root@cmsnmdb1 oracle]# /u01/app/oraInventory/orainstRoot.sh
 Changing permissions of /u01/app/oraInventory.
 Adding read,write permissions for group.
 Removing read,write,execute permissions for world.
 Changing groupname of /u01/app/oraInventory to oinstall.
 The execution of the script is complete.
 [root@cmsnmdb1 oracle]# /u01/11.2.0/grid/root.sh
 Running Oracle 11g root.sh script...
 The following environment variables are set as:
 ORACLE_OWNER= grid
 ORACLE_HOME= /u01/11.2.0/grid
 Enter the full pathname of the local bin directory: [/usr/local/bin]:
 Copying dbhome to /usr/local/bin ...
 Copying oraenv to /usr/local/bin ...
 Copying coraenv to /usr/local/bin ...
 Creating /etc/oratab file...
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 49 / 76
 Entries will be added to the /etc/oratab file as needed by
 Database Configuration Assistant when a database is created
 Finished running generic part of root.sh script.
 Now product-specific root actions will be performed.
 2010-12-30 20:31:34: Parsing the host name
 2010-12-30 20:31:34: Checking for super user privileges
 2010-12-30 20:31:34: User has super user privileges
 Using configuration parameter file: /u01/11.2.0/grid/crs/install/crsconfig_params
 Creating trace directory
 LOCAL ADD MODE
 Creating OCR keys for user 'root', privgrp 'root'..
 Operation successful.
 root wallet
 root wallet cert
 root cert export
 peer wallet
 profile reader wallet
 pa wallet
 peer wallet keys
 pa wallet keys
 peer cert request
 pa cert request
 peer cert
 pa cert
 peer root cert TP
 profile reader root cert TP
 pa root cert TP
 peer pa cert TP
 pa peer cert TP
 profile reader pa cert TP
 profile reader peer cert TP
 peer user cert
 pa user cert
 Adding daemon to inittab
 CRS-4123: Oracle High Availability Services has been started.
 ohasd is starting
 CRS-2672: Attempting to start 'ora.gipcd' on 'cmsnmdb1'
 CRS-2672: Attempting to start 'ora.mdnsd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.gipcd' on 'cmsnmdb1' succeeded
 CRS-2676: Start of 'ora.mdnsd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.gpnpd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.gpnpd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.cssdmonitor' on 'cmsnmdb1' succeeded
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 50 / 76
 CRS-2672: Attempting to start 'ora.cssd' on 'cmsnmdb1'
 CRS-2672: Attempting to start 'ora.diskmon' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.diskmon' on 'cmsnmdb1' succeeded
 CRS-2676: Start of 'ora.cssd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.ctssd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.ctssd' on 'cmsnmdb1' succeeded
 ASM created and started successfully.
 DiskGroup OCR_VOTE created successfully.
 clscfg: -install mode specified
 Successfully accumulated necessary OCR keys.
 Creating OCR keys for user 'root', privgrp 'root'..
 Operation successful.
 CRS-2672: Attempting to start 'ora.crsd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.crsd' on 'cmsnmdb1' succeeded
 CRS-4256: Updating the profile
 Successful addition of voting disk a6339fdf915a4f06bfdf8a74d216f39b.
 Successful addition of voting disk 969178ce88444f29bf3c9f04d3fe2c06.
 Successful addition of voting disk 0be6c9bd693b4f15bff4ce4ca5a5eaa2.
 Successfully replaced voting disk group with +OCR_VOTE.
 CRS-4256: Updating the profile
 CRS-4266: Voting file(s) successfully replaced
 ## STATE File Universal Id File Name Disk group
 -- ----- ----------------- --------- ---------
 1. ONLINE a6339fdf915a4f06bfdf8a74d216f39b (ORCL:OCR_VOTE01) [OCR_VOTE]
 2. ONLINE 969178ce88444f29bf3c9f04d3fe2c06 (ORCL:OCR_VOTE02) [OCR_VOTE]
 3. ONLINE 0be6c9bd693b4f15bff4ce4ca5a5eaa2 (ORCL:OCR_VOTE03) [OCR_VOTE]
 Located 3 voting disk(s).
 CRS-2673: Attempting to stop 'ora.crsd' on 'cmsnmdb1'
 CRS-2677: Stop of 'ora.crsd' on 'cmsnmdb1' succeeded
 CRS-2673: Attempting to stop 'ora.asm' on 'cmsnmdb1'
 CRS-2677: Stop of 'ora.asm' on 'cmsnmdb1' succeeded
 CRS-2673: Attempting to stop 'ora.ctssd' on 'cmsnmdb1'
 CRS-2677: Stop of 'ora.ctssd' on 'cmsnmdb1' succeeded
 CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'cmsnmdb1'
 CRS-2677: Stop of 'ora.cssdmonitor' on 'cmsnmdb1' succeeded
 CRS-2673: Attempting to stop 'ora.cssd' on 'cmsnmdb1'
 CRS-2677: Stop of 'ora.cssd' on 'cmsnmdb1' succeeded
 CRS-2673: Attempting to stop 'ora.gpnpd' on 'cmsnmdb1'
 CRS-2677: Stop of 'ora.gpnpd' on 'cmsnmdb1' succeeded
 CRS-2673: Attempting to stop 'ora.gipcd' on 'cmsnmdb1'
 CRS-2677: Stop of 'ora.gipcd' on 'cmsnmdb1' succeeded
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 51 / 76
 CRS-2673: Attempting to stop 'ora.mdnsd' on 'cmsnmdb1'
 CRS-2677: Stop of 'ora.mdnsd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.mdnsd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.mdnsd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.gipcd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.gipcd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.gpnpd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.gpnpd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.cssdmonitor' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.cssd' on 'cmsnmdb1'
 CRS-2672: Attempting to start 'ora.diskmon' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.diskmon' on 'cmsnmdb1' succeeded
 CRS-2676: Start of 'ora.cssd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.ctssd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.ctssd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.asm' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.asm' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.crsd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.crsd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.evmd' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.evmd' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.asm' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.asm' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.OCR_VOTE.dg' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.OCR_VOTE.dg' on 'cmsnmdb1' succeeded
 CRS-2672: Attempting to start 'ora.registry.acfs' on 'cmsnmdb1'
 CRS-2676: Start of 'ora.registry.acfs' on 'cmsnmdb1' succeeded
 cmsnmdb1 2010/12/30 20:37:33
 /u01/11.2.0/grid/cdata/cmsnmdb1/backup_20101230_203733.olr
 Preparing packages for installation...
 cvuqdisk-1.0.7-1
 Configure Oracle Grid Infrastructure for a Cluster ... succeeded
 Updating inventory properties for clusterware
 Starting Oracle Universal Installer...
 Checking swap space: must be greater than 500 MB. Actual 34111 MB Passed
 The inventory pointer is located at /etc/oraInst.loc
 The inventory is located at /u01/app/oraInventory
 'UpdateNodeList' was successful.
 [root@cmsnmdb1 oracle]#
 [root@cmsnmdb2 oracle]# /u01/app/oraInventory/orainstRoot.sh
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 52 / 76
 Changing permissions of /u01/app/oraInventory.
 Adding read,write permissions for group.
 Removing read,write,execute permissions for world.
 Changing groupname of /u01/app/oraInventory to oinstall.
 The execution of the script is complete.
 [root@cmsnmdb2 oracle]# /u01/11.2.0/grid/root.sh
 Running Oracle 11g root.sh script...
 The following environment variables are set as:
 ORACLE_OWNER= grid
 ORACLE_HOME= /u01/11.2.0/grid
 Enter the full pathname of the local bin directory: [/usr/local/bin]:
 Copying dbhome to /usr/local/bin ...
 Copying oraenv to /usr/local/bin ...
 Copying coraenv to /usr/local/bin ...
 Creating /etc/oratab file...
 Entries will be added to the /etc/oratab file as needed by
 Database Configuration Assistant when a database is created
 Finished running generic part of root.sh script.
 Now product-specific root actions will be performed.
 2010-12-30 20:37:44: Parsing the host name
 2010-12-30 20:37:44: Checking for super user privileges
 2010-12-30 20:37:44: User has super user privileges
 Using configuration parameter file: /u01/11.2.0/grid/crs/install/crsconfig_params
 Creating trace directory
 LOCAL ADD MODE
 Creating OCR keys for user 'root', privgrp 'root'..
 Operation successful.
 Adding daemon to inittab
 CRS-4123: Oracle High Availability Services has been started.
 ohasd is starting
 CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon
 on node cmsnmdb1, number 1, and is
 terminating
 An active cluster was found during exclusive startup, restarting to join the cluster
 CRS-2672: Attempting to start 'ora.mdnsd' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.mdnsd' on 'cmsnmdb2' succeeded
 CRS-2672: Attempting to start 'ora.gipcd' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.gipcd' on 'cmsnmdb2' succeeded
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 53 / 76
 CRS-2672: Attempting to start 'ora.gpnpd' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.gpnpd' on 'cmsnmdb2' succeeded
 CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.cssdmonitor' on 'cmsnmdb2' succeeded
 CRS-2672: Attempting to start 'ora.cssd' on 'cmsnmdb2'
 CRS-2672: Attempting to start 'ora.diskmon' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.diskmon' on 'cmsnmdb2' succeeded
 CRS-2676: Start of 'ora.cssd' on 'cmsnmdb2' succeeded
 CRS-2672: Attempting to start 'ora.ctssd' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.ctssd' on 'cmsnmdb2' succeeded
 CRS-2672: Attempting to start 'ora.drivers.acfs' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.drivers.acfs' on 'cmsnmdb2' succeeded
 CRS-2672: Attempting to start 'ora.asm' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.asm' on 'cmsnmdb2' succeeded
 CRS-2672: Attempting to start 'ora.crsd' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.crsd' on 'cmsnmdb2' succeeded
 CRS-2672: Attempting to start 'ora.evmd' on 'cmsnmdb2'
 CRS-2676: Start of 'ora.evmd' on 'cmsnmdb2' succeeded
 cmsnmdb2 2010/12/30 20:42:00
 /u01/11.2.0/grid/cdata/cmsnmdb2/backup_20101230_204200.olr
 Preparing packages for installation...
 cvuqdisk-1.0.7-1
 Configure Oracle Grid Infrastructure for a Cluster ... succeeded
 Updating inventory properties for clusterware
 Starting Oracle Universal Installer...
 Checking swap space: must be greater than 500 MB. Actual 34111 MB Passed
 The inventory pointer is located at /etc/oraInst.loc
 The inventory is located at /u01/app/oraInventory
 'UpdateNodeList' was successful.
 [root@cmsnmdb2 oracle]#
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 54 / 76
 grid 安装完成
 3.19 安装Oracle 软件
 [oracle@cmsnmdb1 ~]$ cd database/
 [oracle@cmsnmdb1 database]$ ./runInstaller
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 55 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 56 / 76
 选择只安装软件,下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 57 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 58 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 59 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 60 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 61 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 62 / 76
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 63 / 76
 开始安装
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 64 / 76
 执行脚本OK
 ORACLE 软件安装完成
 3.20 创建ASM 磁盘组
 [root@cmsnmdb1 ~]# su - grid
 [grid@cmsnmdb1 ~]$ export DISPLAY=172.16.61.108:0.0
 [grid@cmsnmdb1 ~]$ asmca
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 65 / 76
 创建
 DATA 组
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 66 / 76
 ARCH 组
 ASM 组创建完毕
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 67 / 76
 3.21 创建数据库
 [root@cmsnmdb1 ~]# su – oracle
 [oracle@cmsnmdb1 ~]$ export DISPLAY=172.16.61.108:0.0
 [oracle@cmsnmdb1 ~]$ dbca
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 68 / 76
 下一步
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 69 / 76
 下一步
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 70 / 76
 下一步
 输入+DATA
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 71 / 76
 输入+ARCH,归档模式选择,下一步
 下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 72 / 76
 修改内存分配,连接数,字符集,下一步
 修改数据文件大小,下一步
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 73 / 76
 完成
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 74 / 76
 完成建库
 四.维护ORACLE RAC
 4.1 查看RAC 运行状态
 [root@cmsnmdb1 ~]# su - grid
 [grid@cmsnmdb1 ~]$ crs_stat -t
 Name Type Target State Host
 ------------------------------------------------------------
 ora.ARCH.dg ora....up.type ONLINE ONLINE cmsnmdb1
 ora.DATA.dg ora....up.type ONLINE ONLINE cmsnmdb1
 ora....ER.lsnr ora....er.type ONLINE ONLINE cmsnmdb1
 ora....N1.lsnr ora....er.type ONLINE ONLINE cmsnmdb2
 ora....VOTE.dg ora....up.type ONLINE ONLINE cmsnmdb1
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 75 / 76
 ora.asm ora.asm.type ONLINE ONLINE cmsnmdb1
 ora.cmsnm.db ora....se.type ONLINE ONLINE cmsnmdb1
 ora....SM1.asm application ONLINE ONLINE cmsnmdb1
 ora....B1.lsnr application ONLINE ONLINE cmsnmdb1
 ora....db1.gsd application ONLINE ONLINE cmsnmdb1
 ora....db1.ons application ONLINE ONLINE cmsnmdb1
 ora....db1.vip ora....t1.type ONLINE ONLINE cmsnmdb1
 ora....SM2.asm application ONLINE ONLINE cmsnmdb2
 ora....B2.lsnr application ONLINE ONLINE cmsnmdb2
 ora....db2.gsd application ONLINE ONLINE cmsnmdb2
 ora....db2.ons application ONLINE ONLINE cmsnmdb2
 ora....db2.vip ora....t1.type ONLINE ONLINE cmsnmdb2
 ora.eons ora.eons.type ONLINE ONLINE cmsnmdb1
 ora.gsd ora.gsd.type ONLINE ONLINE cmsnmdb1
 ora....network ora....rk.type ONLINE ONLINE cmsnmdb1
 ora.oc4j ora.oc4j.type ONLINE ONLINE cmsnmdb1
 ora.ons ora.ons.type ONLINE ONLINE cmsnmdb1
 ora....ry.acfs ora....fs.type ONLINE ONLINE cmsnmdb1
 ora.scan1.vip ora....ip.type ONLINE ONLINE cmsnmdb2
 [grid@cmsnmdb1 ~]$
 4.2 启动oracle rac
 crs_start -all
 4.3 关闭oracle rac
 crs_stop -all
 4.4 查看各资源状态
 srvctl status oc4j
 4.5 启用各资源
 srvctl enable oc4j
 《Installing Oracle11g R2 RAC on RedHat Linux AS 5.5》
 76 / 76
 4.6 启动各资源
 srvctl start oc4j
                










