oracle RAC节点重构

一、清除集群上二节点的节点信息

1、删除实例

dbca或静默：

sql 复制代码

[oracle@rac1 ~]$ dbca -silent -deleteinstance -nodelist rac2 -gdbname orcl -instancename orcl2 -sysdbausername sys -sysdbapassword oracle

dbca-实例管理-删除节实例-选择服务输入密码-选择inactive实例-确认删除

2、查看数据库实例情况

sql 复制代码

[oracle@rac1 ~]$ srvctl config database -d orcl
Database unique name: orcl
Database name: orcl
Oracle home: /oracle/app/product/11.2.0/db_1
Oracle user: oracle
Spfile: +DATA/orcl/spfileorcl.ora
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: orcl
Database instances: orcl1
Disk Groups: DATA
Services: 
Database is administrator managed
 
 
sqlplus / as sysdba
SQL> select inst_id,instance_name from gv$instance;
 
  INST_ID INSTANCE_NAME
----------------------------------------------------------
         1 orcl1

3、在保留节点使用oracle用户更新集群列表

sql 复制代码

[oracle@rac1 ~]$ $ORACLE_HOME/oui/bin/runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME  "CLUSTER_NODES={rac1}"       
 
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB.   Actual 8191 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /oracle/oraInventory
'UpdateNodeList' was successful.

4、移除集群中二节点的VIP

停止二节点VIP：

sql 复制代码

cd $GRID_HOME/bin
[root@rac1 bin]# ./srvctl stop vip -i rac2-vip

删除二节点VIP：

sql 复制代码

[root@rac1 bin]#./srvctl remove vip -i rac2-vip -f

5、查看节点状态

查看集群状态

sql 复制代码

[grid@rac1 ~]$crs_stat -t
[grid@rac1 ~]$crsctl stat res -t

可以看到其中关于二节点的VIP信息已被删除

查看集群节点信息

sql 复制代码

[grid@rac1 ~]$ olsnodes -s -t
rac1    Active  Unpinned
rac2    Inactive        Unpinned

（如果二节点是ping状态，需要执行这步：
[grid@rac1 ~]$crsctl unpin css -n rac2）

6、删除节点

sql 复制代码

[root@rac1 bin]# $GRID_HOME/bin/crsctl delete node -n rac2
CRS-4661: Node rac2 successfully deleted.

7、更新GI的inventory信息

sql 复制代码

su - gird
cd $ORACLE_HOME/oui/bin
[grid@rac1 bin]$ ./runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME "CLUSTER_NODES={rac1}" CRS=TRUE  -local
 
Starting Oracle Universal Installer...
 
Checking swap space: must be greater than 500 MB.   Actual 8191 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /oracle/oraInventory
'UpdateNodeList' was successful.

二：重新添加二节点到集群中

1、前提条件

（1）：添加相应的用户和组，用户及用户组ID相同

（2）：配置 hosts文件 ,新增节点和原有都配置为相同

（3）：配置系统参数，用户参数和原有节点一样，配置网络

（4）：创建相应的目录，并保证权限对应（根据实际情况创建目录,非常重要）

sql 复制代码

  mkdir /oracle/app
  mkdir /oracle/grid/crs_1
  mkdir /oracle/gridbase
  mkdir /oracle/oraInventory 
  chown oracle:oinstall /oracle/app
  chown grid:oinstall /oracle/grid/
  chown grid:oinstall /oracle/grid/crs_1
  chown grid:oinstall /oracle/gridbase
  chown grid:oinstall /oracle/oraInventory
  chmod 770 /oracle/oraInventory

5）检查多路径，盘权限

2、配置用户之间的SSH、安装集群rpm包：

到grid软件解压目录下：

sql 复制代码

[root@rac1 sshsetup]# cd /oracle/grid/grid/sshsetup

grid用户的ssh：

sql 复制代码

./sshUserSetup.sh -user grid -hosts "rac1 rac2" -advanced --noPromptPassphrase

oracle用户的ssh：

sql 复制代码

./sshUserSetup.sh -user oracle -hosts "rac1 rac2" -advanced --noPromptPassphrase

将grid软件目录下的rpm包传到二节点：

sql 复制代码

[grid@rac1 ~]$scp cvuqdisk-1.0.9-1.rpm  192.168.40.102:/home/grid

二节点安装rpm包：

sql 复制代码

[grid@rac2 ~]$ rpm-ivh cvuqdisk-1.0.9-1.rpm

若你没有oinstall组，安装可能报错。此时手动export DISKGROUP=dba

3、检查rac2是否满足rac安装条件

1.检查网络和存储：

sql 复制代码

[grid@racdb1 ~]$ cluvfy stage -post hwos -n rac2
Check: TCP connectivity of subnet "10.0.0.0"
  Source                          Destination                     Connected?      
  ------------------------------  ------------------------------  ----------------
  rac1:192.168.40.101             rac2:10.0.0.3                   failed          
 
ERROR: 
PRVF-7617 : Node connectivity between "rac1 : 192.168.40.101" and "rac2 : 10.0.0.3" failed
Result: TCP connectivity check failed for subnet "10.0.0.0"
 
 
Result: Node connectivity check failed
若出现上述报错，可忽略。

2.检查rpm包、磁盘空间等：

sql 复制代码

[grid@racdb1 ~]$ cluvfy comp peer  -n rac2

3.整体检查

sql 复制代码

 [grid@racdb1 ~]$ cluvfy stage -pre nodeadd -n rac2 -fixup -verbose

4、添加节点

grid用户在grid_home/oui/bin目录下执行：

忽略addnote的时候进行的自检（因为我们不使用DNS和NTP，若addnode的时候自检不通过，则无法增加节点）

执行前删除日志小文件，特别是审计日志、trace日志，不然复制很慢

sql 复制代码

export IGNORE_PREADDNODE_CHECKS=Y
[grid@rac1 bin]$ /oracle/grid/crs_1/oui/bin/addNode.sh -silent "CLUSTER_NEW_NODES={rac2}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={rac2-vip}" "CLUSTER_NEW_PRIVATE_NODE_NAMES={rac2-priv}"
Each script in the list below is followed by a list of nodes.
/oracle/oraInventory/orainstRoot.sh #On nodes rac2
/oracle/grid/crs_1/root.sh #On nodes rac2
To execute the configuration scripts:
    1. Open a terminal window
    2. Log in as "root"
    3. Run the scripts in each cluster node
    
The Cluster Node Addition of /oracle/grid/crs_1 was unsuccessful.
Please check '/tmp/silentInstall.log' for more details.
 
 
跑以上提示脚本
（1）[root@rac2 oracle]# /oracle/oraInventory/orainstRoot.sh
 
（2）[root@rac2 oracle]# /oracle/grid/crs_1/root.sh
 
Performing root user operation for Oracle 11g 
 
The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /oracle/grid/crs_1
 
Enter the full pathname of the local bin directory: [/usr/local/bin]: 
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...
 
 
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /oracle/grid/crs_1/crs/install/crsconfig_params
Creating trace directory
User ignored Prerequisites during installation
Installing Trace File Analyzer
OLR initialization - successful
Adding Clusterware entries to upstart
CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1, number 1, and is terminating
An active cluster was found during exclusive startup, restarting to join the cluster
clscfg: EXISTING configuration version 5 detected.
clscfg: version 5 is 11g Release 2.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
PRKO-2190 : VIP exists for node rac2, VIP name rac2-vip
PRKO-2420 : VIP is already started on node(s): rac2
Configure Oracle Grid Infrastructure for a Cluster ... succeeded

5、添加新节点数据库：(在一节点操作)

oracle用户：

sql 复制代码

cd $ORACLE_HOME/oui/bin
[oracle@rac1 bin]$./addNode.sh -silent "CLUSTER_NEW_NODES={rac2}"

二节点运行脚本：

sql 复制代码

[root@rac2 oracle]# /oracle/app/product/11.2.0/db_1/root.sh
Performing root user operation for Oracle 11g 
 
The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /oracle/app/product/11.2.0/db_1
 
Enter the full pathname of the local bin directory: [/usr/local/bin]: 
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
 
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Finished product-specific root actions.

6、创建二节点实例（在一节点操作）

Dg库需要修改db_unique_name和db_name一致，不然会报错，等加好实例再把db_unique_name修改回去

sql 复制代码

[oracle@rac1 bin]$ dbca -silent -addInstance -nodeList rac2 -gdbName orcl -instanceName orcl2 -sysDBAUserName sys -sysDBAPassword "oracle"
Adding instance
1% complete
2% complete
6% complete
13% complete
20% complete
27% complete
28% complete
34% complete
41% complete
48% complete
54% complete
66% complete
Completing instance management.
76% complete
100% complete
Look at the log file "/oracle/app/cfgtoollogs/dbca/orcl/orcl.log" for further details.

7、验证集群状态等

sql 复制代码

[grid@rac2 ~]$ crs_stat -t
Name           Type           Target    State     Host        
------------------------------------------------------------
ora.DATA.dg    ora....up.type ONLINE    ONLINE    rac1        
ora....ER.lsnr ora....er.type ONLINE    ONLINE    rac1        
ora....N1.lsnr ora....er.type ONLINE    ONLINE    rac1        
ora.OCRVOT.dg  ora....up.type ONLINE    ONLINE    rac1        
ora.asm        ora.asm.type   ONLINE    ONLINE    rac1        
ora.cvu        ora.cvu.type   ONLINE    ONLINE    rac1        
ora.gsd        ora.gsd.type   OFFLINE   OFFLINE               
ora....network ora....rk.type ONLINE    ONLINE    rac1        
ora.oc4j       ora.oc4j.type  ONLINE    ONLINE    rac1        
ora.ons        ora.ons.type   ONLINE    ONLINE    rac1        
ora.orcl.db    ora....se.type ONLINE    ONLINE    rac1        
ora....SM1.asm application    ONLINE    ONLINE    rac1        
ora....C1.lsnr application    ONLINE    ONLINE    rac1        
ora.rac1.gsd   application    OFFLINE   OFFLINE               
ora.rac1.ons   application    ONLINE    ONLINE    rac1        
ora.rac1.vip   ora....t1.type ONLINE    ONLINE    rac1        
ora....SM2.asm application    ONLINE    ONLINE    rac2        
ora....C2.lsnr application    ONLINE    ONLINE    rac2        
ora.rac2.gsd   application    OFFLINE   OFFLINE               
ora.rac2.ons   application    ONLINE    ONLINE    rac2        
ora.rac2.vip   ora....t1.type ONLINE    ONLINE    rac2        
ora....ry.acfs ora....fs.type ONLINE    ONLINE    rac1        
ora.scan1.vip  ora....ip.type ONLINE    ONLINE    rac1        
 
 
[grid@rac2 ~]$ srvctl status db -d orcl
Instance orcl1 is running on node rac1
Instance orcl2 is running on node rac2
 
SQL> select inst_id,status from gv$instance;
 
   INST_ID STATUS
---------- ------------
         3 OPEN
         1 OPEN
 
SQL> select open_mode from v$database;
 
OPEN_MODE
--------------------
READ WRITE