RAC12cR2 : 12cR2 RAC Installation Step by step on Oracle Linux 7.4

RAC 12cR2 Installation Step by step on Oracle Linux 7.4

It’s described the installation of 12cR2 RAC installation (2 Node Cluster) and Oracle Database 12c Release 2 RAC on Linux (Oracle Linux 7 64-bit) using asmlib.

Starting with Oracle Grid Infrastructure 12c Release 2 (12.2), the installation media is replaced with a zip file for the Oracle Grid Infrastructure installer. Run the installation wizard after extracting the zip file into the target home path.

Note:

These installation instructions assume you do not already have any Oracle software installed on your system. If you have already installed Oracle ASMLIB, then you will not be able to install Oracle ASM Filter Driver (Oracle ASMFD) until you uninstall Oracle ASMLIB. You can use Oracle ASMLIB instead of Oracle ASMFD for managing the disks used by Oracle ASM, but those instructions are not included in this guide.

Name		Public	Private-1	Private-2
Server	rac131.ora.com	192.168.1.131	10.10.10.131	20.20.20.131
Server	rac132.ora.com	192.168.1.132	10.10.10.132	20.20.20.132
SCAN	rac-scan.ora.com	192.168.1.41	192.168.1.42	192.168.1.43
	rac131-vip.ora.com	192.168.1.166
	rac132-vip.ora.com	192.168.1.167
DNS	dns101.ora.com	192.168.1.101
DNS	DNS Internet resolve	192.168.1.7

12c RAC New Feature for Clusterware.

Some new Feature introduced in 12c Release 1 and 2

· Oracle Flex ASM - New feature reduce per-node overhead of using ASM instance. Instances can use remote node ASM for any planned/unplanned downtime.

· Flex ASM supports up to 511 diskgroups and larger LUNs up to 32PB

· ASM Disk Scrubbing - ASM comes with disk scrubbing feature so that logical corruptions can be discovered and ASM can automatically correct this in normal or high redundancy diskgroups

e.g.

alter diskgroup DATA scrub power low;

alter diskgroup DATA scrub disk datadisk_002 repair power low;

alter diskgroup DATA scrub power low;

alter diskgroup DATA scrub power auto; ==> Auto default

alter diskgroup DATA scrub power high

alter diskgroup DATA scrub power max;

· Grid Infrastructure Rolling Migration support for one-off’s

When applying a one-off patch to the ASM instance, the databases that it is serving can be pointed to use a different ASM instance.

· RAW/Block Storage Devices

Oracle Database 12c and Oracle Clusterware 12c, no longer support raw storage devices. The files must be moved to Oracle ASM before upgrading to Oracle Clusterware 12c.

· Oracle ASM Disk Resync & Rebalance enhancements.

· Deprecation of single-letter SRVCTL command-line interface (CLI) options

All SRVCTL commands have been enhanced to accept full-word options instead of the single-letter options. All new SRVCTL command options added in this release support full-word options, only, and do not have single-letter equivalents.

We have an option for simulate cluster commands without executing it.

srvctl stop database -d ccbprod -eval;

crsctl eval modify resource ccb_pool -attr value;

DB should managed by policy managed service not Administer Manager

[oracle@rac131 ~]$ srvctl stop database -d ccbprod -eval

PRKO-2712 : Administrator-managed database ccbprod is not supported with -eval option

$ srvctl { add | start | stop | modify | relocate } database ... -eval

$ srvctl { add | start | stop | modify | relocate } service ... -eval

$ srvctl { add | modify | remove } srvpool ... -eval

$ srvctl relocate server ... –eval

· Deinstallation tool is integrated with the database installation media. You can run the deinstallation tool using the runInstaller command with the -deinstall and -home options from the base directory of the database, client or grid infrastructure installation media.

Example :

runInstaller -deinstall -home complete path of Oracle home [-silent] [-checkonly] [-local] [-paramfile complete path of input parameter property file] [-params name1=value

name2=value . . .] [-o complete path of directory for saving files] [-help]

$ cd /directory_path/runInstaller

$ ./runInstaller -deinstall -home /u01/app/oracle/product/12.1.0/dbhome_1/

· IPv6 Support - Oracle RAC 12c now supports IPv6 for Client connectivity, Interconnect is still on IPv4.

IPv6 address 2001:0DB8:0:0::200C:417A

IPv4 address 192.168.1.131

Oracle Database 12c Release 2 and IPv6

In Oracle Database 12 Release 2, Oracle provides full IPv6 support for all components and features. Specifically as below:

1. IPv6 on the private network in an Oracle Clusterware configuration is now supported on all platforms

2. IPv6 client connectivity over public networks to Oracle RAC and Clusterware running on Windows is now supported.

3. ASM and ONS-based FAN notifications for single-instance and RAC databases running on Windows is supported

· Oracle 12c Release 2 (12.2) has added an extra group called SYSRAC, this group is not supported in Oracle 12.1

# 12.2 only.

groupadd -g racdba

Its allow a database user to connect using these admin privileges, you need to grant the relevant admin privilege to them. You can't grant sysrac to a database user.

. oraenv (+ASM1)

sqlplus / as sysasm

SQL> create user dbaocm_asm identified by amit123;

GRANT sysasm TO dbaocm_asm;

sqlplus dbaocm_asm as sysasm

. oraenv (ccbprod1)

sqlplus / as sysdba

grant connect to dbaocm identified by amit123;

grant connect to dbaocm_oper identified by amit123;

grant connect to dbocm_bkp identified by amit123;

grant connect to dbaocm_dg identified by amit123;

grant connect to dbaocm_km identified by amit123;

GRANT sysdba TO dbaocm;

GRANT sysoper TO dbaocm_oper;

GRANT sysbackup TO dbocm_bkp;

GRANT sysdg TO dbaocm_dg;

GRANT syskm TO dbaocm_km;

sqlplus dbaocm as sysdba

sqlplus dbaocm_oper as sysoper

sqlplus dbocm_bkp as sysbackup

sqlplus dbaocm_dg as sysdg

sqlplus dbaocm_km as syskm

The users will then be able to connect using admin privileges.

$ sqlplus my_dba_user as sysdba

$ sqlplus my_oper_user as sysoper

$ sqlplus my_asm_user as sysasm

$ sqlplus my_backup_user as sysbackup

$ sqlplus my_dg_user as sysdg

$ sqlplus my_km_user as syskm

12.2 only

$ sqlplus / as sysrac

SQL> select USERNAME,SYSDBA,SYSOPER,SYSASM,SYSBACKUP,SYSDG,SYSKM,AUTHENTICATION_TYPE from v$pwfile_users ;

USERNAME SYSDB SYSOP SYSAS SYSBA SYSDG SYSKM AUTHENTI

--------------- ----- ----- ----- ----- ----- ----- --------

SYS TRUE TRUE FALSE FALSE FALSE FALSE PASSWORD

SYSDG FALSE FALSE FALSE FALSE TRUE FALSE PASSWORD

SYSBACKUP FALSE FALSE FALSE TRUE FALSE FALSE PASSWORD

SYSKM FALSE FALSE FALSE FALSE FALSE TRUE PASSWORD

DBAOCM TRUE FALSE FALSE FALSE FALSE FALSE PASSWORD

DBAOCM_OPER FALSE TRUE FALSE FALSE FALSE FALSE PASSWORD

DBOCM_BKP FALSE FALSE FALSE TRUE FALSE FALSE PASSWORD

DBAOCM_DG FALSE FALSE FALSE FALSE TRUE FALSE PASSWORD

DBAOCM_KM FALSE FALSE FALSE FALSE FALSE TRUE PASSWORD

· Transparent Application Failover (TAF) is extended to DML transactions failover (insert/update/delete) which had been announced by Oracle 12.2 will support DML for

Transparent Application Failover (TAF) instructs Oracle Net to fail over a failed connection to a different listener. This enables the user to continue to work using the new connection as if the original connection had never failed. TAF need more to explore in Oracle.

· Running root.sh is not part of Universal Oracle installer (OUI) across nodes in RAC but we have option to run manually, where we can explor and debuging runtime execution error.

· Per Subnet multiple SCAN - RAC 12c, per-Subnet multiple Single Client Access Name can be configured per cluster. Before implementing additional SCANs, the OS provisioning of new network interfaces or new VLAN Tagging has to be completed.

· Shared Password file in ASM

A single password file can now be stored in the ASM diskgroup and can be shared by all nodes. No need to have individual copies for each instance.

· ASM Multiple Diskgroup Rebalance and Disk Resync Enhancements

Resync Power limit – Allows multiple diskgroups to be resynced concurrently.

Disk Resync Checkpoint – Faster recovery from instance failures.

· "ghctl" command for patching.

· Grid Infrastructure software optionally creates Grid Infrastructure Management Repository (mgmtdb) database, which is available ONLY on one node, to assists in management operations.

Setup 12c RAC

Setup Oracle Linux 7.4 x64 installation with 3 NIC Cards. Server should be minimum configuration of 50GB Local Storage + 12+ GB of RAM and swap as per OS guidance.

Firewall and SELinux should be disabled or open respective port and permission to configure.

Oracle Installation Prerequisites

Perform either the Automatic Setup or the Manual Setup to complete the basic prerequisites. The Additional Setup is required for all installations.

[oracle@rac131 ~]$ more /etc/resolv.conf

# Generated by NetworkManager

search ora.com

nameserver 192.168.1.101 ###(DNS)

nameserver 192.168.1.7 ###(Internet Proxy Server)

# cd /etc/yum.repos.d

wget http://yum.oracle.com/public-yum-ol7.repo

If you plan to use the "oracle-database-server-12cR2-preinstall" package to perform all your prerequisite setup, issue the following command.

# yum install –y oracle-database-server-12cR2-preinstall

Additional rpm required to install on both nodes

From Public Yum

yum install binutils -y

yum install compat-libstdc++-33 -y

yum install compat-libstdc++-33.i686 -y

yum install gcc -y

yum install gcc-c++ -y

yum install glibc -y

yum install glibc.i686 -y

yum install glibc-devel -y

yum install glibc-devel.i686 -y

yum install ksh -y

yum install libgcc -y

yum install libgcc.i686 -y

yum install libstdc++ -y

yum install libstdc++.i686 -y

yum install libstdc++-devel -y

yum install libstdc++-devel.i686 -y

yum install libaio -y

yum install libaio.i686 -y

yum install libaio-devel -y

yum install libaio-devel.i686 -y

yum install libXext -y

yum install libXext.i686 -y

yum install libXtst -y

yum install libXtst.i686 -y

yum install libX11 -y

yum install libX11.i686 -y

yum install libXau -y

yum install libXau.i686 -y

yum install libxcb -y

yum install libxcb.i686 -y

yum install libXi -y

yum install libXi.i686 -y

yum install make -y

yum install sysstat -y

yum install unixODBC -y

yum install unixODBC-devel -y

yum install zlib-devel -y

yum install zlib-devel.i686 –y

Install ASMLib and support package

https://www.oracle.com/linux/downloads/linux-asmlib-v7-downloads.html

yum install –y oracleasm-support

yum install –y kmod-oracleasm

Download asmlib from

https://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.12-1.el7.x86_64.rpm

 yum install –y oracleasmlib-2.0.12-1.el7.x86_64

Create Shared Storage Disk for CRS and Data

Shutdown both machine and set the environment path of Virtual Box on you command prompt and execute below.  This will create the storage disk and automatically attached in your both RAC VM.

My VM Name is:

RAC131-12.2-7.4

RAC132-12.2-7.4

--------------------------------------------------------------

VBoxManage createhd --filename CRS01.vdi --size 8192 --format VDI --variant Fixed

VBoxManage createhd --filename CRS02.vdi --size 8192 --format VDI --variant Fixed

VBoxManage createhd --filename CRS03.vdi --size 8192 --format VDI --variant Fixed

VBoxManage createhd --filename CRS04.vdi --size 8192 --format VDI --variant Fixed

VBoxManage createhd --filename CRS05.vdi --size 8192 --format VDI --variant Fixed

VBoxManage createhd --filename datadisk1.vdi --size 10240 --format VDI --variant Fixed

VBoxManage createhd --filename datadisk2.vdi --size 10240 --format VDI --variant Fixed

VBoxManage createhd --filename datadisk3.vdi --size 10240 --format VDI --variant Fixed

VBoxManage createhd --filename datadisk4.vdi --size 10240 --format VDI --variant Fixed

VBoxManage storageattach RAC131-12.2-7.4 --storagectl "SATA" --port 1 --device 0 --type hdd --medium CRS01.vdi --mtype shareable

VBoxManage storageattach RAC131-12.2-7.4 --storagectl "SATA" --port 2 --device 0 --type hdd --medium CRS02.vdi --mtype shareable

VBoxManage storageattach RAC131-12.2-7.4 --storagectl "SATA" --port 3 --device 0 --type hdd --medium CRS03.vdi --mtype shareable

VBoxManage storageattach RAC131-12.2-7.4 --storagectl "SATA" --port 4 --device 0 --type hdd --medium CRS04.vdi --mtype shareable

VBoxManage storageattach RAC131-12.2-7.4 --storagectl "SATA" --port 5 --device 0 --type hdd --medium CRS05.vdi --mtype shareable

VBoxManage storageattach RAC131-12.2-7.4 --storagectl "SATA" --port 6 --device 0 --type hdd --medium datadisk1.vdi --mtype shareable

VBoxManage storageattach RAC131-12.2-7.4 --storagectl "SATA" --port 7 --device 0 --type hdd --medium datadisk2.vdi --mtype shareable

VBoxManage storageattach RAC131-12.2-7.4 --storagectl "SATA" --port 8 --device 0 --type hdd --medium datadisk3.vdi --mtype shareable

VBoxManage storageattach RAC131-12.2-7.4 --storagectl "SATA" --port 9 --device 0 --type hdd --medium datadisk4.vdi --mtype shareable

VBoxManage storageattach RAC132-12.2-7.4 --storagectl "SATA" --port 1 --device 0 --type hdd --medium CRS01.vdi --mtype shareable

VBoxManage storageattach RAC132-12.2-7.4 --storagectl "SATA" --port 2 --device 0 --type hdd --medium CRS02.vdi --mtype shareable

VBoxManage storageattach RAC132-12.2-7.4 --storagectl "SATA" --port 3 --device 0 --type hdd --medium CRS03.vdi --mtype shareable

VBoxManage storageattach RAC132-12.2-7.4 --storagectl "SATA" --port 4 --device 0 --type hdd --medium CRS04.vdi --mtype shareable

VBoxManage storageattach RAC132-12.2-7.4 --storagectl "SATA" --port 5 --device 0 --type hdd --medium CRS05.vdi --mtype shareable

VBoxManage storageattach RAC132-12.2-7.4 --storagectl "SATA" --port 6 --device 0 --type hdd --medium datadisk1.vdi --mtype shareable

VBoxManage storageattach RAC132-12.2-7.4 --storagectl "SATA" --port 7 --device 0 --type hdd --medium datadisk2.vdi --mtype shareable

VBoxManage storageattach RAC132-12.2-7.4 --storagectl "SATA" --port 8 --device 0 --type hdd --medium datadisk3.vdi --mtype shareable

VBoxManage storageattach RAC132-12.2-7.4 --storagectl "SATA" --port 9 --device 0 --type hdd --medium datadisk4.vdi --mtype shareable

If you have the Linux firewall enabled, you will need to disable

# systemctl stop firewalld

# systemctl disable firewalld

Make sure NTP (Chrony on OL7/RHEL7) is enabled.

# systemctl enable chronyd

# systemctl restart chronyd

mkdir -p /u01/app/12.2.0.1/GRID

mkdir -p /u01/app/oracle/product/12.2.0.1/DB_1

chown -R oracle:oinstall /u01

chmod -R 775 /u01/

Format the disk shared disk you created on any one of the nodes using below in one go.

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdb

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdc

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdd

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sde

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdf

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdg

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdh

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdi

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdj

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdk

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdl

echo -e "o\nn\np\n1\n\n\nw" | fdisk /dev/sdm

[oracle@rac131 ~]$ sudo fdisk -l | grep B

Disk /dev/sda: 107.4 GB, 107374182400 bytes, 209715200 sectors