In Oracle : Oracle 11gR2 RAC installation on AIX

Oracle Applications EBS 11i, R12      Oracle Database      Data Warehouse & BI      Oracle Middleware      PL/SQL      Linux ...

Oracle DBA

Real Application Cluster (RAC) Maintenance tasks Backup and Recovery Database Architecture Replication Oracle Performance Tuning Oracle DBA - Other articles Oracle scripts/ Selects for DBA Oracle Errors (ORA-nnnnn)

The last articles in the site (HOT)

The most visited articles in the site

In-Oracle.com  -> Oracle DBA -> Oracle RAC (Real Application Cluster)

-> Oracle 11gR2 RAC installation on AIX

 

 Oracle 11gR2 RAC installation on AIX

 

 

1. Prerequisites

 

2. Oracle clusterware/ grid installation and configuration for 11.2 version (IBM AIX system)

 

3. Oracle database 11.2 RAC installation and configuration

 

 

1. Prerequisites

 

1.1 Verify the IBM AIX version

uname -a

AIX dev1rac 3 5 00C7FE6E4C00

 

In my case I have:

Version = 5
Release = 3

 

 


1.2 Verify the Technology Level (TL)/  Service Pack (SP) we have installed on the IBM AIX system

 

oslevel -s
5300-11-02-1007
 

In my case I have:
TL = 11
SP = 02

 

Note: In some (old) documentations we can find the ML (Maintenance Level) term. The ML is the same thing as the TL (Technology Level).

The last TL/SP for AIX (5.3) systems you can find at:
http://www-933.ibm.com/support/fixcentral

 

 


1.3 Verify the IBM AIX operating system parameters

 

IBM AIX Parameter

MIN value

Show the IBM AIX Parameter value

How to change the IBM AIX Parameter / Notes

ipqmaxlen 512

/usr/sbin/no -a | grep ipqmaxlen

no -r -o ipqmaxlen=512

rfc1323 1

/usr/sbin/no -a | grep rfc1323

no -r -o rfc1323=1

sb_max 1310720

/usr/sbin/no -a | grep sb_max

no -r -o sb_max=1310720

 

= 2 x udp_recvspace

 tcp_recvspace 65536

/usr/sbin/no -a | grep tcp_recvspace

no -r -o tcp_recvspace=65536

tcp_sendspace 65536

/usr/sbin/no -a | grep tcp_sendspace

no -r -o tcp_sendspace=65536

udp_sendspace 65536

/usr/sbin/no -a | grep udp_sendspace

This value is suitable for a default database installation. For production databases, the minimum value for this parameter is 4 KB plus the value of the database DB_BLOCK_SIZE initialization parameter multiplied by the value of the DB_MULTIBLOCK_READ_COUNT initialization parameter:

(DB_BLOCK_SIZE * DB_MULTIBLOCK_READ_COUNT) + 4 KB

 

no -r -o udp_sendspace=65536

udp_recvspace 655360

/usr/sbin/no -a | grep udp_recvspace

The recommended value of this parameter is 10 times the value of the udp_sendspace parameter. The value must be less than the value of the sb_max parameter.

 

no -r -o udp_recvspace=655360

 

If you have to change some of the parameters above, you have to restart the server:

shutdown -Fr

 

 

1.4 Other requirements

 

NOTES:

1) This installation is done using IBM gpfs (and not the ASM) for the data files, log files, control files, OCR and voting disk. The gpfs is mounted on /data_gpfs.

2) The dba OS group is created on each node with the same GID (group ID)

3) The oracle OS user is created on each node with the same UID (user ID)

4) The dba group is a primary group for oracle user

 

To verify the GUI, UID of oracle user you can use the command:

id oracle

 

To modify the GUI, UID of oracle you can use smit utility:

smit user

smit group

 

 

1.5 Nodes, instalation locations and rights

 

 

owner:group

Software

ORACLE_HOME

Instance

Host

oracle:dba

Oracle

Clusterware

/oracle/grid/11.2

-

dev1rac

dev2rac

oracle:dba

Oracle

RDBMS

/oracle/db/11.2

db11rac1

db11rac2

dev1rac

dev2rac

 

$ORACLE_BASE = /oracle/db

 

 

Connected as root, create the following directories:

 

mkdir -p /oracle/db/11.2

mkdir -p /oracle/grid/11.2

chmod -R 775 /oracle

chown -R oracle:dba /oracle

 

mkdir -p /data_gpfs/oracle/crs

mkdir -p /data_gpfs/oracle/data

chmod 775 /data_gpfs/oracle/crs

chown -R oracle:dba /data_gpfs/oracle

 

/data_gpfs/oracle/crs                -> for OCR + Voting Disk

/data_gpfs/oracle/data              -> for data files, control files, log files

 

 

 

1.6 Verify that the AIX Filesets needed for the clusterware are installed

 

Run, connected as root:

 

lslpp -l bos.adt.base bos.adt.lib bos.adt.libm bos.perf.perfstat bos.perf.libperfstat bos.perf.proctools rsct.basic.rte rsct.compat.clients.rte

 

 

  Fileset                        Level         State                Description

  ----------------------------------------------------------------------------

Path: /usr/lib/objrepos

  bos.adt.base                 5.3.11.0  COMMITTED  Base Application Development  Toolkit

  bos.adt.lib                    5.3.9.0    COMMITTED  Base Application Development  Libraries

  bos.adt.libm                  5.3.11.0  COMMITTED  Base Application Development  Math Library

  bos.perf.libperfstat        5.3.11.2  COMMITTED  Performance Statistics Library  Interface

  bos.perf.perfstat           5.3.11.0  COMMITTED  Performance Statistics Interface

  bos.perf.proctools        5.3.11.1  COMMITTED  Proc Filesystem Tools

  rsct.basic.rte                 2.4.12.0  COMMITTED  RSCT Basic Function

  rsct.compat.clients.rte   2.4.12.0  COMMITTED  RSCT Event Management Client Function

  xlC.aix50.rte                10.1.0.2   COMMITTED  XL C/C++ Runtime for AIX 5.3

  xlC.rte                         10.1.0.2   COMMITTED  XL C/C++ Runtime

 

Path: /etc/objrepos

  bos.perf.libperfstat       5.3.0.50  COMMITTED  Performance Statistics Library Interface

  bos.perf.perfstat          5.3.11.0  COMMITTED  Performance Statistics Interface

  rsct.basic.rte                2.4.12.0  COMMITTED  RSCT Basic Function

 

 

 

lslpp -l xlC.aix50.rte         -- min 8.0.0.4  needed

lslpp -l xlC.rte                  -- min 8.0.0.1  needed

 

 

1.7 Verify that all APARS are present on the system

 

You can look at

      http://download.oracle.com/docs/cd/E11882_01/install.112/e10872/toc.htm

      http://www.ibm.com/support/us/en/

 

In my case (AIX 5.3 TL 11) all the APARS are intalled, however Oracle installation will say that the following APARS are not included:

 

IZ42940, IZ49516, IZ52331

 

 

1.8 Verify the date/ time on the two nodes

 

Run the command:

date

 

 

1.9 Verify that the HACMP is not installed

 

Connected as root, run:

 

lslpp -l cluster.es.*

lslpp -l rsct.hacmp.rte

lslpp -l rsct.compat.basic.hacmp.rte

lslpp -l rsct.compat.clients.hacmp.rte

 

 

1.10 Verify /etc/security/limits for the oracle and root users

 

Using smit utility we must have for oracle, root:

 

■ Soft FILE size = -1

■ Soft CPU time = -1

■ Soft DATA segment = -1

■ Soft STACK size = -1

 

rss for oracle must be -1           (-1 = unlimited)

 

 

1.11 Choose the IPs for the nodes

 

 

Host

Alias IP

Tip de IP

IP

dev1rac

dev1rac

PUBLIC

10.109.1.140

 

dev1vip

vip

10.109.1.141

 

dev1priv

private

162.15.1.140

 

 

 

 

dev2rac

dev2rac

PUBLIC

10.109.1.142

 

dev2vip

vip

10.109.1.143

 

dev2priv

private

162.15.1.142

 

 

1.12 Change the /etc/hosts file

 

cat <<EOF >> /etc/hosts

 

# public

10.109.1.140    dev1rac.mydomain.ca  dev1rac

10.109.1.142    dev2rac.mydomain.ca  dev2rac

 

# Oracle RAC VIP

10.109.1.141    dev1vip.mydomain.ca dev1vip

10.109.1.143    dev2vip.mydomain.ca dev2vip

 

# private

162.15.1.140    dev1priv.mydomain.ca  dev1priv

162.15.1.142    dev2priv.mydomain.ca  dev2priv

 

EOF

 

Assure that the IPs can be pinged (excepting the VIP IPs):

 

ping -c 1 dev1rac

ping -c 1 dev1vip       -- 100% loss

ping -c 1 dev1priv

ping -c 1 dev2rac

ping -c 1 dev2vip       -- 100% loss

ping -c 1 dev2priv

 

 

1.13 Set the /home/oracle/.profile

 

more /home/oracle/.profile

vi /home/oracle/.profile

 

On the 1st node

 

export TEMP=/tmp

export TMP=/tmp

export TMPDIR=/tmp

 

umask 022

export AIXTHREAD_SCOPE=S

export ORACLE_HOSTNAME=dev1rac.mydomain.ca

export ORACLE_BASE=/oracle/db

export ORACLE_HOME=/oracle/db/11.2

export GRID_HOME=/oracle/grid/11.2

export CRS_HOME=/oracle/grid/11.2

export ORACLE_SID=db11rac1

export ORACLE_UNQNAME=db11rac

export PATH=$ORACLE_HOME/bin:$PATH

export LD_LIBRARY_PATH=$ORACLE_HOME/lib

 

alias oh='cd $ORACLE_HOME'

alias ch='cd $CRS_HOME'

alias sql='sqlplus "/ as sysdba"'

alias ddir='cd /data_gpfs/oracle/data/db11rac'

alias tns='cd $ORACLE_HOME/network/admin'

alias ll='ls -altr'

alias hist='fc -l -30'

 

 

On the 2nd node

 

export TEMP=/tmp

export TMP=/tmp

export TMPDIR=/tmp

 

umask 022

export AIXTHREAD_SCOPE=S

export ORACLE_HOSTNAME=dev2rac.mydomain.ca

export ORACLE_BASE=/oracle/db

export ORACLE_HOME=/oracle/db/11.2

export GRID_HOME=/oracle/grid/11.2

export CRS_HOME=/oracle/grid/11.2

export ORACLE_SID=db11rac2

export ORACLE_UNQNAME=db11rac

export PATH=$ORACLE_HOME/bin:$PATH

export LD_LIBRARY_PATH=$ORACLE_HOME/lib

 

alias oh='cd $ORACLE_HOME'

alias ch='cd $CRS_HOME'

alias sql='sqlplus "/ as sysdba"'

alias ddir='cd /data_gpfs/oracle/data/db11rac'

alias tns='cd $ORACLE_HOME/network/admin'

alias ll='ls -altr'

alias hist='fc -l -30'

 

 

1.14 Create the following soft link needed for some Oracle utilities

 

ln -s /usr/sbin/lsattr /etc/lsattr

 

 

1.15 Verify that the rss or ssh is configurated for the RAC installation

        (for more details you can take a look at the Metalink Doc. 300548.1)

 

ssh dev1rac date

ssh dev1priv date

ssh dev1rac.mydomain.ca date

ssh dev1priv.mydomain.ca date

 

ssh dev2rac date

ssh dev2priv date

ssh dev2rac.mydomain.ca date

ssh dev2priv.mydomain.ca date

 

You must see the result without the need to type the password !!!!!!!

 

 

1.16  Verify if maxuproc > 16384

 

lsattr -E -l sys0 -a maxuproc -F value

 

If you want to modify this value, type:

 

chdev -l sys0 -a maxuproc=16384

 

 

1.17  Prepare the servers for an Oracle installation

 

As root, run :

rootpre.sh    (from the grid installation kit)

 

 

1.18 Run the verification runcluvfy.sh script to verify if all prerequisites are ok (optional step, but recommanded)

 

$ ./runcluvfy.sh stage -pre crsinst -n dev1rac,dev2rac -r 11gR2 -verbose > ./runcluvfy112.log

 

 

At this step we can have some errors related to the bootstrap (when runcluvfy.sh is run as root). In this case, you must remove the bootstrap directory and run the runcluvfy.sh again.

 

 

2. Oracle clusterware/ grid installation and configuration for 11.2 version (IBM AIX system)

 

 

Run ./runInstaller from the Oracle grid 11.2 installation kit/ software

 

./runInstaller

 

Screen

Response

Installation option

Install and Configure Grid Infrastructure for a Cluster

Installation Type

Advanced Installation

Product Languages

Next

Grid Plug and Play Information

Cluster Name:  cluster1

SCAN Name: scan1

SCAN Port: 1521

 

I am not using GNS.

Cluster Node Information

Here you must choose the Host Name and the VIP names.

Network Interface Usage

Select the public and private subnet.

Storage Option

Shared File System

OCR Storage

External Redundancy

/data_gpfs/oracle/data/crs/ocr.dbf

Voting Disk Storage

External Redundancy

/data_gpfs/oracle/data/crs/vdisk.dbf

Operating System Groups

In my case all are: dba

Installation Location

Oracle Base: /oracle/db

Software Location: /oracle/grid/11.2

Prerequisite Checks

OS Patch: IZ42940, IZ49516, IZ52331 for 5.3 TL 11 can be safely ignored.

 

NTP can be safely ignored.

Summary

Next

Setup

Run root.sh on specified nodes.

Finish

Close.

 

 

3. Oracle database 11.2 RAC installation and configuration

 

Run ./runInstaller from the Oracle grid 11.2 installation kit/ software

 

./runInstaller

 

Screen

Response

Configure Security Updates

Configure as you wish. In my case I unchecked "I wish to receive security updates via My Oracle Support"

Installation Option

Create and configure a dtabase

System Class

Server Class

Grid Installation Option

Real Application Cluster database installation. Select the 2 nodes available.

Install Type

Advanced Install

Product Languages

English

Database Edition

Entreprise Edition

Installation Location

Oracle Base: /oracle/db

Software Location: /oracle/db/11.2

Configuration Type

General Purpose

Database Identifiers

Global database name: db11rac.mydomain.ca

Oracle Service Identifier(SID): db11rac

 

Configuration Options

From "Memory" tab choose 90% of the available RAM.

The character set: AL32UTF8 (Oracle recommands using this character set)

Management Options

Use Database Control for database management

Database Storage

File System

Specify the database file location: /data_gpfs/oracle/data

Backup & Recovery

Do not enable automated backup

Schema Passwords

Use the same password for all accounts.

OS Groups

OSDBA group: dba

OSOPER group: dba

Prerequisite Checks

OS Patch: IZ42940, IZ49516, IZ52331 for 5.3 TL 11 can be safely ignored.

 

NTP can be safely ignored.

Summary

Finish.

Install Product

Run root.sh on specified nodes.

Finish

Close

 

 

In-Oracle.com  -> Oracle DBA -> Oracle RAC (Real Application Cluster)

-> Oracle 11gR2 RAC installation on AIX

Oracle Applications EBS 11i, R12      Oracle Database      Data Warehouse & BI      Oracle Middleware      PL/SQL      Linux ...

 

     Copyright (c) 2011-2015  www.in-oracle.com  |  Disclaimer: The views expressed on this web site are my own and do not reflect the views of Oracle Corporation. You may use the information from this site only at your risk.