Oracle RAC Installation Procedure

Refeerence Oracle11gR2-RAC-Solaris10-Iscsi-ZFS-Vmware-RageshMoyan.pdf

Change DNS to Single SCAN IP Address

Configure networks

On rac1 &rac2

more /etc/hosts

::1     localhost      

127.0.0.1       localhost      

10.1.0.10       rac1    loghost

10.1.0.11      rac1-vip

10.1.0.12      rac1-priv

10.1.0.20    rac2

10.1.0.21    rac2-vip

10.1.0.22    rac2-priv

10.1.0.30   share

10.1.0.40   cluster

bash-3.00# more /etc/netmasks

#

# The netmasks file associates Internet Protocol (IP) address

# masks with IP network numbers.

#

#       network-number  netmask

#

# The term network-number refers to a number obtained from the Internet Network

# Information Center.

#

# Both the network-number and the netmasks are specified in

# "decimal dot" notation, e.g:

#

#               128.32.0.0 255.255.255.0

#

10.0.0.0        255.0.0.0

bash-3.00# more /etc/defaultrouter

10.0.0.3

On rac1

bash-3.00# more /etc/hostname.e1000g0

rac1

bash-3.00# more /etc/hostname.e1000g1

rac1-priv

On rac2

bash-3.00# more /etc/hostname.e1000g0

rac2

bash-3.00# more /etc/hostname.e1000g1

rac2-priv

Configure share  disks

On share

root@share # format

Searching for disks...done

AVAILABLE DISK SELECTIONS:

       0. c0d1 <DEFAULT cyl 6524 alt 2 hd 255 sec 63>

          /pci@0,0/pci-ide@7,1/ide@1/cmdk@1,0

       1. c1t0d0 <VMware,-VMware Virtual S-1.0-50.00GB>

          /pci@0,0/pci15ad,1976@10/sd@0,0

Specify disk (enter its number):

# zpool create -f shrpool c1t0d0

# zfs create -V 3G shrpool/crs01

#  zfs create -V 10G shrpool/data01

#  zfs create -V 15G shrpool/fra01

# zfs set shareiscsi=on shrpool/crs01

( check format onrac1, rac2  to determine system have same drive path, e.g: c4t7d0 )

# zfs set shareiscsi=on  shrpool/data01

# zfs set shareiscsi=on shrpool/fra01

On rac1 &rac2

bash-3.00# vi /kernel/drv/iscsi.conf

#

# Copyright 2006 Sun Microsystems, Inc.  All rights reserved.

# Use is subject to license terms.

#

#ident  "@(#)iscsi.conf 1.2     06/06/12 SMI"

name="iscsi" parent="/" instance=0;

ddi-forceattach=1;

#

# I/O multipathing feature (MPxIO) can be enabled or disabled using

# mpxio-disable property. Setting mpxio-disable="no" will activate

# I/O multipathing; setting mpxio-disable="yes" disables the feature.

#

# Global mpxio-disable property:

#

# To globally enable MPxIO on all iscsi ports set:

# mpxio-disable="no";

#

# To globally disable MPxIO on all iscsi ports set:

# mpxio-disable="yes";

#

mpxio-disable="yes";

( # iscsiadm list discovery-address )

( # iscsiadm remove discovery-address 10.0.0.30:3260 )

# iscsiadm add discovery-address 10.1.0.30:3260

bash-3.00# format

Searching for disks...

done

AVAILABLE DISK SELECTIONS:

       0. c0d0 <DEFAULT cyl 3913 alt 2 hd 255 sec 63>

          /pci@0,0/pci-ide@7,1/ide@0/cmdk@0,0

       1. c4t6d0 <DEFAULT cyl 1302 alt 2 hd 255 sec 63>

          /iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A4f8bbc55-3509-cc17-84b9-cdfae48bc4180001,0

       2. c4t7d0 <DEFAULT cyl 1532 alt 2 hd 128 sec 32>

          /iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A793e3bb7-6522-4610-88dc-8125621c1d8f0001,0

       3. c4t8d0 <DEFAULT cyl 1955 alt 2 hd 255 sec 63>

          /iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A6805ce31-3c14-41ff-b630-f07af4abd3c90001,0

On share

root@share #  iscsitadm list target -v

Target: shrpool/fra01

    iSCSI Name: iqn.1986-03.com.sun:02:6805ce31-3c14-41ff-b630-f07af4abd3c9

    Alias: shrpool/fra01

    Connections: 2

        Initiator:

            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.5114f504

            Alias: rac2

        Initiator:

            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.511515f2

            Alias: rac1

    ACL list:

    TPGT list:

    LUN information:

        LUN: 0

            GUID: 600144f05115259800000c29587e6600

            VID: SUN

            PID: SOLARIS

            Type: disk

            Size:   15G

            Backing store: /dev/zvol/rdsk/shrpool/fra01

            Status: online

Target: shrpool/crs01

    iSCSI Name: iqn.1986-03.com.sun:02:793e3bb7-6522-4610-88dc-8125621c1d8f

    Alias: shrpool/crs01

    Connections: 2

        Initiator:

            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.5114f504

            Alias: rac2

        Initiator:

            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.511515f2

            Alias: rac1

    ACL list:

    TPGT list:

    LUN information:

        LUN: 0

            GUID: 600144f05115246400000c29587e6600

            VID: SUN

            PID: SOLARIS

            Type: disk

            Size: 3.0G

            Backing store: /dev/zvol/rdsk/shrpool/crs01

            Status: online

Target: shrpool/data01

    iSCSI Name: iqn.1986-03.com.sun:02:4f8bbc55-3509-cc17-84b9-cdfae48bc418

    Alias: shrpool/data01

    Connections: 2

        Initiator:

            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.5114f504

            Alias: rac2

        Initiator:

            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.511515f2

            Alias: rac1

    ACL list:

    TPGT list:

    LUN information:

        LUN: 0

            GUID: 600144f051148a1d00000c29587e6600

            VID: SUN

            PID: SOLARIS

            Type: disk

            Size:   10G

            Backing store: /dev/zvol/rdsk/shrpool/data01

            Status: online

bash-3.00# ls -l /dev/rdsk/c4t6d0s1

lrwxrwxrwx   1 root     root         104 Feb  8 22:52 /dev/rdsk/c4t6d0s1 -> ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A4f8bbc55-3509-cc17-84b9-cdfae48bc4180001,0:b,raw

bash-3.00# ls -l /dev/rdsk/c4t7d0s1

lrwxrwxrwx   1 root     root         104 Feb  8 23:14 /dev/rdsk/c4t7d0s1 -> ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A793e3bb7-6522-4610-88dc-8125621c1d8f0001,0:b,raw

bash-3.00# ls -l /dev/rdsk/c4t8d0s1

lrwxrwxrwx   1 root     root         104 Feb  8 23:19 /dev/rdsk/c4t8d0s1 -> ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A6805ce31-3c14-41ff-b630-f07af4abd3c90001,0:b,raw

bash-3.00#

bash-3.00#

bash-3.00#

bash-3.00# chown grid:asmadmin ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A4f8bbc55-3509-cc17-84b9-cdfae48bc4180001,0:b,raw

bash-3.00# chown grid:asmadmin ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A793e3bb7-6522-4610-88dc-8125621c1d8f0001,0:b,raw

bash-3.00# chown grid:asmadmin ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A6805ce31-3c14-41ff-b630-f07af4abd3c90001,0:b,raw

bash-3.00#

bash-3.00# chmod 660 ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A4f8bbc55-3509-cc17-84b9-cdfae48bc4180001,0:b,raw

bash-3.00# chmod 660 ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A793e3bb7-6522-4610-88dc-8125621c1d8f0001,0:b,raw

bash-3.00# chmod 660 ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A6805ce31-3c14-41ff-b630-f07af4abd3c90001,0:b,raw

3.Pre

On rac1 &rac2

Check packages

# pkgadd -d cdrom/sol_10_910_x86/Solaris_10/Product/ SUNWi1cs

# pkgadd -d cdrom/sol_10_910_x86/Solaris_10/Product/ SUNWi15cs

Set the UDP parameters on both rac1 &rac2

To check current settings for udp_recv_hiwat and udp_xmit_hiwat, enter the following

Commands as root user on both nodes.

# ndd /dev/udp udp_xmit_hiwat

# ndd /dev/udp udp_recv_hiwat

On Solaris 10, to set the values of these parameters to 65536 bytes in current memory,

Enter the following commands for setting until next boot up:

# ndd -set /dev/udp udp_xmit_hiwat 65536

# ndd -set /dev/udp udp_recv_hiwat 65536

Make values persistent across reboots.

As root user on both nodes.

Create a additional swapfile for swap space extension

# mkfile 2G /swapfile1

# cat>/etc/rc2.d/S99ndd<<EOF

ndd -set /dev/udp udp_xmit_hiwat 65536

ndd -set /dev/udp udp_recv_hiwat 65536

swap -a /swapfile1

EOF

Create Users, Groups and Directories for Grid & RDBMS home.

Run below on bothnodes as root user:

----Cut&Paste as root on rac1 & rac2

groupadd -g 1000 oinstall

groupadd -g 1200 asmadmin

groupadd -g 1201 asmdba

groupadd -g 1202 asmoper

groupadd -g 1300 dba

groupadd -g 1301 oper

useradd -u 1100 -g oinstall -G asmadmin,asmdba,asmoper -d /export/home/grid \

-m -s /usr/bin/bash -c "Grid Infrastructure Owner" grid

passwd grid

useradd -u 1101 -g oinstall -G dba,oper,asmdba -d /export/home/oracle -m -s \

/usr/bin/bash -c "Oracle Software Owner" oracle

passwd oracle

mkdir -p /u01/app/grid

mkdir -p /u01/app/11.2.0/grid

chown -R grid:oinstall /u01

mkdir -p /u01/app/oracle

chown oracle:oinstall /u01/app/oracle

chmod -R 775 /u01

----Cut&Paste as root on ac1 & rac2-----

Check for nobody user (id nobody), it will exists as part of the solaris install

Setup .profiles for Users (oracle & grid)

Login to ac1 & rac2 as root and switch to grid user as below and add the entires.

**Here comment the ORACLE_SID as per node.

eg:- Comment ORACLE_SID=+ASM2 on rac1

root# su - grid

-----.profile-----

ORACLE_SID=+ASM1; export ORACLE_SID

ORACLE_SID=+ASM2; export ORACLE_SID

JAVA_HOME=/usr/local/java; export JAVA_HOME

ORACLE_BASE=/u01/app/grid; export ORACLE_BASE

ORACLE_HOME=/u01/app/11.2.0/grid; export ORACLE_HOME

ORACLE_TERM=xterm; export ORACLE_TERM

NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"; export NLS_DATE_FORMAT

TNS_ADMIN=$ORACLE_HOME/network/admin; export TNS_ADMIN

ORA_NLS11=$ORACLE_HOME/nls/data; export ORA_NLS11

PATH=.:${JAVA_HOME}/bin:${PATH}:$HOME/bin:$ORACLE_HOME/bin

PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin

PATH=${PATH}:/u01/app/common/oracle/bin

export PATH

LD_LIBRARY_PATH=$ORACLE_HOME/lib

LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib

LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib

export LD_LIBRARY_PATH

CLASSPATH=$ORACLE_HOME/JRE

CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib

CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib

CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib

export CLASSPATH

THREADS_FLAG=native; export THREADS_FLAG

export TEMP=/tmp

export TMPDIR=/tmp

umask 022

set -o vi

-----.profile-----

Login to rac1/rac2 as root and switch to oracle user as below and add the entires.

**Here comment the ORACLE_SID as per node.

eg:- Comment ORACLE_SID=+racdb2 on rac1

root# su – oracle

----.profile----

# Set the below ORACLE_SID as per node

ORACLE_SID=racdb1; export ORACLE_SID

ORACLE_SID=racdb2; export ORACLE_SID

ORACLE_UNQNAME=racdb; export ORACLE_UNQNAME

JAVA_HOME=/usr/local/java; export JAVA_HOME

ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE

ORACLE_HOME=$ORACLE_BASE/product/11.2.0/dbhome_1; export ORACLE_HOME

ORACLE_PATH=/u01/app/common/oracle/sql; export ORACLE_PATH

ORACLE_TERM=xterm; export ORACLE_TERM

NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"; export NLS_DATE_FORMAT

TNS_ADMIN=$ORACLE_HOME/network/admin; export TNS_ADMIN

ORA_NLS11=$ORACLE_HOME/nls/data; export ORA_NLS11

PATH=.:${JAVA_HOME}/bin:${PATH}:$HOME/bin:$ORACLE_HOME/bin

PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin

PATH=${PATH}:/u01/app/common/oracle/bin

export PATH

LD_LIBRARY_PATH=$ORACLE_HOME/lib

LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib

LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib

export LD_LIBRARY_PATH

CLASSPATH=$ORACLE_HOME/JRE

CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib

CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib

CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib

export CLASSPATH

THREADS_FLAG=native; export THREADS_FLAG

export TEMP=/tmp

export TMPDIR=/tmp

umask 022

set -o vi

----.profile----

Setup Kernel parameters

**Below steps needs to be done on both rac1& rac2

Setup /etc/system

Oracle Clusterware does not set project information when starting processes, some

/etc/system processes that are deprecated but not removed must still be set for Oracle

Clusterware. Oracle recommends that you set both resource control and /etc/system

parameters. Operating system parameters not replaced by resource controls continue

to affect performance and security on Solaris 10 systems.

Append the below parameters to /etc/system of both ac1 & rac2

---Cut & Paste in /etc/system onrac1& rac2

---

set noexec_user_stack = 1

set semsys:seminfo_semmni = 100

set semsys:seminfo_semmns = 1024

set semsys:seminfo_semmsl = 256

set semsys:seminfo_semvmx = 32767

set shmsys:shminfo_shmmax = 4294967295

set shmsys:shminfo_shmmni = 100

set max_nprocs = 20000

set rlim_fd_max = 65536

set rlim_fd_cur = 1024

---Cut & Paste in /etc/system on rac1& rac2

---

**Below steps needs to be done on bothrac1& rac2

Create Project for Grid user and set Kernel parameters

Login as root user (on ac1 & rac2)

root# projadd grid <= This will create a project by name grid

Login into grid user,

root# su - grid

-bash-3.00$ id -p

uid=1100(grid) gid=1000(oinstall) projid=3(default)

Here grid is assigned "default" to change this to grid add a line shown below in

"/etc/user_attr" as root user on rac1& rac2

root# cat>>/etc/user_attr<<EOF

grid::::project=grid

EOF

Relogin into grid user

--log--

# su - grid

Sun Microsystems Inc. SunOS 5.10 Generic January 2005

-bash-3.00$ id -p

uid=1100(grid) gid=1000(oinstall) projid=100(grid)

-bash-3.00$

--log—

Here now grid user is assigned project ID=100 and name grid.

Below are the Kernel parameters required to be set for the "grid" project.

Parameter

Replaced by

Resource Control

Recommended

Values

noexec_user_stack

NA

1

semsys:seminfo_semmni

project.max-sem-ids

100

semsys:seminfo_semmns

NA

1024

semsys:seminfo_semmsl

process.max-sem-nsems

256

semsys:seminfo_semvmx

NA

32767

shmsys:shminfo_shmmax

project.max-shm-memory

4294967295

shmsys:shminfo_shmmni

project.max-shm-ids

100

**The only value which needs to be modified here is of "project.max-shm-memory"

in our install. Remaining values are either equal or more than above mentioned.

Determine the current value of shared memory

grid$ prctl -n project.max-shm-memory -i project grid

--log--

-bash-3.00$ id -p

uid=1100(grid) gid=1000(oinstall) projid=100(grid)

-bash-3.00$ prctl -n project.max-shm-memory -i project grid

project: 100: grid

NAME PRIVILEGE VALUE FLAG ACTION RECIPIENT

project.max-shm-memory

privileged 748MB - deny -

system 16.0EB max deny -

-bash-3.00$

--log--

Permanently set the value in Grid project

root# projmod -sK "project.max-shm-memory=(privileged,4G,deny)" grid

Verify that the resource control is active and reflects the values:

cat /etc/project

--log--

# cat /etc/project

system:0::::

user.root:1::::

noproject:2::::

default:3::::

group.staff:10::::

grid:100::::project.max-shm-memory=(privileged,4294967296,deny)

--log--

**Below steps needs to be done on both rac1& rac2

Create Project for Oracle user and set Kernel parameters

Login as root user on rac1& rac2

root# projadd oracle <= This will create a project by name oracle

root# su - oracle

-bash-3.00$ id –p

uid=1101(oracle) gid=1000(oinstall) projid=3(default)

Here oracle is assigned "default" to change this to oracle add a line shown below in

“ /etc/user_attr” as root user in rac1 & rac2

root# cat>>/etc/user_attr<<EOF

oracle::::project=oracle

EOF

Relogin into oracle

--log--

-bash-3.00$ id -p

uid=1101(oracle) gid=1000(oinstall) projid=101(oracle)

-bash-3.00$

--log--

Here now oracle user is assigned project ID=101 and name oracle.

Below are the Kernel parameters required to be set for the "oracle" project.

Parameter

Replaced by

Resource Control

Recommended

Values

noexec_user_stack

NA

1

semsys:seminfo_semmni

project.max-sem-ids

100

semsys:seminfo_semmns

NA

1024

semsys:seminfo_semmsl

process.max-sem-nsems

256

semsys:seminfo_semvmx

NA

32767

shmsys:shminfo_shmmax

project.max-shm-memory

4294967295

shmsys:shminfo_shmmni

project.max-shm-ids

100

The only value which needs to be modified here is of "project.max-shm-memory"

in our install.Remaining values are either equal or more than above mentioned.

Determine the current value of shared memory

oracle$ prctl -n project.max-shm-memory -i project oracle

--log--

-bash-3.00$ id -p

uid=1101(oracle) gid=1000(oinstall) projid=101(oracle)

-bash-3.00$ prctl -n project.max-shm-memory -i project oracle

project: 101: oracle

NAME PRIVILEGE VALUE FLAG ACTION RECIPIENT

project.max-shm-memory

privileged 748MB - deny -

system 16.0EB max deny -

-bash-3.00$

--log--

Permanently set the value in Oracle project

root# projmod -sK "project.max-shm-memory=(privileged,4G,deny)" oracle

Verify that the resource control is active and reflects the values:

cat /etc/project

--log--

# cat /etc/project

system:0::::

user.root:1::::

noproject:2::::

default:3::::

group.staff:10::::

grid:100::::project.max-shm-memory=(privileged,4294967296,deny)

oracle:101::::project.max-shm-memory=(privileged,4294967296,deny)

#

--log--

Install

bash-3.00# /u01/app/oraInventory/orainstRoot.sh

Changing permissions of /u01/app/oraInventory.

Adding read,write permissions for group.

Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.

The execution of the script is complete.

bash-3.00# /u01/app/11.2.0/grid/root.sh

Running Oracle 11g root.sh script...

The following environment variables are set as:

    ORACLE_OWNER= grid

    ORACLE_HOME=  /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:

Creating /usr/local/bin directory...

   Copying dbhome to /usr/local/bin ...

   Copying oraenv to /usr/local/bin ...

   Copying coraenv to /usr/local/bin ...

Creating /var/opt/oracle/oratab file...

Entries will be added to the /var/opt/oracle/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

Now product-specific root actions will be performed.

2013-02-18 16:59:17: Parsing the host name

2013-02-18 16:59:17: Checking for super user privileges

2013-02-18 16:59:17: User has super user privileges

Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params

Creating trace directory

LOCAL ADD MODE

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

  root wallet

  root wallet cert

  root cert export

  peer wallet

  profile reader wallet

  pa wallet

  peer wallet keys

  pa wallet keys

  peer cert request

  pa cert request

  peer cert

  pa cert

  peer root cert TP

  profile reader root cert TP

  pa root cert TP

  peer pa cert TP

  pa peer cert TP

  profile reader pa cert TP

  profile reader peer cert TP

  peer user cert

  pa user cert

Adding daemon to inittab

CRS-4123: Oracle High Availability Services has been started.

ohasd is starting

CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'

CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'

CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded

CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'

CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'

CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cssd' on 'rac1'

CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'

CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded

CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'

CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded

ASM created and started successfully.

DiskGroup CRS created successfully.

clscfg: -install mode specified

Successfully accumulated necessary OCR keys.

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

CRS-2672: Attempting to start 'ora.crsd' on 'rac1'

CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded

CRS-4256: Updating the profile

Successful addition of voting disk 812ffcc7d82d4feabf66530ad0b28fbd.

Successfully replaced voting disk group with +CRS.

CRS-4256: Updating the profile

CRS-4266: Voting file(s) successfully replaced

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

 1. ONLINE   812ffcc7d82d4feabf66530ad0b28fbd (/dev/rdsk/c4t7d0s1) [CRS]

Located 1 voting disk(s).

CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'

CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'rac1'

CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'

CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'rac1'

CRS-2677: Stop of 'ora.cssdmonitor' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'

CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'

CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'

CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'

CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'

CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'

CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'

CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'

CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cssd' on 'rac1'

CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'

CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded

CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'

CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.asm' on 'rac1'

CRS-2676: Start of 'ora.asm' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.crsd' on 'rac1'

CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.evmd' on 'rac1'

CRS-2676: Start of 'ora.evmd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.asm' on 'rac1'

CRS-2676: Start of 'ora.asm' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.CRS.dg' on 'rac1'

CRS-2676: Start of 'ora.CRS.dg' on 'rac1' succeeded

rac1     2013/02/18 17:06:25     /u01/app/11.2.0/grid/cdata/rac1/backup_20130218_170625.olr

Configure Oracle Grid Infrastructure for a Cluster ... succeeded

Updating inventory properties for clusterware

Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 5123 MB    Passed

The inventory pointer is located at /var/opt/oracle/oraInst.loc

The inventory is located at /u01/app/oraInventory

'UpdateNodeList' was successful.

bash-3.00# /u01/app/11.2.0/grid/root.sh  /u01/app/11.2.0/grid/bin/crsctl check crs

bash-3.00#

bash-3.00#  /u01/app/11.2.0/grid/bin/crsctl check crs

CRS-4638: Oracle High Availability Services is online

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

On rac1 &rac2

bash-3.00# /u01/app/oracle/product/11.2.0/dbhome_1/root.sh

Running Oracle 11g root.sh script...

The following environment variables are set as:

    ORACLE_OWNER= oracle

    ORACLE_HOME=  /u01/app/oracle/product/11.2.0/dbhome_1

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The file "dbhome" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]:

The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]:

The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]:

Entries will be added to the /var/opt/oracle/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

Now product-specific root actions will be performed.

Finished product-specific root actions.

bash-3.00# /u01/app/11.2.0/grid/bin/crsctl check crs

CRS-4638: Oracle High Availability Services is online

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online

Login rac1 as grid

$ asmca

Login rac1 as oracle

$ dbca