Thursday, 7 March 2013

Sun Message 7.0 on Single Host





1. Install and configure Directory Server 5.2
a. Install Directory Server on mail
# gunzip ds.5.2.P4.Solaris.x86.full.tar.gz
# tar xf ds.5.2.P4.Solaris.x86.full.tar
# ./setup
Enter the fully qualified name of the computer
   Fully Qualified Computer Name [mail.domain.com] {"<" goes back, "!"
   exits}: mail.sunviet.vn
Choose the type of installation from the following choices:
Sun Java(TM) System Servers - Installs the Sun Java(TM) System servers, Sun Java
(TM) System Server Console, and related components.
Sun Java(TM) System Server Console - Installs the Sun Java(TM) System Server
Console as a stand-alone Java application.
1. Sun Java(TM) System Servers
2. Sun Java(TM) System Server Console
   What would you like to do [1] {"<" goes back, "!" exits}?
Choose the type of installation you prefer from the following choices:
Express - Installation option choices are made automatically. The easiest
installation and recommended for evaluating the product.
Typical - Software will be installed with the most common options. Recommended
for most deployments.
Custom - You may choose the options you want to install. Recommended for
advanced users.
1. Express
2. Typical
3. Custom
   What would you like to do [2] {"<" goes back, "!" exits}?
The Directory Server components will be installed in the following directory.
Specify the directory location where you want to install the product.
   Directory to install Directory Server components into [/var/Sun/mps] {"<"
   goes back, "!" exits}:
The directory "/var/Sun/mps" does not exist.
Do you want to create it now or choose another directory?
1. Create Directory
2. Choose New
   Enter the number corresponding to your choice  [1] {"<" goes back, "!"
   exits}
Please wait while components are loaded...
Directory Server components showing a checked box will be installed.
 [X]  1   Sun Java(TM) System Directory Suite    0 bytes
 [X]  2     Sun Java(TM) System Directory Server    28.02 MB
 [X]  3     Sun Java(TM) System Directory Console Support    1.76 MB
 [X]  4   Sun Java(TM) System Administration Services    0 bytes
 [X]  5     Sun Java(TM) System Administration Server    12.26 MB
 [X]  6     Sun Java(TM) System Administration Console    230.89 KB
 [X]  7   Sun Java(TM) System Server Console    0 bytes
 [X]  8     Sun Java(TM) System Server Console Core    5.85 MB
 [X]  9     Java Runtime Environment    65.00 MB
 [X]  10  Sun Java(TM) System Server Basic Libraries    27.60 MB
   To check a particular component, enter its number, or 0 when you are
   finished [0] {"<" goes back, "!" exits}:
Checking Disk Space
Choose the system user and group names under whose identity
the Sun Java(TM) System Directory server will run.
   System User [root] {"<" goes back, "!" exits}:
   System Group [root] {"<" goes back, "!" exits}:
You may store Sun Java(TM) System server configuration information in another
Sun Java(TM) System Directory Server. If you have already prepared a
configuration server, you may configure the new server to use it.
1. The new instance will be the configuration Directory Server
2. Use existing configuration Directory Server
   What would you like to do [1] {"<" goes back, "!" exits}?
You may already have a Directory Server where you store user and group
information.
1. Store data in the new Directory Server
2. Store data in an existing Directory Server
   What would you like to do [1] {"<" goes back, "!" exits}?
Settings the new server will use for basic operation
   Server Identifier [mail] {"<" goes back, "!" exits}:
   Server Port [389] {"<" goes back, "!" exits}:
   Suffix [dc=sunviet, dc=vn] {"<" goes back, "!" exits}:
Configuration Directory Server Administrator
   Administrator ID [admin] {"<" goes back, "!" exits}:
Password:
Password (again):
Administration Domain
   Administration Domain [sunviet.vn] {"<" goes back, "!" exits}:
Enter a Distinguished Name (DN) for the Directory Manager and a password at
least 8 characters long.
   Directory Manager DN [cn=Directory Manager] {"<" goes back, "!" exits}:
Password:
Password (again):
The Administration Server runs on a different network port from other servers.
Specify the number of the port.
   Administration Port [390] {"<" goes back, "!" exits}:

b. Migrate data from old Directory Server on ldapsunviet to mail ( after installing Sun Messaging schema on Directory Server )

Export file suffix dc=sunviet,dc=vn to directory server from old ldapsunviet  
/var/Sun/mps/slapd-mail/db2ldif -s dc=sunviet,dc=vn
[04/Jun/2010:10:55:59 +0700] - DEBUG  - conn=-1 op=-1 msgId=-1 -  Backend Instance: userRoot
ldiffile: /var/Sun/mps/slapd-mail/ldif/2010_06_04_105558.ldif
[04/Jun/2010:10:56:00 +0700] - export userRoot: Processed 1000 entries (75%).
[04/Jun/2010:10:56:00 +0700] - export userRoot: Processed 1322 entries (100%).

Import file suffix dc=sunviet,dc=vn vào directory server c?a mail
/usr/bin/ldapmodify -D "cn=directory manager" -w tainguyenmtvn -a -c -f 2010_06_04_105558.ldif
2. Install and configure Sun Messaging 7.2

a. Install Sun Messaging 7.2

# unzip SunJava_CommsInstaller_Suite6u2_solaris-x86.zip
./commpkg install
   Item  Description
    ----  -----------
       1  Messaging Server 7u2 (7.2-7.02)
       2  Messaging Server (64bit) 7u2 (7.2-7.02)
==        Installed Version at /opt/sun/comms/messaging64 : 7.2-7.02
       3  Comms DSsetup 6.4 (6.4-4.04)
       4  Comms Delegated Administrator 7 (7.0-0.00)
       5  Calendar Server 6.3 (6.3-15.01)
       6  Instant Messaging 8u1 (8.1-01.03)
       7  Communications Express 6.3 (6.3-13.01)
       8  Messaging Server Sun Cluster HA agent 7.0 (7.0-0.03)
       9  Calendar Server Sun Cluster HA agent 6.3 (6.3-1.01)
      10  Instant Messaging Sun Cluster HA agent 7.3 (7.3-01.02)
      11  Convergence 1u2 (1.0-7.01)
Select 2,3,11 to install Messaging Server, Convergence
#cd /opt/sun/comms/messaging64/install/
# cat Config.txt
Port Assignments:
Port Service
==== =======
25   SMTP
110  POP3
143  IMAP4
225  LMTP
465  SMTP SSL
587  SMTP SUBMIT
995  POP3 SSL
993  IMAP4 SSL
8990 Webmail
8991 mail SSL

b. Configure Sun Messaging server:

Setup schema Sun Messaging cho Directory Server
# /var/Sun/mps/bin/slapd/admin/bin/perl /opt/sun/comms/dssetup/sbin/comm_dssetup.pl
Disable sendmail service:
# svcadm disable sendmail


#/opt/sun/comms/messaging64/sbin/configure
Please enter the fully qualified host name for the Messaging Server.

   Enter fully qualified host name [mail.sunviet.vn] {"<" goes back, "!" exits}

Please specify the directory into which the Messaging Server configuration and
data files will be installed.

   Directory to install Messaging Server configuration and data files
   [/var/opt/sun/comms/messaging64] {"<" goes back, "!" exits}:
Messaging Server components showing a checked box will be configured. Please
change selection accordingly.


 [X]  1  Message Transfer Agent    0 bytes
 [X]  2  Message Store    0 bytes
 [X]  3  Webmail Server    0 bytes
 [ ]  4  Messaging Multiplexor    0 bytes

   To check a particular component, enter its number, or 0 when you are
   finished [0] {"<" goes back, "!" exits}:
Please enter the user and group which will be used to adminster the Messaging
Server. The user and group will be created if they do not exist. If the user is
created, it will have a password that is locked out.
   Enter Username [mailsrv]:
   Enter Unix Group [mail]:

User/Group Server LdapURL [ldap://mail.sunviet.vn:389] {"<" goes back, "!"
   exits}:
   Bind As [cn=Directory Manager] {"<" goes back, "!" exits}:
   Password {"<" goes back, "!" exits}:

Do not use an email address that begins with "Postmaster@".  This email address
is already assigned to the Postmaster alias.

   Enter Postmaster email address [] {"<" goes back, "!" exits} hostmaster@domain.com
Enter a password to be used for Messaging Server (several administration
accounts)
   Enter password [] {"<" goes back, "!" exits}:
   Re-enter password to verify [] {"<" goes back, "!" exits}:

Please enter the default email domain that this Messaging Server will be
responsible for. The default email domain is the domain of unqualified user-
id's that do not belong to any particular domain.

   Enter Email Default Domain [sunviet.vn] {"<" goes back, "!" exits}

The Organization DN will be the LDAP subtree under which all email users and
groups that belong to the default email domain are located. Note that the DN
must be located under the user/group suffix.

   Enter Organization DN [o=sunviet.vn,dc=sunviet,dc=vn] {"<" goes back, "!" exits}
Start messaging server:
#/opt/sun/comms/messaging64/sbin/start-msg
3. Setup Application Server 9.1

a. Cài d?t Application Server 9.1

# ./sjsas_ee-9_1_02-solaris-i586.bin -console
Installation Directory [/opt/SUNWappserver] {"<" goes back, "!" exits}:
Administrator User [admin] {"<" goes back, "!" exits}:
Administrator User's Password (8 chars minimum):
Re-enter Password:
Do you want to store administrator user name and password in user preference
file [yes] {"<" goes back, "!" exits}?
Administration Port [4848] {"<" goes back, "!" exits}:
HTTP Port [8080] {"<" goes back, "!" exits}:80
HTTPS Port [8181] {"<" goes back, "!" exits}:
1. Access the About Application Server PE 8 welcome page at:
       file:///opt/SUNWappserver/docs/about.html
2. Start the Application Server by executing:
 #  /opt/SUNWappserver/bin/asadmin start-domain domain1
3. Start the Admin Console:
       http://localhost:4848
# /opt/SUNWappserver/bin/asadmin stop-appserv

b. Start Sun Application Server

T?o file /etc/asadminpassword
vi  /etc/asadminpasswd
AS_ADMIN_PASSWORD=tainguyenmtvn
AS_ADMIN_MASTERPASSWORD=tainguyenmtvn
Ch?y Application Server
 /opt/SUNWappserver/bin/asadmin stop-domain
 /opt/SUNWappserver/bin/asadmin start-domain --user admin --passwordfile /etc/asadminpasswd

4. Setup Sun Converenge 1.0

a. Configure Sun Converenge

# JAVA_HOME=/usr;export JAVA_HOME;
# /opt/sun/comms/iwc/sbin/init-config -nodisplay
Specify the directory in which the configuration and data files should be
   installed [/var/opt/sun/comms/iwc] {"<" goes back, "!" exits}:

 [X]  1  Mail Service    0 bytes
 [ ]  2  Calendar Service    0 bytes
 [ ]  3  Instant Messaging Service    0 bytes
   To select a component, enter its number, or 0 when you are done [0] {"<"
   goes back, "!" exits}: 0

Convergence is to be configured.

Virtual Server Identifier: Enter the Virtual Server Identifier for which the
Sun Convergence is to be configured.

Server Instance HTTP Port: Enter the Application Server port number where HTTP
service is available.

   Enter Application Server Install Directory [/opt/SUNWappserver] {"<" goes
   back, "!" exits}:
   Enter Application Server Domain Directory
   [/opt/SUNWappserver/domains/domain1] {"<" goes back, "!" exits}:
   Enter Application Server Document Root Directory
   [/opt/SUNWappserver/domains/domain1/docroot] {"<" goes back, "!" exits}:
   Enter Application Server Instance Name [server] {"<" goes back, "!" exits}:
   Enter Virtual Server Identifier [server] {"<" goes back, "!" exits}:
   Enter Application Server Instance HTTP Port [80] {"<" goes back, "!" exits}:
Please Wait: Verifying whether the Application Server Instance connection is
Alive

Application Server: Administration Instance Details
Specify Application Server's Administration instance details used by the
configurator to configure Sun Convergence on Application Server.
   Enter the Administration Server Port [4848] {"<" goes back, "!" exits}:
   Enter the Administrator User ID [admin] {"<" goes back, "!" exits}:
   Enter the Administrator Password [] {"<" goes back, "!" exits}:
   Is the Administration Server instance running in the secure mode  [yes] {"<"
   goes back, "!" exits}?
Please Wait: Verifying whether the Administration Server instance connection is
alive

Information
You have specified that the Application Server's Administration Server instance
is running in the secure mode.
URI Path
Enter the URI Path for Sun Convergence.
URI Path: Enter the URI Path where the Sun Convergence is to be deployed.

Note: Ensure you have specified a new URI Path. If there exists a web
application already configured at the specified URI, it will be deleted before
Sun Convergence is deployed.
   Enter URI Path for Sun Convergence [/iwc] {"<" goes back, "!" exits}:
Start Install Sun Convergence to Application Server

b. Configure redirect http://mail.sunviet.vn/iwc URL to http://mail.sunviet.vn
vi /opt/SUNWappserver/domains/domain1/docroot/index.html
<meta http-equiv="refresh" content="0;url=http://mail.sunviet.vn/iwc">
c. Patch for Sun Convergence

# JAVA_HOME=/usr
# export JAVA_HOME
# patchadd 137631-12
5. Script to auto-start Sun Messaging

ln -s /var/Sun/mps/start-admin /usr/sbin/start-admin
ln -s /var/Sun/mps/slapd-mail/start-slapd /usr/sbin/start-ldap
ln -s /opt/sun/comms/messaging64/sbin/start-msg /usr/sbin/start-msg
vi /usr/sbin/start-app
#!/bin/sh
/opt/SUNWappserver/bin/asadmin start-domain --user admin --passwordfile /etc/asadminpassword
chmod u+x /usr/sbin/start-app
vi /usr/sbin/run-ciren
#!/bin/sh
start-ldap
start-admin
start-msg
start-app
vi /etc/rc3.d/S98Ciren
run-ciren
chmod u+x /etc/rc3.d/S98Ciren
6. Setup a local DNS server for Testing

a. Create file /etc/named.conf
vi /etc/named.conf
"/etc/named.conf" 15 lines, 224 characters
options {
                DIRECTORY "/var/named";
};

zone    "."  {
                type hint;
                file "db.root";
};

zone    "sunviet.vn" in {
                type master;
                file "db.sunviet.vn";
};

b. Create file /var/named/db.root
vi /var/named/db.root
; formerly NS.INTERNIC.NET
;
.       3600000  IN NS    A.ROOT-SERVERS.NET.
A.ROOT-SERVERS.NET.      3600000      A     198.41.0.4
;
; formerly NS1.ISI.EDU
;
.       3600000  IN NS    B.ROOT-SERVERS.NET.
B.ROOT-SERVERS.NET.      3600000      A     128.9.0.107
;
; formerly C.PSI.NET
;
.       3600000  IN NS    C.ROOT-SERVERS.NET.
C.ROOT-SERVERS.NET.      3600000      A     192.33.4.12

; housed in Japan, operated by WIDE
;
.       3600000  IN NS    M.ROOT-SERVERS.NET.
M.ROOT-SERVERS.NET.      3600000      A     202.12.27.33
; End of File

T?o file /var/named/db.sunviet.vn
more /var/named/db.sunviet.vn
$TTL 86400

;{name}         {ttl}   Class   SOA     Origin                  Postmaster
;----------------------------------------------------------------------------------
@                       IN      SOA     mail.sunviet.vn.          root.mail.sunviet.vn. (
                                                2005010101      ; Serial
                                                3600            ; Refresh (1 Hour)
                                                1800            ; Retry (30 Minutes)
                                                6048000         ; Expire (1 Week)
                                                86400 )         ; Minimum (24 Hours)

;
;{name}         {ttl}   Class   NS      Nameserver Name
;------------------------------------------------------
                        IN      NS      mail.sunviet.vn.
                        IN      MX   10   mail.sunviet.vn.

;
;{name}         {ttl}   Class   A       IP Address
;-------------------------------------------------

mail                IN      A      172.16.4.34
localhost               IN      A       127.0.0.1

;
;{name}         {ttl}   Class   CNAME   Canonical Name
;-------------------------------------------------------
mail                    IN      CNAME   mail
c. Configure dns client
vi /etc/resolv.conf
nameserver localhost
domain sunviet.vn

cp /etc/nsswitch.dns /etc/nsswitch.conf
ipnodes:   files dns

svcadm enable dns/client

svcs |grep dns
online         15:08:29 svc:/network/dns/client:default
d. Run named process
named; dmesg |tail
Aug 30 15:11:55 mail named[2099]: [ID 873579 daemon.warning] checkhints: unable to find root NS 'j.root-servers.net' in hints
Aug 30 15:11:55 mail named[2099]: [ID 873579 daemon.warning] checkhints: unable to find root NS 'k.root-servers.net' in hints
Aug 30 15:11:55 mail named[2099]: [ID 873579 daemon.warning] checkhints: unable to find root NS 'l.root-servers.net' in hints
Aug 30 16:36:32 mail named[2792]: [ID 873579 daemon.notice] starting BIND 9.6.1-P3
Aug 30 16:36:32 mail named[2792]: [ID 873579 daemon.notice] built with --prefix=/usr --with-libtool --bindir=/usr/sbin --sbindir=/usr/sbin --libdir=/usr/lib/dns --sysconfdir=/etc --localstatedir=/var --with-openssl=/usr/sfw --enable-threads=yes --enable-devpoll=yes --enable-fixed-rrset --disable-openssl-version-check -DNS_RUN_PID_DIR=0
Aug 30 16:36:32 mail named[2792]: [ID 873579 daemon.error] binding TCP socket: address in use
Aug 30 16:36:32 mail last message repeated 1 time
Aug 30 16:36:32 mail named[2792]: [ID 873579 daemon.notice] couldn't add command channel 127.0.0.1#953: address in use
Aug 30 16:36:32 mail named[2792]: [ID 873579 daemon.notice] couldn't add command channel ::1#953: address not available
Aug 30 16:36:32 mail named[2792]: [ID 873579 daemon.notice] running

e. Test named
nslookup
> set q=MX  
> sunviet.vn
Server:         127.0.0.1
Address:        127.0.0.1#53
sunviet.vn mail exchanger = 10 mail.sunviet.vn.




QFS Setup



======= 2 nodes ==================
mkdir -p /db_qfs/Data3

# vi /etc/vfstab
Data3 - /db_qfs/Data3 samfs - no shared,notrace

# vi /etc/opt/SUNWsamfs/mcf
Data3 6 ma Data3 on shared
/dev/did/dsk/d6s0 60 mm Data3 on
/dev/did/dsk/d6s1 61 mr Data3 on

# vi /etc/opt/SUNWsamfs/hosts.Data3
node1 clusternode2-priv 1 0 server
node2 clusternode1-priv 1 0

# vi /etc/opt/SUNWsamfs/samfs.cmd
stripe=1
sync_meta=1
mh_write
qwrite
forcedirectio
nstreams=1024
notrace
rdlease=300
wrlease=300
aplease=300

# /opt/SUNWsamfs/sbin/samd config
# /opt/SUNWsamfs/sbin/sammkfs -S -a 64 Data3
# mount /db_qfs/Data3
# chown oracle:dba /db_qfs/Data3


=========================================

# mkdir /db_qfs/Data3/crs_files
# mkdir /db_qfs/Data3/db_files

# chown -R oracle:dba /db_qfs/Data3/crs_files
# chown -R oracle:dba /db_qfs/Data3/db_files

# cd /db_qfs/Data3/crs_files
# dd if=/dev/zero of=ocr bs=1024k count=120
# dd if=/dev/zero of=voting bs=1024k count=120
# chown -R oracle:dba voting
# chown -R root:dba ocr
# chmod -R 660 voting
# chmod -R 640 ocr


 clresource create -t SUNW.qfs -g Data-rg -p QFSFileSystem=/db_qfs/Data Data-rs

Share ISO Image


# share server
lofiadm -a /setup/eis-dvd.iso /dev/lofi/1
mount -F hsfs /dev/lofi/1 /mnt

vi /etc/dfs/dfstab
share -F nfs -o root=verilab /datashare
shareall
share

# verilab server
mount 10.0.0.205:/datashare /mnt

Tuesday, 19 February 2013

Oracle RAC Installation Procedure


Refeerence Oracle11gR2-RAC-Solaris10-Iscsi-ZFS-Vmware-RageshMoyan.pdf
Change DNS to Single SCAN IP Address

Configure networks


On rac1 &rac2
more /etc/hosts
::1     localhost      
127.0.0.1       localhost      
10.1.0.10       rac1    loghost
10.1.0.11      rac1-vip
10.1.0.12      rac1-priv
10.1.0.20    rac2
10.1.0.21    rac2-vip
10.1.0.22    rac2-priv
10.1.0.30   share
10.1.0.40   cluster


Machine generated alternative text: —. .—. — — .—.. 1
j CD/DVD (IDE)
Floppy
Network Adapter
Network Adapter 2
Sound Card
Display
Auto detect
Auto detect
Bridged
Bridged
Auto detect
Auto detect

bash-3.00# more /etc/netmasks
#
# The netmasks file associates Internet Protocol (IP) address
# masks with IP network numbers.
#
#       network-number  netmask
#
# The term network-number refers to a number obtained from the Internet Network
# Information Center.
#
# Both the network-number and the netmasks are specified in
# "decimal dot" notation, e.g:
#
#               128.32.0.0 255.255.255.0
#
10.0.0.0        255.0.0.0

bash-3.00# more /etc/defaultrouter
10.0.0.3

On rac1
bash-3.00# more /etc/hostname.e1000g0
rac1
bash-3.00# more /etc/hostname.e1000g1
rac1-priv

On rac2
bash-3.00# more /etc/hostname.e1000g0
rac2
bash-3.00# more /etc/hostname.e1000g1
rac2-priv

Configure share  disks
On share

Machine generated alternative text: l__I CILJ 4JI J.
Hard Disk (SCSI) 50 GB
Hard Disk (IDE) 50 GB
jCD/DVD (IDE) Using file C:\Users\paerl\Des...
Network Adapte ________________________
Bridged


root@share # format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
       0. c0d1 <DEFAULT cyl 6524 alt 2 hd 255 sec 63>
          /pci@0,0/pci-ide@7,1/ide@1/cmdk@1,0
       1. c1t0d0 <VMware,-VMware Virtual S-1.0-50.00GB>
          /pci@0,0/pci15ad,1976@10/sd@0,0
Specify disk (enter its number):


# zpool create -f shrpool c1t0d0

# zfs create -V 3G shrpool/crs01
#  zfs create -V 10G shrpool/data01
#  zfs create -V 15G shrpool/fra01

# zfs set shareiscsi=on shrpool/crs01
( check format onrac1, rac2  to determine system have same drive path, e.g: c4t7d0 )
# zfs set shareiscsi=on  shrpool/data01
# zfs set shareiscsi=on shrpool/fra01

On rac1 &rac2

bash-3.00# vi /kernel/drv/iscsi.conf
#
# Copyright 2006 Sun Microsystems, Inc.  All rights reserved.
# Use is subject to license terms.
#
#ident  "@(#)iscsi.conf 1.2     06/06/12 SMI"

name="iscsi" parent="/" instance=0;
ddi-forceattach=1;

#
# I/O multipathing feature (MPxIO) can be enabled or disabled using
# mpxio-disable property. Setting mpxio-disable="no" will activate
# I/O multipathing; setting mpxio-disable="yes" disables the feature.
#
# Global mpxio-disable property:
#
# To globally enable MPxIO on all iscsi ports set:
# mpxio-disable="no";
#
# To globally disable MPxIO on all iscsi ports set:
# mpxio-disable="yes";
#
mpxio-disable="yes";


( # iscsiadm list discovery-address )
( # iscsiadm remove discovery-address 10.0.0.30:3260 )
# iscsiadm add discovery-address 10.1.0.30:3260

bash-3.00# format
Searching for disks...
done


AVAILABLE DISK SELECTIONS:
       0. c0d0 <DEFAULT cyl 3913 alt 2 hd 255 sec 63>
          /pci@0,0/pci-ide@7,1/ide@0/cmdk@0,0
       1. c4t6d0 <DEFAULT cyl 1302 alt 2 hd 255 sec 63>
          /iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A4f8bbc55-3509-cc17-84b9-cdfae48bc4180001,0
       2. c4t7d0 <DEFAULT cyl 1532 alt 2 hd 128 sec 32>
          /iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A793e3bb7-6522-4610-88dc-8125621c1d8f0001,0
       3. c4t8d0 <DEFAULT cyl 1955 alt 2 hd 255 sec 63>
          /iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A6805ce31-3c14-41ff-b630-f07af4abd3c90001,0


On share
root@share #  iscsitadm list target -v
Target: shrpool/fra01
    iSCSI Name: iqn.1986-03.com.sun:02:6805ce31-3c14-41ff-b630-f07af4abd3c9
    Alias: shrpool/fra01
    Connections: 2
        Initiator:
            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.5114f504
            Alias: rac2
        Initiator:
            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.511515f2
            Alias: rac1
    ACL list:
    TPGT list:
    LUN information:
        LUN: 0
            GUID: 600144f05115259800000c29587e6600
            VID: SUN
            PID: SOLARIS
            Type: disk
            Size:   15G
            Backing store: /dev/zvol/rdsk/shrpool/fra01
            Status: online
Target: shrpool/crs01
    iSCSI Name: iqn.1986-03.com.sun:02:793e3bb7-6522-4610-88dc-8125621c1d8f
    Alias: shrpool/crs01
    Connections: 2
        Initiator:
            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.5114f504
            Alias: rac2
        Initiator:
            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.511515f2
            Alias: rac1
    ACL list:
    TPGT list:
    LUN information:
        LUN: 0
            GUID: 600144f05115246400000c29587e6600
            VID: SUN
            PID: SOLARIS
            Type: disk
            Size: 3.0G
            Backing store: /dev/zvol/rdsk/shrpool/crs01
            Status: online
Target: shrpool/data01
    iSCSI Name: iqn.1986-03.com.sun:02:4f8bbc55-3509-cc17-84b9-cdfae48bc418
    Alias: shrpool/data01
    Connections: 2
        Initiator:
            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.5114f504
            Alias: rac2
        Initiator:
            iSCSI Name: iqn.1986-03.com.sun:01:eaaee2f3ffff.511515f2
            Alias: rac1
    ACL list:
    TPGT list:
    LUN information:
        LUN: 0
            GUID: 600144f051148a1d00000c29587e6600
            VID: SUN
            PID: SOLARIS
            Type: disk
            Size:   10G
            Backing store: /dev/zvol/rdsk/shrpool/data01
            Status: online

bash-3.00# ls -l /dev/rdsk/c4t6d0s1
lrwxrwxrwx   1 root     root         104 Feb  8 22:52 /dev/rdsk/c4t6d0s1 -> ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A4f8bbc55-3509-cc17-84b9-cdfae48bc4180001,0:b,raw
bash-3.00# ls -l /dev/rdsk/c4t7d0s1
lrwxrwxrwx   1 root     root         104 Feb  8 23:14 /dev/rdsk/c4t7d0s1 -> ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A793e3bb7-6522-4610-88dc-8125621c1d8f0001,0:b,raw
bash-3.00# ls -l /dev/rdsk/c4t8d0s1
lrwxrwxrwx   1 root     root         104 Feb  8 23:19 /dev/rdsk/c4t8d0s1 -> ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A6805ce31-3c14-41ff-b630-f07af4abd3c90001,0:b,raw
bash-3.00#
bash-3.00#
bash-3.00#
bash-3.00# chown grid:asmadmin ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A4f8bbc55-3509-cc17-84b9-cdfae48bc4180001,0:b,raw
bash-3.00# chown grid:asmadmin ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A793e3bb7-6522-4610-88dc-8125621c1d8f0001,0:b,raw
bash-3.00# chown grid:asmadmin ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A6805ce31-3c14-41ff-b630-f07af4abd3c90001,0:b,raw
bash-3.00#
bash-3.00# chmod 660 ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A4f8bbc55-3509-cc17-84b9-cdfae48bc4180001,0:b,raw
bash-3.00# chmod 660 ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A793e3bb7-6522-4610-88dc-8125621c1d8f0001,0:b,raw
bash-3.00# chmod 660 ../../devices/iscsi/disk@0000iqn.1986-03.com.sun%3A02%3A6805ce31-3c14-41ff-b630-f07af4abd3c90001,0:b,raw

3.Pre

On rac1 &rac2

Check packages
# pkgadd -d cdrom/sol_10_910_x86/Solaris_10/Product/ SUNWi1cs
# pkgadd -d cdrom/sol_10_910_x86/Solaris_10/Product/ SUNWi15cs

Set the UDP parameters on both rac1 &rac2
To check current settings for udp_recv_hiwat and udp_xmit_hiwat, enter the following
Commands as root user on both nodes.
# ndd /dev/udp udp_xmit_hiwat
# ndd /dev/udp udp_recv_hiwat
On Solaris 10, to set the values of these parameters to 65536 bytes in current memory,
Enter the following commands for setting until next boot up:
# ndd -set /dev/udp udp_xmit_hiwat 65536
# ndd -set /dev/udp udp_recv_hiwat 65536
Make values persistent across reboots.
As root user on both nodes.
Create a additional swapfile for swap space extension
# mkfile 2G /swapfile1
# cat>/etc/rc2.d/S99ndd<<EOF
ndd -set /dev/udp udp_xmit_hiwat 65536
ndd -set /dev/udp udp_recv_hiwat 65536
swap -a /swapfile1
EOF


Create Users, Groups and Directories for Grid & RDBMS home.
Run below on bothnodes as root user:
----Cut&Paste as root on rac1 & rac2
groupadd -g 1000 oinstall
groupadd -g 1200 asmadmin
groupadd -g 1201 asmdba
groupadd -g 1202 asmoper
groupadd -g 1300 dba
groupadd -g 1301 oper
useradd -u 1100 -g oinstall -G asmadmin,asmdba,asmoper -d /export/home/grid \
-m -s /usr/bin/bash -c "Grid Infrastructure Owner" grid
passwd grid
useradd -u 1101 -g oinstall -G dba,oper,asmdba -d /export/home/oracle -m -s \
/usr/bin/bash -c "Oracle Software Owner" oracle
passwd oracle
mkdir -p /u01/app/grid
mkdir -p /u01/app/11.2.0/grid
chown -R grid:oinstall /u01
mkdir -p /u01/app/oracle
chown oracle:oinstall /u01/app/oracle
chmod -R 775 /u01
----Cut&Paste as root on ac1 & rac2-----
Check for nobody user (id nobody), it will exists as part of the solaris install

Setup .profiles for Users (oracle & grid)
Login to ac1 & rac2 as root and switch to grid user as below and add the entires.
**Here comment the ORACLE_SID as per node.
eg:- Comment ORACLE_SID=+ASM2 on rac1
root# su - grid
-----.profile-----
ORACLE_SID=+ASM1; export ORACLE_SID
ORACLE_SID=+ASM2; export ORACLE_SID
JAVA_HOME=/usr/local/java; export JAVA_HOME
ORACLE_BASE=/u01/app/grid; export ORACLE_BASE
ORACLE_HOME=/u01/app/11.2.0/grid; export ORACLE_HOME
ORACLE_TERM=xterm; export ORACLE_TERM
NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"; export NLS_DATE_FORMAT
TNS_ADMIN=$ORACLE_HOME/network/admin; export TNS_ADMIN
ORA_NLS11=$ORACLE_HOME/nls/data; export ORA_NLS11
PATH=.:${JAVA_HOME}/bin:${PATH}:$HOME/bin:$ORACLE_HOME/bin
PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin
PATH=${PATH}:/u01/app/common/oracle/bin
export PATH
LD_LIBRARY_PATH=$ORACLE_HOME/lib
LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib
LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib
export LD_LIBRARY_PATH
CLASSPATH=$ORACLE_HOME/JRE
CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib
CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib
CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib
export CLASSPATH
THREADS_FLAG=native; export THREADS_FLAG
export TEMP=/tmp
export TMPDIR=/tmp
umask 022
set -o vi
-----.profile-----

Login to rac1/rac2 as root and switch to oracle user as below and add the entires.
**Here comment the ORACLE_SID as per node.
eg:- Comment ORACLE_SID=+racdb2 on rac1
root# su – oracle
----.profile----
# Set the below ORACLE_SID as per node
ORACLE_SID=racdb1; export ORACLE_SID
ORACLE_SID=racdb2; export ORACLE_SID
ORACLE_UNQNAME=racdb; export ORACLE_UNQNAME
JAVA_HOME=/usr/local/java; export JAVA_HOME
ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE
ORACLE_HOME=$ORACLE_BASE/product/11.2.0/dbhome_1; export ORACLE_HOME
ORACLE_PATH=/u01/app/common/oracle/sql; export ORACLE_PATH
ORACLE_TERM=xterm; export ORACLE_TERM
NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"; export NLS_DATE_FORMAT
TNS_ADMIN=$ORACLE_HOME/network/admin; export TNS_ADMIN
ORA_NLS11=$ORACLE_HOME/nls/data; export ORA_NLS11
PATH=.:${JAVA_HOME}/bin:${PATH}:$HOME/bin:$ORACLE_HOME/bin
PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin
PATH=${PATH}:/u01/app/common/oracle/bin
export PATH
LD_LIBRARY_PATH=$ORACLE_HOME/lib
LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib
LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib
export LD_LIBRARY_PATH
CLASSPATH=$ORACLE_HOME/JRE
CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib
CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib
CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib
export CLASSPATH
THREADS_FLAG=native; export THREADS_FLAG
export TEMP=/tmp
export TMPDIR=/tmp
umask 022
set -o vi
----.profile----

Setup Kernel parameters
**Below steps needs to be done on both rac1& rac2
Setup /etc/system
Oracle Clusterware does not set project information when starting processes, some
/etc/system processes that are deprecated but not removed must still be set for Oracle
Clusterware. Oracle recommends that you set both resource control and /etc/system
parameters. Operating system parameters not replaced by resource controls continue
to affect performance and security on Solaris 10 systems.
Append the below parameters to /etc/system of both ac1 & rac2
---Cut & Paste in /etc/system onrac1& rac2
---
set noexec_user_stack = 1
set semsys:seminfo_semmni = 100
set semsys:seminfo_semmns = 1024
set semsys:seminfo_semmsl = 256
set semsys:seminfo_semvmx = 32767
set shmsys:shminfo_shmmax = 4294967295
set shmsys:shminfo_shmmni = 100
set max_nprocs = 20000
set rlim_fd_max = 65536
set rlim_fd_cur = 1024
---Cut & Paste in /etc/system on rac1& rac2
---
**Below steps needs to be done on bothrac1& rac2
Create Project for Grid user and set Kernel parameters
Login as root user (on ac1 & rac2)
root# projadd grid <= This will create a project by name grid
Login into grid user,
root# su - grid
-bash-3.00$ id -p
uid=1100(grid) gid=1000(oinstall) projid=3(default)
Here grid is assigned "default" to change this to grid add a line shown below in
"/etc/user_attr" as root user on rac1& rac2
root# cat>>/etc/user_attr<<EOF
grid::::project=grid
EOF
Relogin into grid user
--log--
# su - grid
Sun Microsystems Inc. SunOS 5.10 Generic January 2005
-bash-3.00$ id -p
uid=1100(grid) gid=1000(oinstall) projid=100(grid)
-bash-3.00$
--log—
Here now grid user is assigned project ID=100 and name grid.

Below are the Kernel parameters required to be set for the "grid" project.
Parameter
Replaced by
Resource Control
Recommended
Values
noexec_user_stack
NA
1
semsys:seminfo_semmni
project.max-sem-ids
100
semsys:seminfo_semmns
NA
1024
semsys:seminfo_semmsl
process.max-sem-nsems
256
semsys:seminfo_semvmx
NA
32767
shmsys:shminfo_shmmax
project.max-shm-memory
4294967295
shmsys:shminfo_shmmni
project.max-shm-ids
100
**The only value which needs to be modified here is of "project.max-shm-memory"
in our install. Remaining values are either equal or more than above mentioned.
Determine the current value of shared memory
grid$ prctl -n project.max-shm-memory -i project grid
--log--
-bash-3.00$ id -p
uid=1100(grid) gid=1000(oinstall) projid=100(grid)
-bash-3.00$ prctl -n project.max-shm-memory -i project grid
project: 100: grid
NAME PRIVILEGE VALUE FLAG ACTION RECIPIENT
project.max-shm-memory
privileged 748MB - deny -
system 16.0EB max deny -
-bash-3.00$
--log--
Permanently set the value in Grid project
root# projmod -sK "project.max-shm-memory=(privileged,4G,deny)" grid
Verify that the resource control is active and reflects the values:
cat /etc/project
--log--
# cat /etc/project
system:0::::
user.root:1::::
noproject:2::::
default:3::::
group.staff:10::::
grid:100::::project.max-shm-memory=(privileged,4294967296,deny)
--log--

**Below steps needs to be done on both rac1& rac2
Create Project for Oracle user and set Kernel parameters
Login as root user on rac1& rac2
root# projadd oracle <= This will create a project by name oracle
root# su - oracle
-bash-3.00$ id –p
uid=1101(oracle) gid=1000(oinstall) projid=3(default)
Here oracle is assigned "default" to change this to oracle add a line shown below in
“ /etc/user_attr” as root user in rac1 & rac2
root# cat>>/etc/user_attr<<EOF
oracle::::project=oracle
EOF
Relogin into oracle
--log--
-bash-3.00$ id -p
uid=1101(oracle) gid=1000(oinstall) projid=101(oracle)
-bash-3.00$
--log--
Here now oracle user is assigned project ID=101 and name oracle.
Below are the Kernel parameters required to be set for the "oracle" project.
Parameter
Replaced by
Resource Control
Recommended
Values
noexec_user_stack
NA
1
semsys:seminfo_semmni
project.max-sem-ids
100
semsys:seminfo_semmns
NA
1024
semsys:seminfo_semmsl
process.max-sem-nsems
256
semsys:seminfo_semvmx
NA
32767
shmsys:shminfo_shmmax
project.max-shm-memory
4294967295
shmsys:shminfo_shmmni
project.max-shm-ids
100
The only value which needs to be modified here is of "project.max-shm-memory"
in our install.Remaining values are either equal or more than above mentioned.
Determine the current value of shared memory
oracle$ prctl -n project.max-shm-memory -i project oracle
--log--
-bash-3.00$ id -p
uid=1101(oracle) gid=1000(oinstall) projid=101(oracle)

-bash-3.00$ prctl -n project.max-shm-memory -i project oracle
project: 101: oracle
NAME PRIVILEGE VALUE FLAG ACTION RECIPIENT
project.max-shm-memory
privileged 748MB - deny -
system 16.0EB max deny -
-bash-3.00$
--log--
Permanently set the value in Oracle project
root# projmod -sK "project.max-shm-memory=(privileged,4G,deny)" oracle
Verify that the resource control is active and reflects the values:
cat /etc/project
--log--
# cat /etc/project
system:0::::
user.root:1::::
noproject:2::::
default:3::::
group.staff:10::::
grid:100::::project.max-shm-memory=(privileged,4294967296,deny)
oracle:101::::project.max-shm-memory=(privileged,4294967296,deny)
#
--log--

Install
Machine generated alternative text: Select any of the following installation options
Ø l•nstall and Configure Grid Infrastructure for a Cluster
Q Install and Qonfigure Grid Infrastructure for a Standalone Server
! upgrade Grid Infrastructure
! Install grid Infrastructure Software Only

Machine generated alternative text: lypical Installation
Perform a full grid infrastructure installation with basic configuration.
Advanced Installation
Allows advanced configuration options such as aternative storage choices, additional networking flexibility,
integration with IPMI, and more granularity in specifying Automatic Storage Management roles.

Machine generated alternative text: Specify basic configuration information for the grid infrastructure.
SCAN Name: cluster
Hostname Virlual IP Name
Iracl rad -vip
rac2
rac2-vip
SSH Connectivity... Use Cluster Configuration File... Add... CIIt... Femove
Identity network interfaces...

Machine generated alternative text: Specify basic configuration information for the grid infrastructure.
SCAN Name: cluster
Hostname Virtual IP Name
rad rad -vip
rac2
rac2-vip
551-I Connectivty... Use Cluster Configuration File... Add... Edit... Remove
QS Username: grid OS Passfford: I
D User home is shared by the selected nodes
D Reuse private and public keys existing in the user home
Identify network interfaces...

Machine generated alternative text: Identify the planned use for each global interface shown in the box below as Public, Private, or Do Not Use. Private
interfaces are used by Oracle Grid Infrastructure for internode traffic.
If there is more than one subnet associated with an interface, then change the interfaces attributes to associate the
interface name with the additional subnets.
Interface Name Subnet Interface Type j
el 000gO 10.0.0.0 [Public
el 000gl 10.0.0.0 [Private

Machine generated alternative text: Specify locations for Oracle base, where to install the software, where to place the Oracle Cluster Registry
(OCR), and which UNIX group should be given administrative privileges (OSASM) for Automatic Storage
Management.
Oracle 8ae: MOl /app/grid w BLowse
Software Location: MOI /app/i I .2.0/grid ZE]w Browse
Cluster Registry Storage Type: Automatic Storage Management
SYSASM Password:
Confirm Password:
OSASM group: [asmadmin rj

Machine generated alternative text: Select Disk Group Characteristics and select disks
Disk Group Name
Redundancy Hiah Norrna ‘ xternal
Ici
‘ Candidate Disks All Disks
Disk Path j(inM8jatu
10166 Candidate
Li Idevkdsklc4t6dosl
El
D ldevkdsklc4t8dosl
tdevkdsk/c4t7dOsl
15296 Candidate
Change Discovery eath


Machine generated alternative text: You are starling your first installation on this host. Specify a directory for installation files. This directory is called
the “inventory directory. The installer automatically sets up subdirectories for each product to contain inventory
data. The subdirectory for each product typically requires 150 kilobytes of disk space.
Inventory Directory:  Iapp/oralnventory Browse
Members of the following operating system group (the primary group) will have write permission to the inventory
directory (orainventory).
oralnventory Group Name: oinstall


Machine generated alternative text: - OFicie Grid Infreetructure a
- Global Settings
Disk Space: required 3.46 GB available 11 .74 GB
Install Option: Install and Configure Grid Infrastructure for a Cluster
Oracle base: AiDi /app/grid
Oracle home: MD1 /app/il 2.D/grid
Source Location: /gridAnstall/../stage4roducts.xml
- lnuento.y information
Inventory location: MD1 /app/oralnveritory
Central inventory (oralnventory) group:: oinstall
- Grid Infrastructure Settings
Cluster Name: cluster
Local Node: rad
Remote Node(s): rac2
SCAN Name: cluster
SCAN Port: 1521
Public Interfaces: el DDDgD


bash-3.00# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
bash-3.00# /u01/app/11.2.0/grid/root.sh
Running Oracle 11g root.sh script...

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
Creating /usr/local/bin directory...
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /var/opt/oracle/oratab file...
Entries will be added to the /var/opt/oracle/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2013-02-18 16:59:17: Parsing the host name
2013-02-18 16:59:17: Checking for super user privileges
2013-02-18 16:59:17: User has super user privileges
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
  root wallet
  root wallet cert
  root cert export
  peer wallet
  profile reader wallet
  pa wallet
  peer wallet keys
  pa wallet keys
  peer cert request
  pa cert request
  peer cert
  pa cert
  peer root cert TP
  profile reader root cert TP
  pa root cert TP
  peer pa cert TP
  pa peer cert TP
  profile reader pa cert TP
  profile reader peer cert TP
  peer user cert
  pa user cert
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'
CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'
CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'
CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'
CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded

ASM created and started successfully.

DiskGroup CRS created successfully.

clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-2672: Attempting to start 'ora.crsd' on 'rac1'
CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 812ffcc7d82d4feabf66530ad0b28fbd.
Successfully replaced voting disk group with +CRS.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   812ffcc7d82d4feabf66530ad0b28fbd (/dev/rdsk/c4t7d0s1) [CRS]
Located 1 voting disk(s).
CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'
CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'rac1'
CRS-2677: Stop of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'
CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'
CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'
CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac1'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'
CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'
CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac1'
CRS-2676: Start of 'ora.asm' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'rac1'
CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'rac1'
CRS-2676: Start of 'ora.evmd' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'rac1'
CRS-2676: Start of 'ora.asm' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.CRS.dg' on 'rac1'
CRS-2676: Start of 'ora.CRS.dg' on 'rac1' succeeded

rac1     2013/02/18 17:06:25     /u01/app/11.2.0/grid/cdata/rac1/backup_20130218_170625.olr
Configure Oracle Grid Infrastructure for a Cluster ... succeeded
Updating inventory properties for clusterware
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 5123 MB    Passed
The inventory pointer is located at /var/opt/oracle/oraInst.loc
The inventory is located at /u01/app/oraInventory
'UpdateNodeList' was successful.
bash-3.00# /u01/app/11.2.0/grid/root.sh  /u01/app/11.2.0/grid/bin/crsctl check crs
bash-3.00#
bash-3.00#  /u01/app/11.2.0/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online



Machine generated alternative text: Provide your email address to be informed of security issues, install the product
and initiate configuration manager. View details.
Email:
Easier for you if you use your My Oracle Support email addressitisername.
Dl wish to receive security updates via My Oracle Support.

Machine generated alternative text: Select any of the following install options.
Q Qreate and configure a database
Ø l.nstall database software only
! upgrade an existing database

Machine generated alternative text: Select the type of database installation you want to perform.
Single instance database installation
eal Application Clusters database installation
Select nodes (in addition to the local node) in the cluster where the installer should install Oracle RAC.
Node Name
User home is shared bthe selected nodes
Reuse private and public keys existing in the user home
Test Setu
SSI-l Connectivity...
OS Username: oracle
[Select All] [Deselect All]
OS Password

Machine generated alternative text: Which database edtion do you want to install?
Enterprise Edition (4 .55GB)
Oracle Database 11g Enterprise Edition is a self-managing database that has the scalability, performance,
high availability, and security teatures required fo run the most demanding, mission-critical applications.
! ! Standard Edtion (4.4BGB)
Oracle Database 11g Standard Edtion is a full-featured data management solution ideally suited fo the
needs of medium-sized businesses, It includes Oracle Real Application Clusters for enterprise-class
availability and comes complete wth ts own clusterware and storage management capabilities.

Machine generated alternative text: Specify an Oracle base path to place all Oracle software and configuration-related files. This location is the
Oracle base directory.
Qracle Base: MOl /app/oracle [owse..
Specif y a location for storing Oracle software files. This location is the Oracle home directory.
oftware Location: MOl /app/oracle.4xoduct/1 1 .2.O/dbhome_l ________ Brose...

Machine generated alternative text: SYSDBA and SYSOPER privileges are required to create a database using operating system (OS) authentication.
Membership in OSDEA grants the SYSDBA privilege, and membership in OSOPER grants the SYSOPER privilege,
which is a subset of SYSDBA privileges. Select the name of the OSDBA group to grant the SYSDBA privilege. You
must be a member of this group.
Database &dministrator (OSDEA) Group: dba
Database Qperator (OSOPER) Group: [ w

On rac1 &rac2

bash-3.00# /u01/app/oracle/product/11.2.0/dbhome_1/root.sh
Running Oracle 11g root.sh script...

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/oracle/product/11.2.0/dbhome_1

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The file "dbhome" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]:
The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]:
The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]:

Entries will be added to the /var/opt/oracle/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
Finished product-specific root actions.
bash-3.00# /u01/app/11.2.0/grid/bin/crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

Login rac1 as grid
$ asmca

Machine generated alternative text: r z M Configuration Assistant: Configure ASM: Disk Groups
ASM Instances [ Disk Groups r Volumes Ffle Systems
You can choose to create a new disk group or add disks to an existing disk group. To create dynamic volumes, you need disk groups wth
11.2 ASM compatibilty.
Tip: To perform operations on a disk group, right mouse click on the row.
Disk Groups
Disk Group Name [ Size (GB) [ Free (GB) [ Usable (GB) [ Redundancy State
CRS 2.9B 2.60 2.60 E)CFERN MOUNTED(2 012)
j Create] [Mount All [[Dismount All_[



Machine generated alternative text: Disk Group Name DATA
Redundancy
Redundancy is achieved by storing multiple copies of the data on ditterent tailure groups. Normal redundancy needs disks from atleast two different
failure groups, and high redundancy from at least three different failure groups.
High Normal - External (None)
Select Member Disks
Show Eligible ‘Show All
Quorum failure groups are used to store voting files in extended clusters and do not contain any user data. It requires ASM compatibility of 11 .2 or
higher.
F Disk Path [ Header Status [ Disk Name Size (MB) [ Quorum
W Idevfrdskic4t6dOsi CANDIDATE 10166 F
F ldevlrdskfc4t8dosl CANDIDATE 15296 F
Note: If you do not see the disks which you believe are available, check Disk Discovery Path and readtwrf e permissions on the disks. The Disk
Discovery Path limits sat of disks considered for discovery.
Disk Discovery Path: <def ault> Change Disk Discovery Path
Click on the Show Advanced Options button to change the diskgroup attributes. Diskgroup compatibility attributes may need to be modified based on the
usage of diskgroup for different versions of databases or ASM Cluster File Systems.
[Show Advanced Options [ [OK[ Cancel Help



Machine generated alternative text: Disk Group Name FRA
Redundancy
Redundancy is achieved by storing mutiple copies of the data on different failure groups. Normal redundancy needs disks from atleast two different
failure groups, and high redundancy from atleast three different failure groups.
Q High C) Normal ® External (None)
Select Member Disks
® Show Eligible Q Show All
Quorum failure groups are used to store voting files in extended clusters and do not contain any user data. It requires ASM compatibilty 0111.2 or
higher.
F I Disk Path Header Status Disk Name Size (MB) Quorum
W Idevlrdsklc4t8dOsl CANDIDATE 15296 F
Note: If you do not see the disks which you believe are available, check Disk Discovery Path and readhvrte permissions on the disks. The Disk
Discovery Path limits sat of disks considered for discovery.
Disk Discovery Path: <def aut> Change Disk Discovery Path
Click on the Show Advanced Options button to change the diskgroup attributes. Diskgroup compatibility attributes may need to be modified based on the
usage of diskgroup for different versions of databases or ASM Cluster File Systems.
Show Advanced Options lORI Cancel

Machine generated alternative text: ASM Instances Disk Groups Volumes r r rtHr F H
You can choose to create a new disk group or add disks to an existing disk group. To create dynamic volumes, you need disk groups wth
11 .2 ASM compatibilty.
Tip: To perform operations on a disk group, right mouse click on the row.
Disk Groups
Disk Group Name Size (GB) J Free (GB) j Usable (GB) Redundancy j State j
DATA 9.93 9.93 9.B3 EXTERN MOUNTED(2 012)
FRA 14.94 14.84 14.84 E)CERN MOUNTED(2 012)
CRS 2.98 2.60 2.60 EXTERN MOUNTED(2 012)
Create Mount All Dismount All

Login rac1 as oracle
$ dbca

Machine generated alternative text: Welcome to the Database Configuration Assistantfor Oracle Real Application Clusters.
The Database Configuration Assistant enables you to create, configure, or delete a cluster
database and manage database templates. It also enables you to add and delete instances ola
cluster database.
Select the database type that you would like to create or administer
i Oracle Real Application Clusters database
r Oracle single instance database
Cancel J Help J Back Next )_)


Machine generated alternative text: Select the operation that you want to perform:
“ Create a Database
r Cùriî’jum Eit.L:.z C’
C Delete a Database
C Manage Templates
C Instance Management
t ASM configuration operations must be performed using Automatic Storage Management
Configuration Assistant (ASMCA) from Oracle Grid Infrastructure home.


Machine generated alternative text: Templates that include datafiles contain pre-created databases. They allow you to create a new
database in minutes, as opposed to an hour or more. Use templates without datafiles only when
necessary, such as when you need to change attributes like block size, which cannot be altered
after database creation.
Select Template Includes Datafiles
‘
General Purpose or Transaction Processing
Yes
.
Custom Database
! No
C Data Warehouse Yes


Machine generated alternative text: Cluster database configuration can be Policy-Managed orAdmin-Managed. A Policy-Managed
database is dynamic with instances managed automatically based on pools of servers for
effective resource utilization. Admin-Managed database results in instances tied to specific
servers.
Configuration Type: (I Admin-Managed r Policy-Managed
An Oracle database is uniquely identified by a Global Database Name, typically of the form
“name.domain”.
Global Database Name: Iracdb
A database is referenced by an Oracle instance on each cluster database node. Specity a prefix
to be used to name the cluster database instances.
SID Prefix: Iracdb
Select the nodes on which you want to create the cluster database. The local node “rad” will
always be used, whether or not it is selected.
Select All]
Deselect All
Back Next



Machine generated alternative text: Enterprise Manager Automatic Maintenance Tasks
l Configure Enterprise Manager
r Registerwith Grid Control for centralized management
Management Service No Agents Found
i Configure Database Control for local management
F Enable Alert Notifications
ûutgoing Mail (8MW) Server.
Recipient Email Address:
F Enable Daily Disk Backup to Recovery Area
Backup Start Time: 1 Ed   AM r PM
OS Username:  
OS Password: I
Back Next ))



Machine generated alternative text: For security reasons, you must specity passwords for the following user accounts in the new
database.
r Use Different Administrative Passwords
User Name Password Confirm Password
SYS
SYSTEM
DBS NM P
SYSMAN
¿I Use the Same Administrative Password forAll Accounts
Password:
Confirm Password: I”I



Machine generated alternative text: . -.. Select Disk Group __.
Available Disk Groups
Select Disk Group Name
Size (MB)
Free (MB)
Redundancy
State
jJ CR8
3056
2660
External
Mounted
a DATA 10166 0071 IT1 Mounted
r FRA 15296 15201 External Mounted
Note: Free (MB) reflects the usable free space available taking redundancy into account.
f5j Cancel)


Machine generated alternative text: Speci’ storage type and locations for database files.
Storage Type: Automatic Storage Management (ASM) .-]
Storage Locations:
r Use Database File Locations from Template
r Use Common Location forAll Database Files
Database Files Location: L Browse...)
i Use Oracle-Managed Files
Database Area: [fDATA
Multiplex Redo Logs and Control Files...
C lfyou want to specify different locations for any database files, pick any of the above options
except Oracle-Managed Files and use the Storage page laterto customize each file
location. lfyou use Oracle-Managed Files, Oracle automatically generates the names for
database files, which can not be changed on the Storage page.
File Location Variables...J
ack UextlJ


Machine generated alternative text: Choose the recovery options forthe database:
l Speci Flash Recovery Area
This is used as the defaultfor all disk based backup and recovery operations, and is also
required for automatic disk based backup using Enterprise Manager. Oracle recommends that
the database files and recovery files be located on physically different disks for data protection
and performance.
Flash Recovery Area: I+FRA Browse..3
Flash RecoveryArea Size: 114000  1M Bytes •j
F Enable Archiving Edit Archive Mode Parameters...
File Location variables...
Back Next >)


Machine generated alternative text: Database Components Custom Scripts
Select the components you want to configure for use in your database. Provide the tablespace
¡n which you wantthe component to reside. Components which appear disabled are either not
installed or depend on components which are not selected.
Oracle Text ¡SYSAUX «j
lOracleOLAP ISYSAUX —1
l Oracle Spatial ISYSAUX —1
F Oracle Label Security jSYSTEM J
FSampleSchemas ISYSAUX
lEnterprise Manager Repository [SYSAUX J
l Oracle Warehouse Builder [SYSAUX «J
F Oracle Database Vault jSYSAUX —]
Standard Database Components..d

Machine generated alternative text: Memory Sizing Character Sets Connection Mode
Typical ________
Memory Size (SOA and POA): 11022 MB I • .zi
Percentage: 40 % 490 MB 2556 MB
k? Use Automatic Memory Management Show Memory Distribution...)
r’ Custom
Memory Management lAutomatic Shared Memory Management
SCA Size: [766 lE [M Bytes ]
PCA Size: [255 iR [M Bytes ]
Total Memory for Oracle: 1022 M Bytes
All Initialization Parameters...)
Back




Machine generated alternative text: Select the database creation options:
PCreate Database
F Save as a Database Template
Name: Hc ‘1h
Description:
F Generate Database Creation Scripts
Destination Hh1t’h’’Drd’ Rd’1min’H’ ‘h 1 Browse...]
Directory:
back He.1


Machine generated alternative text: From the Database Storage page, you can specil’, storage parameters for database creation.
This page displays a tree listing and summary view (multi-column lists) to enable you to
change and view the following objects:
. Controlfiles
. Tablespaces
. Datafiles
. Rollback Segments
. Redo Log Groups
From any objecttype folder, clickCreateto create a new object. To dE
specific objectfrom within the objecttype folder and clickDelete.
Important: If you select a database template including data files, then you will not be able to
add or remove data files, tablespaces, or rollback segments. Selecting this type of template
enables you to change the following:
. Destination of the datafiles
. Control files or log groups.

Machine generated alternative text: A cluster database will be created with following parameters.
Create database with db name racdb.
Create Database - Summary
Database Configuration Summary
Global Database Naine: racdb
Database Configuration Type: Admin-Managed Cluster Database
Node List: rad ,rac2
SID List: racdbl ,racdb2
Management Option Type: Database Control
Storage Type: Automatic Storage Management (ASM)
Memory Configuration Type: Automatic Memory Management
Database Configuration Details
Database Components
Component elected
Oracle JYM true
Oracle Text true
OracIeXMLDB true
flnrIn iu1iiItimrii tni
Save as an HTML file...
OK__J Cancel j