11g DB Installation in RAC step by step Guide
11g DB Installation in RAC step by step Guide
Step_1::2 node 1 san installation Configuration
NODE 1
Note: While Installation We need to add two Network adapter nd there
netrwork should be b
/(root)------------10GB
/u01 --------------20gb
/swap--------------2*RAM
/tmp---------------06gb
eth0------192.168.1.100
eth1------10.0.1.100
vip-------192.168.1.101
=============================================
NODE_2
/(root)------------10GB
/u01 --------------20gb
/swap--------------2*RAM
/tmp---------------06gb
eth0------192.168.1.200
eth1------10.0.1.200
vip-------192.168.1.201
SAN (openfiler Configuration)
============================================
/(root)------------10GB
/tmp---------------05gb
/swap--------------2GB
SAN_IP- eth0------192.168.1.150
==============================================
Configuration Of NODE1 and NODE2 with SAN step by step
Step 1: open the browser in any one of the node nd use SAN IP address with port no
as it as like https://192.168.1.150:446/ It will ask the username and password
USERNAME: openfilier
PASSWORD: PASSWORD
a)Volume(click on it)
click on a create new physical values and then sda/dev
b)volume Group
Enter the valume group name and description here and add valume to group
c) Add Volume
create a valume in 'san11g;
Description 'san11g'
select "iscsi" as click on CREATE.
Step 2:Services
Enable -->iscsi target server
Enable -->iscsi initiator
Diseble-->Remaining All
Step 3:Volume
a)Iscsi target
i) Target Configuration
Add new iscsi Target
eg. tin.san11g [ADD]
click on [UPDATE]
b)LUN Mapping
Click on MAP
c)Network ACKL
Node1--->Allow
Node2--->Allow
Now update all the information permanuntly. There is top of right corner [UPDATE] button is there.
===============================================================================================================
==============================================================================================================
NODE 1 and NODE 2 Configuration [Do this on all nodes of rac]
vi /etc/hosts
set public,private,virtul ip and san ip here
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
###############################################################################
##node1
192.168.1.100 node1.uit.com node1
10.0.1.100 node1-priv.uit.com node1-priv
192.168.1.101 node1-vip.uit.com node1-vip
###############################################################################
##node2
192.168.1.200 node2.uit.com node2
10.0.1.200 node2-priv.uit.com node2-priv
192.168.1.201 node2-vip.uit.com node2-vip
192.168.1.150 scan-rac.uit.com scan-rac
node1#service network restart
node2#service network restart
=========================================================================================
==========================================================================================
CLUSTER CONFIGURATION AND CLUSTER INFORMATION STEP:
NOTE: Create followin group as user on all the node of rac
userdel -r oracle
groupdel oinstall
groupdel dba
groupadd -g 500 oinstall
groupadd -g 501 dba
groupadd -g 503 asmdba
groupadd -g 502 asmadmin
groupadd -g 504 asmoper
useradd -u 1000 -g oinstall -G asmadmin,asmdba,asmoper grid
useradd -u 2000 -g oinstall -G dba,asmadmin,asmdba oracle
passwd oracle
passwd grid
note: verify the group id user id of both the user grid nd oracle on all node
it must be same then only it ill work
ex node1----id oracle
` node2----id oracle........like same for grid user also.
================================================================================================
=================================================================================================
CONFIGURE KERNAL PARAMETER on all the rac node
vi /etc/sysctl.conf
vm.min_free_kbytes = 51200
kernel.shmmni=4096
kernel.sem=250 32000100 128
fs.file-max=6553600
net.core.rmem_default=262144
net.core.rmem_max=4194304
net.core.wmem_default=262144
net.core.wmem_max=1048576
$sysctl -l -------------execute this command to make this changes permanuntly.
==============================================================================================
==============================================================================================
set the shell limit for the oracle user on all the rac node
vi /etc/security/limit.con f
============================================================
grid soft nproc 2047
grid hard nproc 16384
grid soft nofile 1024
grid hard nofile 65536
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft nofile 1024
oracle hard nofile 65536
Configure security limits on all node again
vi /etc/pam.d/login
session required pam_limits.so
==================================================================
Create the required directory structure and give the proper permissions & ownership [All the Nodes]
Mkdir -p /u01/app/11.2.0/grid
chown -R grid:oinstall /u01/app/11.2.0/grid
mkdir -p /u01/app/oracle/product/11.2.0/dbhome_1
chown -R oracle:oinstall /u01/app/oracle/product/11.2.0/dbhome_1
chmod -R 777 /u01
================================================================
Configure the Shared Storage on [All Node]
[root@node1 ~]# chkconfig iscsi on
[root@node1 ~]# chkconfig iscsid on
[root@node1 ~]# service iscsi restart
Stopping iSCSI daemon:
iscsid dead but pid file exists [ OK ]
Starting iSCSI daemon: [ OK ]
[ OK ]
Setting up iSCSI targets: iscsiadm: No records found!
[ OK ]
[root@node1 ~]# service iscsid restart
Stopping iSCSI daemon:
Starting iSCSI daemon: [ OK ]
[ OK ]
[root@node1 ~]# chkconfig --list|grep iscsi
iscsi 0:off 1:off 2:on 3:on 4:on 5:on 6:off
iscsid 0:off 1:off 2:on 3:on 4:on 5:on 6:off
[root@node1 ~]#
=====================================================================
node communication to storage
[root@node2 ~]# iscsiadm -m discovery -t sendtargets -p 192.168.1.150
192.168.1.150:3260,1 iqn.2006-01.com.openfiler:tsn.san11g
[root@node2 ~]# iscsiadm -m node -T iqn.2006-01.com.openfiler:tsn.san11g -p 192.168.1.150 --login
Logging in to [iface: default, target: iqn.2006-01.com.openfiler:tsn.san11g, portal: 192.168.1.150,3260]
Login to [iface: default, target: iqn.2006-01.com.openfiler:tsn.san11g, portal: 192.168.1.150,3260]: successful
[root@node2 ~]# fdisk -l
Disk /dev/sda: 42.9 GB, 42949672960 bytes
255 heads, 63 sectors/track, 5221 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 1275 10241406 83 Linux
/dev/sda2 1276 3825 20482875 83 Linux
/dev/sda3 3826 4347 4192965 82 Linux swap / Solaris
/dev/sda4 4348 5221 7020405 5 Extended
/dev/sda5 4348 5221 7020373+ 83 Linux
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Disk /dev/sdb doesn't contain a valid partition table
[root@node2 ~]#
##################################################################################
Execute thsi command on all node
stop ntp as 11g has ctss
[root@node1 etc]# ls ntp*
ntp.conf
ntp:
keys ntpservers step-tickers
[root@node1 etc]# mv ntp.conf ntp.conf.bkp
[root@node1 etc]#
=========================================================================================
Create required partation on the openfilier volume
fdisk -l
m
n
e---extended
p---primary[1-4]
e (press enter)
paration number(1-4):1 (press enter)
First cyclinder(-----): (press Enter)
Last Cyclinder(------): (press Enter)
$p (press enter)
$n
$l-----------logical partation
First cyclinder()-----(print Enter)
Last cylinder(): +4g
$w -------------save
$q -------quite
$partprob -------------permanunt saving
[root@node1 ~]# fdisk /dev/sdb
Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel
Building a new DOS disklabel. Changes will remain in memory only,
until you decide to write them. After that, of course, the previous
content won't be recoverable.
The number of cylinders for this disk is set to 44384.
There is nothing wrong with that, but this is larger than 1024,
and could in certain setups cause problems with:
1) software that runs at boot time (e.g., old versions of LILO)
2) booting and partitioning software from other OSs
(e.g., DOS FDISK, OS/2 FDISK)
Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
Command (m for help): m
Command action
a toggle a bootable flag
b edit bsd disklabel
c toggle the dos compatibility flag
d delete a partition
l list known partition types
m print this menu
n add a new partition
o create a new empty DOS partition table
p print the partition table
q quit without saving changes
s create a new empty Sun disklabel
t change a partition's system id
u change display/entry units
v verify the partition table
w write table to disk and exit
x extra functionality (experts only)
Command (m for help): n
Command action
e extended
p primary partition (1-4)
e
Partition number (1-4): 1
First cylinder (1-44384, default 1):
Using default value 1
Last cylinder or +size or +sizeM or +sizeK (1-44384, default 44384):
Using default value 44384
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (1-44384, default 1):
Using default value 1
Last cylinder or +size or +sizeM or +sizeK (1-44384, default 44384): +4g
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (3817-44384, default 3817):
Using default value 3817
Last cylinder or +size or +sizeM or +sizeK (3817-44384, default 44384): +4g
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (7633-44384, default 7633):
Using default value 7633
Last cylinder or +size or +sizeM or +sizeK (7633-44384, default 44384): +4g
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (11449-44384, default 11449):
Using default value 11449
Last cylinder or +size or +sizeM or +sizeK (11449-44384, default 44384): +4g
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
/dev/sdb5 1 3816 3907552 83 Linux
/dev/sdb6 3817 7632 3907568 83 Linux
/dev/sdb7 7633 11448 3907568 83 Linux
/dev/sdb8 11449 15264 3907568 83 Linux
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (15265-44384, default 15265):
Using default value 15265
Last cylinder or +size or +sizeM or +sizeK (15265-44384, default 44384): +4g
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (19081-44384, default 19081):
Using default value 19081
Last cylinder or +size or +sizeM or +sizeK (19081-44384, default 44384): +4g
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
/dev/sdb5 1 3816 3907552 83 Linux
/dev/sdb6 3817 7632 3907568 83 Linux
/dev/sdb7 7633 11448 3907568 83 Linux
/dev/sdb8 11449 15264 3907568 83 Linux
/dev/sdb9 15265 19080 3907568 83 Linux
/dev/sdb10 19081 22896 3907568 83 Linux
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (22897-44384, default 22897):
Using default value 22897
Last cylinder or +size or +sizeM or +sizeK (22897-44384, default 44384): +4g
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
/dev/sdb5 1 3816 3907552 83 Linux
/dev/sdb6 3817 7632 3907568 83 Linux
/dev/sdb7 7633 11448 3907568 83 Linux
/dev/sdb8 11449 15264 3907568 83 Linux
/dev/sdb9 15265 19080 3907568 83 Linux
/dev/sdb10 19081 22896 3907568 83 Linux
/dev/sdb11 22897 26712 3907568 83 Linux
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (26713-44384, default 26713):
Using default value 26713
Last cylinder or +size or +sizeM or +sizeK (26713-44384, default 44384): +4g
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
/dev/sdb5 1 3816 3907552 83 Linux
/dev/sdb6 3817 7632 3907568 83 Linux
/dev/sdb7 7633 11448 3907568 83 Linux
/dev/sdb8 11449 15264 3907568 83 Linux
/dev/sdb9 15265 19080 3907568 83 Linux
/dev/sdb10 19081 22896 3907568 83 Linux
/dev/sdb11 22897 26712 3907568 83 Linux
/dev/sdb12 26713 30528 3907568 83 Linux
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (30529-44384, default 30529):
Using default value 30529
Last cylinder or +size or +sizeM or +sizeK (30529-44384, default 44384): +4g
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
/dev/sdb5 1 3816 3907552 83 Linux
/dev/sdb6 3817 7632 3907568 83 Linux
/dev/sdb7 7633 11448 3907568 83 Linux
/dev/sdb8 11449 15264 3907568 83 Linux
/dev/sdb9 15265 19080 3907568 83 Linux
/dev/sdb10 19081 22896 3907568 83 Linux
/dev/sdb11 22897 26712 3907568 83 Linux
/dev/sdb12 26713 30528 3907568 83 Linux
/dev/sdb13 30529 34344 3907568 83 Linux
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (34345-44384, default 34345):
Using default value 34345
Last cylinder or +size or +sizeM or +sizeK (34345-44384, default 44384): +4g
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
/dev/sdb5 1 3816 3907552 83 Linux
/dev/sdb6 3817 7632 3907568 83 Linux
/dev/sdb7 7633 11448 3907568 83 Linux
/dev/sdb8 11449 15264 3907568 83 Linux
/dev/sdb9 15265 19080 3907568 83 Linux
/dev/sdb10 19081 22896 3907568 83 Linux
/dev/sdb11 22897 26712 3907568 83 Linux
/dev/sdb12 26713 30528 3907568 83 Linux
/dev/sdb13 30529 34344 3907568 83 Linux
/dev/sdb14 34345 38160 3907568 83 Linux
Command (m for help): n
Command action
l logical (5 or over)
p primary partition (1-4)
l
First cylinder (38161-44384, default 38161):
Using default value 38161
Last cylinder or +size or +sizeM or +sizeK (38161-44384, default 44384):
Using default value 44384
Command (m for help): p
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
/dev/sdb5 1 3816 3907552 83 Linux
/dev/sdb6 3817 7632 3907568 83 Linux
/dev/sdb7 7633 11448 3907568 83 Linux
/dev/sdb8 11449 15264 3907568 83 Linux
/dev/sdb9 15265 19080 3907568 83 Linux
/dev/sdb10 19081 22896 3907568 83 Linux
/dev/sdb11 22897 26712 3907568 83 Linux
/dev/sdb12 26713 30528 3907568 83 Linux
/dev/sdb13 30529 34344 3907568 83 Linux
/dev/sdb14 34345 38160 3907568 83 Linux
/dev/sdb15 38161 44384 6373360 83 Linux
Command (m for help): partprob
Disk /dev/sdb: 46.5 GB, 46539997184 bytes
64 heads, 32 sectors/track, 44384 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 44384 45449200 5 Extended
/dev/sdb5 1 3816 3907552 83 Linux
/dev/sdb6 3817 7632 3907568 83 Linux
/dev/sdb7 7633 11448 3907568 83 Linux
/dev/sdb8 11449 15264 3907568 83 Linux
/dev/sdb9 15265 19080 3907568 83 Linux
/dev/sdb10 19081 22896 3907568 83 Linux
/dev/sdb11 22897 26712 3907568 83 Linux
/dev/sdb12 26713 30528 3907568 83 Linux
/dev/sdb13 30529 34344 3907568 83 Linux
/dev/sdb14 34345 38160 3907568 83 Linux
/dev/sdb15 38161 44384 6373360 83 Linux
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
Syncing disks.
[root@node1 ~]# partprob
bash: partprob: command not found
[root@node1 ~]# partprobe
Configure the ASM lib from root user on both node[node1,node2]
[root@node2 ~]# /etc/init.d/oracleasm status
Checking if ASM is loaded: no
Checking if /dev/oracleasm is mounted: no
[root@node2 ~]# /etc/init.d/oracleasm configure
Configuring the Oracle ASM library driver.
===============================================================================
[root@node1 ~]# /etc/init.d/oracleasm status
Checking if ASM is loaded: no
Checking if /dev/oracleasm is mounted: no
[root@node1 ~]# /etc/init.d/oracleasm configure
Configuring the Oracle ASM library driver.
This will configure the on-boot properties of the Oracle ASM library
driver. The following questions will determine whether the driver is
loaded on boot and what permissions it will have. The current values
will be shown in brackets ('[]'). Hitting <ENTER> without typing an
answer will keep that current value. Ctrl-C will abort.
Default user to own the driver interface []: grid
Default group to own the driver interface []: asmdba
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
Initializing the Oracle ASMLib driver: [ OK ]
Scanning the system for Oracle ASMLib disks: [ OK ]
[root@node1 ~]# clear
[root@node1 ~]#
[root@node1 ~]# /usr/sbin/oracleasm createdisk ocr_vd1 /dev/sdb5
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk ocr_vd2 /dev/sdb6
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk ocr_vd3 /dev/sdb7
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk data1 /dev/sdb8
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk data2 /dev/sdb9
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk data3 /dev/sdb10
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk data4 /dev/sdb11
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk data5 /dev/sdb12
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk data6 /dev/sdb13
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk data7 /dev/sdb14
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm createdisk data8 /dev/sdb15
Writing disk header: done
Instantiating disk: done
[root@node1 ~]# /usr/sbin/oracleasm listdisks
DATA1
DATA2
DATA3
DATA4
DATA5
DATA6
DATA7
DATA8
OCR_VD1
OCR_VD2
OCR_VD3
[root@node1 ~]# /usr/sbin/oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
[root@node1
This will configure the on-boot properties of the Oracle ASM library
driver. The following questions will determine whether the driver is
loaded on boot and what permissions it will have. The current values
will be shown in brackets ('[]'). Hitting <ENTER> without typing an
answer will keep that current value. Ctrl-C will abort.
Default user to own the driver interface []: grid
Default group to own the driver interface []: asmdba
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
Initializing the Oracle ASMLib driver: [ OK ]
Scanning the system for Oracle ASMLib disks: [ OK ]
[root@node2 ~]#
Grid Infrastructure Installation Step:
Installation Prerequisite
1) ./runcluvfy.sh stage -post hwos -n node1,node2 -verbose
2) ./runcluvfy.sh stage -pre crsinst -n node1,node2 -verbose
3) ./runcluvfy.sh comp ssa -n node1,node2 -verbose
GO to s/w location and
./runInstaller
Install & configuration for cluster
Advanced Installation
[]Deselect the GNS server
Enter the SCAN-IP
Add All the node of RAC
HOSTNAME= node2.uit.com
VIP= node2-vip.uit.com
Select SSH Connectivity
OS username=grid OSpassword= grid (password)
Step 4: Select Automatic storage management
Step5: Change Discovery Path
/dev/oracleasm /disck*
DIsk Group Name: OCR_VD
() NORMAL (select normal mirroring)
Select Required file to add into
step 7:
Comments
Post a Comment