Trucluster 安裝手冊
一、 安裝前准備(兩台機分別做)
* 安裝公共盤櫃，>>> show dev 時，公共盤櫃的盤正常
* 在控台下，設置以下參數：
>>> set bus_probe_algorithem new
>>> set boot_reset on
>>> set pkb0_host_id 6 (其中 一台pkb0_host_id為6,另一台
pkb0_host_id為7).
l 配置網絡：在/etc/hosts中加入對方的主機名及地址、公共主機名及地址。加入本機及對方主機的memory channel 名及地址。
* lmfsetup 增加 Trucluster 許可證
* 做時間同步：
（1） 時間同步NTP 配置
# ntpsetup (兩台機均要做)
[ Press the RETURN key to continue ] :
Default answers are shown in square brackets ([]). To use a default
answer, press RETURN.
Would you like to enable authentication (y/n) [n]? n
NTP Server/Peer Selection
-------------------------
During the selection of servers and peers, you will be asked
for a hostname, and for the mode, server or peer, to be
associated to each hostname.
Press RETURN to terminate the list.
Hostname of NTP server/peer [no default]: 對方主機名
Mode for sgcrj1 (server or peer) (s/p) [s]? S
Looking up host gzeacdatasvr1 ... found.
Is sgcrj1 running ntpd (V1) or xntpd (V2 or V3) (V1/V2/V3) [V3]? V3
Hostname of NTP server/peer [no default]: 回車
The list of NTP servers is:
server gzeacdatasvr1 version 3
Enter "r" to REDO the servers list, "e" to EXIT the ntpsetup
procedure, or "c" to CONTINUE [no default]: C
[ Press RETURN to continue ] :
Xntpd (the NTP daemon) Options
Would you like to use the -g option (y/n) [y]? y
Would you like to use the -x option (y/n) [n]? N
Configuring your system to run NTP... done.
Starting the NTP daemon (xntpd)...
Setting kernel timezone variable
Setting the current time and date with ntpdate
Ntpdate failed.
Network Time Service started
To monitor NTP, enter "/usr/bin/ntpq -p".
****** NTPSETUP Complete ******
2）在其中一台主機上做時間同步，另一台主機不用做：
# ntp –s –f 對方主機名
# crontab –e
最後加入：00 06 * * * ntp -s -f 對方主機名
二、 安裝Trucluster軟件，兩台主機分別作：
（1）安裝軟件：
# mount -r /dev/rz5c /mnt
# setld -l /mnt/TruCluster/kit
.
- TruCluster(TM) Software:
1) TruCluster Cluster Monitor
2) TruCluster Reference Pages
3) ALL mandatory and all optional subsets
4) MANDATORY subsets only
5) CANCEL selections and redisplay menus
6) EXIT without installing any subsets
Enter your choices or press RETURN to redisplay menus.
Choices (for example, 1 2 4-6): 3
Enter the IP name for the cluster interconnect: mccrj1 （memory channel 名）
You chose "mccrj1," IP 10.0.0.1 using interface mc0
Is this correct? [y]: y
Will the system be in an ASE? [y]: y
Enter the ASE_ID number [0]: 0
Do you want to run the ASE logger on this node? [n]: y
Choose an installation procedure:
TruCluster Production Server (ASE) Installation Menu
f) Setting up an ASE for the first time
r) Performing a rolling upgrade
s) Performing a simultaneous upgrade
e) Adding to an ASE with a V1.6 operating version
p) Adding to an ASE with a V1.5 operating version
Enter your choice [f]: f
Initializing a new ASE V1.6 database ...
The kernel will now be configured using "doconfig".
Enter the name of the kernel configuration file. [SGCRJ]:
*** KERNEL CONFIGURATION AND BUILD PROCEDURE ***
Saving /sys/conf/SGCRJ as /sys/conf/SGCRJ.bck
Do you want to edit the configuration file? (y/n) [n]: n
*** PERFORMING KERNEL BUILD ***
The ASE I/O Bus Renumbering Tool has been invoked.
Select the controllers that define the shared ASE I/O buses.
Name Controller Slot Bus Slot
scsi0 itpsa0 0 pci2001 0
scsi1 itpsa1 0 pci2001 1
2) scsi2 isp0 0 pci1 8
scsi3 ata0 0 pci0 105
scsi4 ata1 0 pci0 205
q) Quit without making changes
Enter your choices (comma or space separated): q （各成員的SCSI號要一致，不同時建議往大的數值改）
Quit without making changes
Is the above choice correct (y|n)? [y]: y
Working....Tue Jan 11 09:44:17 CST 2000
The new kernel is /sys/SGCRJ/vmunix
The kernel build was successful. Please perform the following actions:
o Move the new kernel to /.
o Before rebooting make sure that the cluster interconnect IP
addresses for all cluster members are recorded in each member's
/etc/hosts file.
o Reboot the system.
# mv /vmunix /vmunix.noTru0
# mv /sys/SGCRJ1/vmunix
# reboot
(2) 打patch
# init s
# bcheckrc
# cd /usr/patch/patch_kit
# ./dupatch
# doconfig
# mv 新核心 /vmunix
# reboot
注：若已打了系統補丁，則只選擇打Trucluster 補丁。否則兩種補丁一起打。
三 、兩台機都reboot後， 配置Trucluster：
（1）初始化環境，兩台機同時作：
# asesetup
Stopping the TruCluster ASE member ...
Shutting down the ASE agent (/usr/sbin/aseagent)
Shutting down the ASE logger (/usr/sbin/aselogger)
Deinitializing the ASE Availability Manager
TruCluster ASE member stopped ...
Choose how to initialize this ASE member:
e) Run in an ASE with a V1.6 operating version
p) Run in an ASE with a V1.5 operating version
Enter your choice: e
Please confirm that there are only TruCluster Production Server V1.6
members in the ASE and that the V1.6 features have been enabled with
the asemgr. (y/n): y
Initializing a new ASE V1.6 database ...
Starting the TruCluster ASE member ...
Initializing the ASE Availability Manager
ASE logger started (/usr/sbin/aselogger)
ASE agent started (/usr/sbin/aseagent)
TruCluster ASE member started
（2）配置Trucluster 成員：
# asemgr
Enter a comma-separated list of member systems's interfaces on the cluster
interconnect within ASE 0.
Enter Members: mccrj1,mccrj2 （為memorry chanel 卡名）
Member List: mccrj1,mccrj2
Is this correct? (y/n) [y]: y
TruCluster Production Server (ASE)
ASE Main Menu
a) Managing the ASE
m) Managing ASE Services
s) Obtaining ASE Status
x) Exit
Enter your choice: x
（3）設置Tia-breaking 盤：
# cnxset -d /dev/rrz16c
Verifying: /dev/rrz16c
/dev/rrz16c is unknown to the local ASE
Performing further checks on this device...
/dev/rrz16c is a disk
/dev/rrz16c will be configured anyway
/dev/rrz16c is an acceptable device
Local configuration updated...You must also update all other nodes
（4）檢查Trucluster 成員狀態：
# cnxshow
Cluster View from mccrj1
Director: mccrj2 Suspended: No
Node monitor using tie-breaking disk: /dev/rrz16c
Hostname Cluster I/F CS_ID Incarnation Comm Okay Member
---------------------------------------------------------------------------------------------------------
sgcrj mccrj1 0001,0002 00000000000d6e9a Yes Yes
sgcrj1 mccrj2 0001,0001 0000000000028a0f Yes Yes
（5）增加Trucluster 服務：
# asemgr
TruCluster Production Server (ASE)
ASE Main Menu
a) Managing the ASE
m) Managing ASE Services
s) Obtaining ASE Status
x) Exit
Enter your choice: m
Managing ASE Services
c) Service Configuration
r) Relocate a service
on) Set a service on line
off) Set a service off line
res) Restart a service
s) Display the status of a service
a) Advanced Utilities
q) Quit (back to the Main Menu)
x) Exit
Enter your choice [q]: c
Service Configuration
a) Add a new service
m) Modify a service
o) Modify a service without interrupting its availability
d) Delete a service
s) Display the status of a service
c) Display the configuration of a service
q) Quit (back to Managing ASE Services)
x) Exit
Enter your choice [q]: a
Adding a service
Select the type of service:
1) NFS service
2) Disk service
3) User-defined service
4) DRD service
5) Tape service
q) Quit without adding a service
x) Exit
Enter your choice [1]: 4
You are now adding a new DRD disk service to your ASE.
A DRD disk service is comprised of any number of DRDs which can be
created from a single raw disk partition or LSM volume which will
be accessible from all members in the cluster.
Note: If using a raw disk partition please be sure that the character
device special file exists on all members which are in this ASE.
DRD Service Name
The name of a DRD disk service must be a unique service name within this ASE.
Enter the DRD disk service name ('q' to quit): crj_ora805
You will now be prompted to enter a list of devices comprising
the DRD service, enter Return when you have completed the list.
Enter an existing character device special file for one of the following:
a physical device (ie /dev/rrz1c)
a LSM volume (ie /dev/rvol/dg/vol01)
To end the list, press the Return key at the prompt.
Enter character device special file: /dev/rvol/crj/cotr1
Following is a list of device(s) and pubpath(s) for disk group crj:
DEVICE PUBPATH
rz16c /dev/rz16c
Is this correct (y/n) [y]: y
將所有oracle所用的分區加入：/dev/rvol/crj/cotr1，/dev/rvol/crj/cotr2，/dev/rvol/crj/cotr3，/dev/rvol/crj/redo101，/dev/rvol/crj/redo102，
/dev/rvol/crj/redo103，/dev/rvol/crj/redo201，/dev/rvol/crj/redo202，
/dev/rvol/crj/redo203，/dev/rvol/crj/system，/dev/rvol/crj/rbs, /dev/rvol/crj/temp
/dev/rvol/crj/tools, /dev/rvol/crj/users, /dev/rvol/crj/crj_rbs, /dev/rvol/crj/crj_tmp,
/dev/rvol/crj/crj_data
Selecting an Autogmalic service Placement(ASP) policy
b) Balanced Service Distribution
f) favor Members
r)Restrict to Favord members
Enter you choice : b
Do you want Ase toconsider relocationg this service to another member if one becomes available while this service is running (y/n?) n
Enter “y” to add Service ‘oracle8’ (y/n): y
Adding service …
Starting service …
Service oracle8 successfully added …
四、對DRD盤授權：（兩台機分別做）
#chown -R oracle8:dba /dev/rdrd
