故障現象:
1、主庫日志報錯
Sun Nov 27 12:31:34 2011
Errors in file /home/oracle/admin/zjtv/bdump/zjtv1_arc0_803242.trc:
ORA-16055: FAL request rejected
ARCH: FAL archive failed. Archiver continuing
Sun Nov 27 12:31:34 2011
ORACLE Instance zjtv1 - Archival Error. Archiver continuing.
Sun Nov 27 12:36:34 2011
Errors in file /home/oracle/admin/zjtv/bdump/zjtv1_arc2_709010.trc:
ORA-00270: error creating archive log
Sun Nov 27 12:36:34 2011
FAL[server, ARC2]: FAL archive failed, see trace file.
2、從庫日志草錯,顯示歸檔文件沒有權限創建
Sun Nov 27 13:26:59 2011
Errors in file /home/oracle/admin/standby/udump/standby_rfs_450640.trc:
ORA-00270: error creating archive log /archivelog/arch_2_22493_614088933.arc
ORA-19504: failed to create file "/archivelog/arch_2_22493_614088933.arc"
ORA-27040: file create error, unable to create file
IBM AIX RISC System/6000 Error: 13: Permission denied
故障分析:
該從庫上周剛剛重新調整歸檔目錄/archivelog條帶化到hdisk0\hdisk1,
故障發生前從庫剛剛進行過重啟動作,重啟後就出現如上錯誤。
懷疑是沒有設置自動MOUNT,根據如下思路有如下具體排查經過:
1、首先查看目錄是否存在
P560A:/archivelog#df -g
Filesystem GB blocks Free %Used Iused %Iused Mounted on
/dev/hd4 2.00 0.56 73% 2135 2% /
/dev/hd2 4.00 1.66 59% 50260 12% /usr
/dev/hd9var 1.00 0.27 74% 3219 5% /var
/dev/hd3 10.00 5.62 44% 141687 10% /tmp
/dev/hd1 1.00 0.54 47% 865 1% /home
/proc - - - - - /proc
/dev/hd10opt 2.00 1.53 24% 7221 2% /opt
/dev/weblogiclv 10.00 9.47 6% 47 1% /weblogic
/dev/weblogic9lv 10.00 1.85 82% 93440 18% /weblogic9
/dev/tsmdb 7.50 2.92 62% 7918 2% /tsmdb
/dev/oraclelv 10.00 2.08 80% 27758 6% /home/oracle
/dev/oradata_lv 300.00 138.46 54% 94 1% /oradata
/dev/fslv00 150.00 26.45 83% 25 1% /backup
發現/archivelog未掛載
2、嘗試掛載,出現錯誤
P560A:/#mount /archivelog
mount: 0506-351 The log device and fs device must be in the same volume group.
顯然原因是日志設備和你要掛載的文件系統不在一個卷組裡
3、查看archive_lv在哪個VG上,結果是rootvg
P560A:/archivelog#lslv archive_lv
LOGICAL VOLUME: archive_lv VOLUME GROUP: rootvg
LV IDENTIFIER: 00c3ee9e00004c000000011c74979ab0.16 PERMISSION: read/write
VG STATE: active/complete LV STATE: opened/syncd
TYPE: jfs2 WRITE VERIFY: off
MAX LPs: 512 PP SIZE: 256 megabyte(s)
COPIES: 1 SCHED POLICY: striped
LPs: 400 PPs: 400
STALE PPs: 0 BB POLICY: relocatable
INTER-POLICY: maximum RELOCATABLE: no
INTRA-POLICY: middle UPPER BOUND: 2
MOUNT POINT: /archivelog LABEL: /archivelog
MIRROR WRITE CONSISTENCY: on/ACTIVE
EACH LP COPY ON A SEPARATE PV ?: yes (superstrict)
Serialize IO ?: NO
STRIPE WIDTH: 2
STRIPE SIZE: 128K
P560A:/archivelog#
4、查看rootvg的日志設備jfs2log在hd8上
P560A:/archivelog#lsvg -l rootvg
rootvg:
LV NAME TYPE LPs PPs PVs LV STATE MOUNT POINT
hd5 boot 1 2 2 closed/syncd N/A
hd6 paging 32 64 2 open/syncd N/A
hd8 jfs2log 1 2 2 open/syncd N/A
hd4 jfs2 8 16 2 open/syncd /
hd2 jfs2 16 32 2 open/syncd /usr
hd9var jfs2 4 8 2 open/syncd /var
hd3 jfs2 40 80 2 open/syncd /tmp
hd1 jfs2 4 8 2 open/syncd /home
hd10opt jfs2 8 16 2 open/syncd /opt
lg_dumplv sysdump 8 8 1 open/syncd N/A
fwdump jfs2 2 2 1 closed/syncd /var/adm/ras/platform
oraclelv jfs2 40 40 1 open/syncd /home/oracle
tsmdb jfs2 30 60 2 open/syncd /tsmdb
archive_lv jfs2 400 400 2 closed/syncd /archivelog
5、查看/etc/filesystems文件的/archivelog的LOG屬性在/dev/loglv00,而正常的應該是/dev/hd8
6、修改/archivelog的LOG屬性
vi /etc/filesystems
/oradata:
dev = /dev/oradata_lv
vfs = jfs2
log = /dev/loglv00
mount = true
options = rw
account = false
/archivelog:
dev = /dev/archive_lv
vfs = jfs2
log = /dev/loglv00 --> hd8
mount = true
options = rw
account = false
7、mount成功
mount /archivelog
8、P560A:/archivelog#df -g發現已經掛載
Filesystem GB blocks Free %Used Iused %Iused Mounted on
/dev/hd4 2.00 0.56 73% 2135 2% /
/dev/hd2 4.00 1.66 59% 50260 12% /usr
/dev/hd9var 1.00 0.27 74% 3219 5% /var
/dev/hd3 10.00 5.62 44% 141687 10% /tmp
/dev/hd1 1.00 0.54 47% 865 1% /home
/proc - - - - - /proc
/dev/hd10opt 2.00 1.53 24% 7221 2% /opt
/dev/weblogiclv 10.00 9.47 6% 47 1% /weblogic
/dev/weblogic9lv 10.00 1.85 82% 93440 18% /weblogic9
/dev/tsmdb 7.50 2.92 62% 7918 2% /tsmdb
/dev/oraclelv 10.00 2.08 80% 27758 6% /home/oracle
/dev/oradata_lv 300.00 138.46 54% 94 1% /oradata
/dev/fslv00 150.00 26.45 83% 25 1% /backup
/dev/archive_lv 100.00 80.91 20% 59 1% /archivelog
本文出自 “麥地塢” 博客,請務必保留此出處http://yunlongzheng.blog.51cto.com/788996/727219