尝试删除ACFS文件系统是碰到了错误。
首先尝试UMOUNT文件系统:
[oracle@xsh-server1 ~]$ df -k
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/VolGroup00-LogVol00 435653856 192338280 220828536 47% /
/dev/sda1 101086 16919 78948 18% /boot
tmpfs 65968984 195784 65773200 1% /dev/shm
/dev/asm/acfsdgvol1-57 624951296 165746644 459204652 27% /backup
[root@xsh-server1 ~]# umount -t acfs /backup
在节点2上执行同样的UMOUNT操作:
[root@xsh-server2 asm]# umount -t acfs /backup/
在节点1上取消acfs的注册信息:
[root@xsh-server1 ~]# acfsutil registry -m /dev/asm/acfsdgvol1-57
/backup
[root@xsh-server1 ~]# acfsutil registry -d /dev/asm/acfsdgvol1-57
acfsutil registry: successfully removed ACFS volume /dev/asm/acfsdgvol1-57 from Oracle Registry
但是随后删除acfs文件系统的时候出现了错误:
[root@xsh-server1 ~]# acfsutil rmfs /dev/asm/acfsdgvol1-57
acfsutil rmfs: ACFS-00511: /dev/asm/acfsdgvol1-57 is mounted on at least one node of the cluster.
acfsutil rmfs: ACFS-03014: file system not removed
由于文件系统无法删除,是的VOLUME同样无法删除:
[root@xsh-server1 ~]# su - grid
[grid@xsh-server1 ~]$ sqlplus / as sysasm
SQL*Plus: Release 11.2.0.2.0 Production on Thu Aug 11 11:15:02 2011
Copyright (c) 1982, 2010, Oracle. All rights reserved.Connected to:Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
SQL> SELECT GROUP_NUMBER, VOLUME_NAME, SIZE_MB, STATE, USAGE, VOLUME_DEVICE, MOUNTPATH
2 FROM V$ASM_VOLUME;
GROUP_NUMBER VOLUME_NAME SIZE_MB STATE USAGE VOLUME_DEVICE MOUNTPATH
------------ ----------- ------- ------- ----- ---------------------- ----------
4 ACFSDGVOL1 610304 ENABLED ACFS /dev/asm/acfsdgvol1-57 /backup
SQL> SELECT GROUP_NUMBER, NAME FROM V$ASM_DISKGROUP WHERE GROUP_NUMBER = 4;
GROUP_NUMBER NAME
------------ ------------------------------
4 ACFSDG
SQL> ALTER DISKGROUP ACFSDG DISABLE VOLUME ACFSDGVOL1;
ALTER DISKGROUP ACFSDG DISABLE VOLUME ACFSDGVOL1
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15468: volume 'ACFSDGVOL1' in diskgroup 'ACFSDG' is currently being accessed
尝试在ASMCMD中操作,同样无法删除VOLUME:
[grid@xsh-server1 ~]$ asmcmd
ASMCMD> volinfo -a
Diskgroup Name: ACFSDG
Volume Name: ACFSDGVOL1
Volume Device: /dev/asm/acfsdgvol1-57
State: ENABLED
Size (MB): 610304
Resize Unit (MB): 256
Redundancy: UNPROT
Stripe Columns: 4
Stripe Width (K): 128
Usage: ACFS
Mountpath: /backup
ASMCMD> voldelete -G ACFSDG ACFSDGVOL1
ORA-15032: not all alterations performed
ORA-15468: volume 'ACFSDGVOL1' in diskgroup 'ACFSDG' is currently being accessed (DBD ERROR: OCIStmtExecute)
ASMCMD> voldisable -a
ORA-15032: not all alterations performed
ORA-15468: volume 'ACFSDGVOL1' in diskgroup 'ACFSDG' is currently being accessed (DBD ERROR: OCIStmtExecute)
ASMCMD> quit
[grid@xsh-server1 ~]$ exit
尝试各种方法,都无法以常规的方法删除ACFS文件系统和ASM中创建的VOLUME,没有办法,最终只是使用强制的方法来删除:
[grid@xsh-server1 ~]$ id
uid=1300(grid) gid=1000(oinstall) groups=1000(oinstall),1200(dba) context=user_u:system_r:unconfined_t
[grid@xsh-server1 ~]$ sqlplus / as sysasm
SQL*Plus: Release 11.2.0.2.0 Production on Thu Aug 11 12:59:35 2011
Copyright (c) 1982, 2010, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
SQL> set pages 100 lines 120
SQL> SELECT GROUP_NUMBER, NAME FROM V$ASM_DISKGROUP;
GROUP_NUMBER NAME
------------ ------------------------------
1 CRSDG
2 DATADG
3 FRADG
4 ACFSDG
SQL> DROP DISKGROUP ACFSDG;
DROP DISKGROUP ACFSDG
*
ERROR at line 1:
ORA-15039: diskgroup not dropped
ORA-15053: diskgroup "ACFSDG" contains existing files
SQL> DROP DISKGROUP ACFSDG INCLUDING CONTENTS;
DROP DISKGROUP ACFSDG INCLUDING CONTENTS
*
ERROR at line 1:
ORA-15039: diskgroup not dropped
ORA-15027: active use of diskgroup "ACFSDG" precludes its dismount
SQL> DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS;
DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS
*
ERROR at line 1:
ORA-15039: diskgroup not dropped
ORA-15230: diskgroup 'ACFSDG' does not require the FORCE option
SQL> ALTER DISKGROUP ACFSDG DISMOUNT;
ALTER DISKGROUP ACFSDG DISMOUNT
*
ERROR at line 1:
ORA-15032: not all alterations performed
ORA-15027: active use of diskgroup "ACFSDG" precludes its dismount
SQL> ALTER DISKGROUP ACFSDG DISMOUNT FORCE;
Diskgroup altered.
SQL> DROP DISKGROUP ACFSDG;
DROP DISKGROUP ACFSDG
*
ERROR at line 1:
ORA-15039: diskgroup not dropped
ORA-15001: diskgroup "ACFSDG" does not exist or is not mounted
SQL> DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS;
DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS
*
ERROR at line 1:
ORA-15039: diskgroup not dropped
ORA-15073: diskgroup ACFSDG is mounted by another ASM instance
利用DISMOUNT FORCE的选项,终于将磁盘组ACFSDG卸载,由于另外的ASM实例还加载这个磁盘组,因此这个磁盘组暂时还不能删除。
登录另外的实例,执行DISMOUNT操作:
[root@xsh-server2 dev]# su - grid
[grid@xsh-server2 ~]$ sqlplus / as sysasm
SQL*Plus: Release 11.2.0.2.0 Production on Thu Aug 11 13:11:55 2011
Copyright (c) 1982, 2010, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
SQL> set pages 100 lines 120
SQL> select group_number, name, state from v$asm_diskgroup;
GROUP_NUMBER NAME STATE
------------ ------------------------------ -----------
1 CRSDG MOUNTED
2 DATADG MOUNTED
3 FRADG MOUNTED
4 ACFSDG MOUNTED
SQL> alter diskgroup acfsdg dismount;
Diskgroup altered.
下面会到第一个节点,再次执行删除操作:
SQL> DROP DISKGROUP ACFSDG;
DROP DISKGROUP ACFSDG
*
ERROR at line 1:
ORA-15039: diskgroup not dropped
ORA-15001: diskgroup "ACFSDG" does not exist or is not mounted
SQL> DROP DISKGROUP ACFSDG FORCE INCLUDING CONTENTS;
Diskgroup dropped.
SQL> SELECT GROUP_NUMBER, NAME FROM V$ASM_DISKGROUP;
GROUP_NUMBER NAME
------------ ------------------------------
1 CRSDG
2 DATADG
3 FRADG
SQL> EXIT
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@xsh-server1 ~]$ df -k
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/mapper/VolGroup00-LogVol00 435653856 192353508 220813308 47% /
/dev/sda1 101086 16919 78948 18% /boot
tmpfs 65968984 195784 65773200 1% /dev/shm
最后利用ORACLEASM删除对应的设备:
[grid@xsh-server1 ~]$ su -
Password:
[root@xsh-server1 ~]# oracleasm listdisks
VOL1
VOL2
VOL3
VOLACFS
[root@xsh-server1 ~]# oracleasm deletedisk VOLACFS
Clearing disk header: done
Dropping disk: done
在另外的节点执行检查ASM磁盘组和ORACLEASM设备,确认节点1上的操作在两个节点上都已经生效:
SQL> select group_number, name, state from v$asm_diskgroup;
GROUP_NUMBER NAME STATE
------------ ------------------------------ -----------
1 CRSDG MOUNTED
2 DATADG MOUNTED
3 FRADG MOUNTED
SQL> EXIT
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
[grid@xsh-server2 ~]$ exit
logout
[root@xsh-server2 dev]# oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Cleaning disk "VOLACFS"
Scanning system for ASM disks...
[root@xsh-server2 dev]# oracleasm listdisks
VOL1
VOL2
VOL3
虽然最终通过强制的方式删除了ACFS文件系统和对应的磁盘组,但是这种强制的方式很可能在操作系统级别上还留下一下没有清除的信息。
显然ACFS这项新技术还存在很多的bug,而且在处理这个问题时也发现,即使是在metalink上,关于ACFS的信息也非常少,虽然存在一个和当前几乎完全一样的问题,但是并没有下文,Oracle也没有给出任何解决的方法。
如果打算在产品环境中使用ACFS,还是要经过大量的测试才行。
该贴被蜀山战纪编辑于2015-12-3 15:55:54