Skip to Main Content
Forums

Database Software

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

why do we need to rebalance disks manually when we shutdown the storage

AnjumShehzadJun 21 2008 — edited Jul 25 2008
Dear all,

Here is my scenario.

We have extended RAC setup. Assuming everything is going fine and you have following status:
SQL> select MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,NAME,FAILGROUP,PATH from v$asm_disk;

MOUNT_S HEADER_STATU MODE_ST STATE NAME FAILGROUP PATH
------- ------------ ------- -------- ------------------------------ ------------------------------ ----------------------------------------
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote2
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote3
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote1
CACHED MEMBER ONLINE NORMAL DATADG_0003 DATAFG2 /dev/rdisk/asm_data1b
CACHED MEMBER ONLINE NORMAL FLASHDG_0001 FLASHFG2 /dev/rdisk/asm_arch1b
CACHED MEMBER ONLINE NORMAL FLASHDG_0000 FLASHFG1 /dev/rdisk/asm_arch1a
CACHED MEMBER ONLINE NORMAL DATADG_0000 DATAFG1 /dev/rdisk/asm_data1a

Now you shutdown one of the storages and have following status:

$ cd /u01/app/oracle/crs/log/hisdbs01/
$ ls
admin alerthisdbs01.log client crsd cssd evmd racg
$ tail -f alerthisdbs01.log
2008-06-14 17:00:05.710
[cssd(2757)]CRS-1604:CSSD voting file is offline: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.
2008-06-14 17:00:05.710
[cssd(2757)]CRS-1604:CSSD voting file is offline: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.
2008-06-14 17:01:05.720
[cssd(2757)]CRS-1604:CSSD voting file is offline: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.
2008-06-14 17:01:05.720
[cssd(2757)]CRS-1604:CSSD voting file is offline: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.
2008-06-14 17:02:09.241
[cssd(2757)]CRS-1605:CSSD voting file is online: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.
2008-06-14 18:14:37.660
[cssd(2757)]CRS-1604:CSSD voting file is offline: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.
2008-06-14 18:14:37.660
[cssd(2757)]CRS-1604:CSSD voting file is offline: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.

SQL> select MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,NAME,FAILGROUP,PATH from v$asm_disk;

MOUNT_S HEADER_STATU MODE_ST STATE NAME FAILGROUP PATH
------- ------------ ------- -------- ------------------------------ ------------------------------ ------------------------------
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote2
CLOSED UNKNOWN ONLINE NORMAL /dev/rdisk/asm_data1a
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote3
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote1
CACHED MEMBER ONLINE NORMAL DATADG_0003 DATAFG2 /dev/rdisk/asm_data1b
CACHED MEMBER ONLINE NORMAL FLASHDG_0001 FLASHFG2 /dev/rdisk/asm_arch1b
CACHED MEMBER ONLINE NORMAL FLASHDG_0000 FLASHFG1 /dev/rdisk/asm_arch1a
MISSING CANDIDATE OFFLINE FORCING DATADG_0000
8 rows selected.

sql> select MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,NAME,FAILGROUP,PATH from v$asm_disk;

MOUNT_S HEADER_STATU MODE_ST STATE NAME FAILGROUP PATH
------- ------------ ------- -------- ------------------------------ ------------------------------ ----------------------------------------
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote3
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote1
CLOSED UNKNOWN ONLINE NORMAL /dev/rdisk/asm_data1a
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote2
CACHED MEMBER ONLINE NORMAL FLASHDG_0000 FLASHFG1 /dev/rdisk/asm_arch1a
CACHED MEMBER ONLINE NORMAL DATADG_0003 DATAFG2 /dev/rdisk/asm_data1b
CACHED MEMBER ONLINE NORMAL FLASHDG_0001 FLASHFG2 /dev/rdisk/asm_arch1b
MISSING CANDIDATE OFFLINE HUNG DATADG_0000
8 rows selected.

After you have verified that the state is "HUNG", you startup the storage

========================
$ cd /u01/app/oracle/crs/log/hisdbs01/
$ ls
admin alerthisdbs01.log client crsd cssd evmd racg
$ tail -f alerthisdbs01.log

2008-06-14 18:29:37.810
[cssd(2757)]CRS-1604:CSSD voting file is offline: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.
2008-06-14 18:29:37.810
[cssd(2757)]CRS-1604:CSSD voting file is offline: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.
2008-06-14 18:30:41.241
[cssd(2757)]CRS-1605:CSSD voting file is online: /dev/rdisk/crs_vote1. Details in /u01/app/oracle/crs/log/hisdbs01/cssd/ocssd.log.

SQL> select MOUNT_STATUS,HEADER_STATUS,MODE_STATUS,STATE,NAME,FAILGROUP,PATH from v$asm_disk;

MOUNT_S HEADER_STATU MODE_ST STATE NAME FAILGROUP PATH
------- ------------ ------- -------- ------------------------------ ------------------------------ ------------------------------
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote2
CLOSED MEMBER ONLINE NORMAL /dev/rdisk/asm_data1a
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote3
CLOSED FOREIGN ONLINE NORMAL /dev/rdisk/crs_vote1
CACHED MEMBER ONLINE NORMAL DATADG_0003 DATAFG2 /dev/rdisk/asm_data1b
CACHED MEMBER ONLINE NORMAL FLASHDG_0001 FLASHFG2 /dev/rdisk/asm_arch1b
CACHED MEMBER ONLINE NORMAL FLASHDG_0000 FLASHFG1 /dev/rdisk/asm_arch1a
MISSING CANDIDATE OFFLINE HUNG DATADG_0000
8 rows selected.

Now my question is WHY do we need to rebalance the asm_data1a MANUALLY because as per above scenario it needs rebalancing. Should not ASM do rebalancing itself?

Suggest solutions please.

Thanks a lot. Waiting for your expert opinions.

br,
Anjum
Comments
Locked Post
New comments cannot be posted to this locked post.
Post Details
Locked on Aug 22 2008
Added on Jun 21 2008
#performance-availability, #rac-asm-clusterware-installation
2 comments
2,378 views