Skip to Main Content

Infrastructure Software

Announcement

For appeals, questions and feedback about Oracle Forums, please email oracle-forums-moderators_us@oracle.com. Technical questions should be asked in the appropriate category. Thank you!

ovm 3.3.1 lun issue

JackDethFeb 10 2015 — edited Feb 11 2015

ok needing some help with an issue, i'm not sure what to do about..

have two hosts with dozen or so vm's running on

san storage already working with both hosts, with multipath.

added a new lun 500gb, can't get it added to host 2.

details of new lun:

pr-al-ovm02 LUN 205

205

Ready

RAID5

VP 02

  1. 500.000

SP A

PR-AL-LPSOVM2

60:06:01:60:7E:A0:21:00:9A:44:A9:12:CA:AA:E4:11

hosting server has been rebooted.

here are the commands i have tried so far:

[root@pr-al-ulpsovm2 scsi]# df -h

Filesystem                                     Size  Used Avail Use% Mounted on

/dev/sda2                                       50G  1.5G   46G   4% /

tmpfs                                          994M     0  994M   0% /dev/shm

/dev/sda1                                      477M   47M  401M  11% /boot

none                                           994M  176K  994M   1% /var/lib/xenstored

/dev/mapper/3600601607ea021009c41f0912643e411  100G  266M  100G   1% /poolfsmnt/0004fb0000050000539444abd803cf41

/dev/mapper/36003005701a64e701bad80050cb9fc6e  1.7T  1.2T  545G  68% /OVS/Repositories/0004fb00000300003890c07711bdd825

/dev/mapper/3600601607ea02100001dfe442643e411  1.4T  1.1T  292G  80% /OVS/Repositories/0004fb00000300001f53ffd22448ae55

------------------------------------------

[root@pr-al-ulpsovm2 scsi]# fdisk -l 2>/dev/null | egrep '^Disk' | egrep -v 'dm-' | wc -l

20

-----------------------------------------------------------------------------------------

echo "1" > /sys/class/fc_host/host1/issue_lip

echo "- - -" > /sys/class/scsi_host/host1/scan

echo "1" > /sys/class/fc_host/host2/issue_lip

echo "- - -" > /sys/class/scsi_host/host2/scan

----------------------------------------------------------------------------

[root@pr-al-ulpsovm2 scsi]# cat /proc/scsi/scsi | egrep -i 'Host:' | wc -l

35

----------------------------------------------------------

[root@pr-al-ulpsovm2 scsi]# /usr/bin/rescan-scsi-bus.sh -l -w

Host adapter 0 (megaraid_sas) found.

Host adapter 1 (lpfc) found.

Host adapter 2 (lpfc) found.

Host adapter 3 (ahci) found.

Host adapter 4 (ahci) found.

Host adapter 5 (ahci) found.

Host adapter 6 (ahci) found.

Host adapter 7 (ahci) found.

Host adapter 8 (ahci) found.

Scanning SCSI subsystem for new devices

Scanning host 0 for  SCSI target IDs  0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15, LUNs  0 1 2 3 4 5 6 7

Scanning for device 0 2 0 0 ...

OLD: Host: scsi0 Channel: 02 Id: 00 Lun: 00

      Vendor: LSI      Model: RAID 5/6 SAS 6G  Rev: 2.13

      Type:   Direct-Access                    ANSI SCSI revision: 05

Scanning for device 0 2 1 0 ...

OLD: Host: scsi0 Channel: 02 Id: 01 Lun: 00

      Vendor: LSI      Model: RAID 5/6 SAS 6G  Rev: 2.13

      Type:   Direct-Access                    ANSI SCSI revision: 05

Scanning host 1 for  all SCSI target IDs, LUNs  0 1 2 3 4 5 6 7

Scanning for device 1 0 0 0 ...

OLD: Host: scsi1 Channel: 00 Id: 00 Lun: 00

      Vendor: DGC      Model: LUNZ             Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 0 1 ...

OLD: Host: scsi1 Channel: 00 Id: 00 Lun: 01

      Vendor: DGC      Model: VRAID            Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 0 2 ...

OLD: Host: scsi1 Channel: 00 Id: 00 Lun: 02

      Vendor: DGC      Model: VRAID            Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 0 3 ...

OLD: Host: scsi1 Channel: 00 Id: 00 Lun: 03

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 0 4 ...

OLD: Host: scsi1 Channel: 00 Id: 00 Lun: 04

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 0 5 ...

OLD: Host: scsi1 Channel: 00 Id: 00 Lun: 05

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 0 6 ...

OLD: Host: scsi1 Channel: 00 Id: 00 Lun: 06

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 0 7 ...

OLD: Host: scsi1 Channel: 00 Id: 00 Lun: 07

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 1 0 ...

OLD: Host: scsi1 Channel: 00 Id: 01 Lun: 00

      Vendor: DGC      Model: LUNZ             Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 1 1 ...

OLD: Host: scsi1 Channel: 00 Id: 01 Lun: 01

      Vendor: DGC      Model: VRAID            Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 1 2 ...

OLD: Host: scsi1 Channel: 00 Id: 01 Lun: 02

      Vendor: DGC      Model: VRAID            Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 1 3 ...

OLD: Host: scsi1 Channel: 00 Id: 01 Lun: 03

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 1 4 ...

OLD: Host: scsi1 Channel: 00 Id: 01 Lun: 04

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 1 5 ...

OLD: Host: scsi1 Channel: 00 Id: 01 Lun: 05

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 1 6 ...

OLD: Host: scsi1 Channel: 00 Id: 01 Lun: 06

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 1 0 1 7 ...

OLD: Host: scsi1 Channel: 00 Id: 01 Lun: 07

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning host 2 for  all SCSI target IDs, LUNs  0 1 2 3 4 5 6 7

Scanning for device 2 0 0 0 ...

OLD: Host: scsi2 Channel: 00 Id: 00 Lun: 00

      Vendor: DGC      Model: LUNZ             Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 0 1 ...

OLD: Host: scsi2 Channel: 00 Id: 00 Lun: 01

      Vendor: DGC      Model: VRAID            Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 0 2 ...

OLD: Host: scsi2 Channel: 00 Id: 00 Lun: 02

      Vendor: DGC      Model: VRAID            Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 0 3 ...

OLD: Host: scsi2 Channel: 00 Id: 00 Lun: 03

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 0 4 ...

OLD: Host: scsi2 Channel: 00 Id: 00 Lun: 04

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 0 5 ...

OLD: Host: scsi2 Channel: 00 Id: 00 Lun: 05

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 0 6 ...

OLD: Host: scsi2 Channel: 00 Id: 00 Lun: 06

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 0 7 ...

OLD: Host: scsi2 Channel: 00 Id: 00 Lun: 07

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 1 0 ...

OLD: Host: scsi2 Channel: 00 Id: 01 Lun: 00

      Vendor: DGC      Model: LUNZ             Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 1 1 ...

OLD: Host: scsi2 Channel: 00 Id: 01 Lun: 01

      Vendor: DGC      Model: VRAID            Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 1 2 ...

OLD: Host: scsi2 Channel: 00 Id: 01 Lun: 02

      Vendor: DGC      Model: VRAID            Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 1 3 ...

OLD: Host: scsi2 Channel: 00 Id: 01 Lun: 03

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 1 4 ...

OLD: Host: scsi2 Channel: 00 Id: 01 Lun: 04

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 1 5 ...

OLD: Host: scsi2 Channel: 00 Id: 01 Lun: 05

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 1 6 ...

OLD: Host: scsi2 Channel: 00 Id: 01 Lun: 06

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning for device 2 0 1 7 ...

OLD: Host: scsi2 Channel: 00 Id: 01 Lun: 07

      Vendor: DGC      Model:                  Rev: 0430

      Type:   Direct-Access                    ANSI SCSI revision: 04

Scanning host 3 channels  0 for  SCSI target IDs  0 1, LUNs  0 1 2 3 4 5 6 7

Scanning host 4 channels  0 for  SCSI target IDs  0 1, LUNs  0 1 2 3 4 5 6 7

Scanning for device 4 0 0 0 ...

OLD: Host: scsi4 Channel: 00 Id: 00 Lun: 00

      Vendor: HL-DT-ST Model: DVDRAM GT80N     Rev: SF03

      Type:   CD-ROM                           ANSI SCSI revision: 05

Scanning host 5 channels  0 for  SCSI target IDs  0 1, LUNs  0 1 2 3 4 5 6 7

Scanning host 6 channels  0 for  SCSI target IDs  0 1, LUNs  0 1 2 3 4 5 6 7

Scanning host 7 channels  0 for  SCSI target IDs  0 1, LUNs  0 1 2 3 4 5 6 7

Scanning host 8 channels  0 for  SCSI target IDs  0 1, LUNs  0 1 2 3 4 5 6 7

0 new device(s) found.

0 device(s) removed.

--------------------------------------------------------------------

[root@pr-al-ulpsovm2 scsi]# /sbin/service multipathd status

multipathd (pid  1880) is running...

----------------------------------------------------------------------

ls /sys/class/scsi_host/

host0  host1  host2  host3  host4  host5  host6  host7  host8

-----------------------------------------------------------------------------------------

[root@pr-al-ulpsovm2 scsi]# ls /sys/class/fc_host

host1  host2

------------------------------------------------------------------------------------------

dmesg:

bottom part:

sd 1:0:1:1: emc: at SP B Port 6 (owned, default SP B)

sd 2:0:1:1: emc: ALUA failover mode detected

sd 2:0:1:1: emc: at SP B Port 7 (owned, default SP B)

sd 1:0:0:2: emc: ALUA failover mode detected

sd 1:0:0:2: emc: at SP A Port 6 (owned, default SP A)

sd 2:0:0:2: emc: ALUA failover mode detected

sd 2:0:0:2: emc: at SP A Port 7 (owned, default SP A)

lpfc 0000:02:00.0: 0:1305 Link Down Event xa received Data: xa x20 x110 x0 x0

lpfc 0000:02:00.0: 0:1303 Link Up Event xb received Data: xb x0 x20 x0 x0 x0 0

lpfc 0000:83:00.0: 1:1305 Link Down Event xe received Data: xe x20 x110 x0 x0

lpfc 0000:83:00.0: 1:1303 Link Up Event xf received Data: xf x0 x20 x0 x0 x0 0

scsi 0:0:4:0: Direct-Access     SEAGATE  ST3600057SS      1703 PQ: 0 ANSI: 5

scsi 0:0:5:0: Direct-Access     SEAGATE  ST3600057SS      1703 PQ: 0 ANSI: 5

scsi 0:0:6:0: Direct-Access     SEAGATE  ST3600057SS      1703 PQ: 0 ANSI: 5

scsi 0:0:7:0: Direct-Access     SEAGATE  ST3600057SS      1703 PQ: 0 ANSI: 5

scsi 0:0:8:0: Direct-Access     SEAGATE  ST3600057SS      1703 PQ: 0 ANSI: 5

scsi 0:0:9:0: Direct-Access     SEAGATE  ST3600057SS      1703 PQ: 0 ANSI: 5

ata1: hard resetting link

ata1: SATA link down (SStatus 0 SControl 300)

ata1: EH complete

ata2: hard resetting link

ata2: SATA link up 1.5 Gbps (SStatus 113 SControl 300)

ata2.00: configured for UDMA/133

ata2: EH complete

sd 1:0:1:1: emc: ALUA failover mode detected

sd 1:0:1:1: emc: at SP B Port 6 (owned, default SP B)

sd 2:0:1:1: emc: ALUA failover mode detected

sd 2:0:1:1: emc: at SP B Port 7 (owned, default SP B)

sd 1:0:0:2: emc: ALUA failover mode detected

sd 1:0:0:2: emc: at SP A Port 6 (owned, default SP A)

sd 2:0:0:2: emc: ALUA failover mode detected

sd 2:0:0:2: emc: at SP A Port 7 (owned, default SP A)

rport-1:0-9: blocked FC remote port time out: removing rport

rport-2:0-10: blocked FC remote port time out: removing rport

ata1: hard resetting link

ata1: SATA link down (SStatus 0 SControl 300)

ata1: EH complete

lpfc 0000:02:00.0: 0:1305 Link Down Event xc received Data: xc x20 x110 x0 x0

lpfc 0000:02:00.0: 0:1303 Link Up Event xd received Data: xd x0 x20 x0 x0 x0 0

lpfc 0000:83:00.0: 1:1305 Link Down Event x10 received Data: x10 x20 x110 x0 x0

lpfc 0000:83:00.0: 1:1303 Link Up Event x11 received Data: x11 x0 x20 x0 x0 x0 0

rport-1:0-10: blocked FC remote port time out: removing rport

rport-2:0-11: blocked FC remote port time out: removing rport

ata1: hard resetting link

ata1: SATA link down (SStatus 0 SControl 300)

ata1: EH complete

-----------------------------------------------------------------------------------------------------------------------

more /etc/multipath.conf:

#blacklist {

#       wwid 26353900f02796769

#       devnode "^(ram|raw|loop|fd|md|dm-|sr|scd|st)[0-9]*"

#       devnode "^hd[a-z]"

#       devnode "^sd[ab]"

#}

#multipaths {

---------------------------------------------------------------------------------

[root@pr-al-ulpsovm2 scsi]# multipath -ll

36003005701a64e701bad80050cb9fc6e dm-0 LSI,RAID 5/6 SAS 6G

size=1.6T features='0' hwhandler='0' wp=rw

`-+- policy='round-robin 0' prio=1 status=active

  `- 0:2:1:0 sdb 8:16  active ready running

3600601607ea021009c41f0912643e411 dm-2 DGC,VRAID

size=100G features='1 queue_if_no_path' hwhandler='1 emc' wp=rw

|-+- policy='round-robin 0' prio=1 status=active

| |- 1:0:0:2 sde 8:64  active ready running

| `- 2:0:0:2 sdk 8:160 active ready running

`-+- policy='round-robin 0' prio=0 status=enabled

  |- 1:0:1:2 sdh 8:112 active ready running

  `- 2:0:1:2 sdn 8:208 active ready running

3600601607ea02100001dfe442643e411 dm-1 DGC,VRAID

size=1.4T features='1 queue_if_no_path' hwhandler='1 emc' wp=rw

|-+- policy='round-robin 0' prio=1 status=active

| |- 1:0:1:1 sdg 8:96  active ready running

| `- 2:0:1:1 sdm 8:192 active ready running

`-+- policy='round-robin 0' prio=0 status=enabled

  |- 1:0:0:1 sdd 8:48  active ready running

  `- 2:0:0:1 sdj 8:144 active ready running

---------------------------------------------------------------------------------------------------------

please help

ta

Comments
Locked Post
New comments cannot be posted to this locked post.
Post Details
Locked on Mar 11 2015
Added on Feb 10 2015
4 comments
1,717 views