Qlogic ISP 2200, DL-380 and EVA 5000 SAN; how?

[Morten Liebach]

Hello

I am trying to use a HP EVA 5000 SAN through a Qlogic ISP 2200 PCI FC-AL
Adapter on a HP DL-380 (dmesg inline at the end), and so far I've
failed.

The HBA is recognized as:
isp0: <Qlogic ISP 2200 PCI FC-AL Adapter> port 0x4000-0x40ff mem 0xf7ff0000-0xf7 ff0fff irq 10 at device 1.0 on pci6

I have tried with ispfw(4) both as a module and compiled in, with "options
ISP_TARGET_MODE" and without.

I need to run 'camcontrol rescan all' to see anything more than the
built in RAID, with ISP_TARGET_MODE and ispfw(4) compiled in. After
running 'camcontrol rescan all' I get:


# camcontrol devlist -v
scbus0 on ciss0 bus 0:
<COMPAQ RAID 1 VOLUME OK> at scbus0 target 0 lun 0 (pass0,da0)
scbus1 on ciss0 bus 32:
scbus2 on ciss0 bus 33:
scbus3 on isp0 bus 0:
<COMPAQ HSV110 (C)COMPAQ 3020> at scbus3 target 0 lun 0 (pass1)
< > at scbus3 target -1 lun -1 ()
scbus-1 on xpt0 bus 0:
< > at scbus-1 target -1 lun -1 (xpt0)


I've been trying to rescan 3:0:0 and 3:0:1 and various other
combinations. The SAN should have the volume available at LUN 1,
according to our storage manager, but nothing is found there.

I expected getting a new da1 device and access the SAN through that, but
no joy so far. I did get a da1 device without ispfw(4) and
ISP_TARGET_MODE in the kernel (but ispfw(4) loaded as a module, but I
found out the hard way (disklabeling and newfs'ing it) that that was
just another name for the da0 device. Thank god for nightly full
backups...

So, what blindingly obvious thing am I missing here?

Have a nice day
Morten



Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 4.11-RELEASE #2: Mon Feb 21 13:51:58 CET 2005
[email]root@build01.telmore.dk[/email]:/usr/obj/usr/src/sys/TelmoreSANHBA
Timecounter "i8254" frequency 1193182 Hz
Timecounter "TSC" frequency 3189402584 Hz
CPU: Intel(R) Xeon(TM) CPU 3.20GHz (3189.40-MHz 686-class CPU)
Origin = "GenuineIntel" Id = 0xf25 Stepping = 5
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE ,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH, DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Hyperthreading: 2 logical CPUs
real memory = 1073717248 (1048552K bytes)
avail memory = 1039577088 (1015212K bytes)
Preloaded elf kernel "kernel" at 0xc052d000.
Warning: Pentium 4 CPU: PSE disabled
Pentium Pro MTRR support enabled
md0: Malloc disk
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib0: <Host to PCI bridge> on motherboard
pci0: <PCI bus> on pcib0
pci0: <ATI Mach64-GR graphics accelerator> at 3.0
pci0: <unknown card> (vendor=0x0e11, dev=0xb203) at 4.0 irq 3
pci0: <unknown card> (vendor=0x0e11, dev=0xb204) at 4.2 irq 5
isab0: <PCI to ISA bridge (vendor=1166 device=0201)> at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <ServerWorks CSB5 ATA100 controller> port 0x2000-0x200f,0x374-0x377,0x170-0x177,0x3f4-0x3f7,0x1f0-0x1f7 at device 15.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ata1: at 0x170 irq 15 on atapci0
ohci0: <OHCI (generic) USB controller> mem 0xf0ef0000-0xf0ef0fff irq 7 at device 15.2 on pci0
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 4 ports with 4 removable, self powered
pcib1: <Host to PCI bridge> on motherboard
pci1: <PCI bus> on pcib1
ciss0: <Compaq Smart Array 5i> port 0x3000-0x30ff mem 0xf2cf0000-0xf2cf3fff,0xf2dc0000-0xf2dfffff irq 10 at device 3.0 on pci1
pcib2: <Host to PCI bridge> on motherboard
pci2: <PCI bus> on pcib2
bge0: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev. 0x1002> mem 0xf2ef0000-0xf2efffff irq 11 at device 1.0 on pci2
bge0: Ethernet address: 00:11:0a:9d:e2:f3
miibus0: <MII bus> on bge0
brgphy0: <BCM5703 10/100/1000baseTX PHY> on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
bge1: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev. 0x1002> mem 0xf2ee0000-0xf2eeffff irq 15 at device 2.0 on pci2
bge1: Ethernet address: 00:11:0a:9d:e2:f2
miibus1: <MII bus> on bge1
brgphy1: <BCM5703 10/100/1000baseTX PHY> on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
pcib3: <Host to PCI bridge> on motherboard
pci3: <PCI bus> on pcib3
pcib4: <ServerWorks host to PCI bridge(unknown chipset)> on motherboard
pci4: <PCI bus> on pcib4
pcib6: <ServerWorks host to PCI bridge(unknown chipset)> on motherboard
pci6: <PCI bus> on pcib6
isp0: <Qlogic ISP 2200 PCI FC-AL Adapter> port 0x4000-0x40ff mem 0xf7ff0000-0xf7ff0fff irq 10 at device 1.0 on pci6
pci6: <unknown card> (vendor=0x0e11, dev=0xa0f7) at 30.0 irq 15
pcib5: <ServerWorks host to PCI bridge(unknown chipset)> on motherboard
pci5: <PCI bus> on pcib5
pcib7: <ServerWorks host to PCI bridge(unknown chipset)> on motherboard
pci7: <PCI bus> on pcib7
eisa0: <EISA bus> on motherboard
mainboard0: <CPQ0727 (System Board)> on eisa0 slot 0
orm0: <Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff,0xcc000-0xcd7ff,0xee000-0xeffff on isa0
pmtimer0 on isa0
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio1: configured irq 3 not in bitmap of probed irqs 0
ppc0: parallel port not found.
isp0: port logout of iid 0
ipfw2 initialized, divert disabled, rule-based forwarding enabled, default to accept, logging unlimited
ata0-slave: ATA identify retries exceeded
acd0: CDROM <COMPAQ CD-ROM SN-124> at ata0-master PIO4
pass1 at isp0 bus 0 target 0 lun 0
pass1: <COMPAQ HSV110 (C)COMPAQ 3020> Fixed Storage Array SCSI-2 device
pass1: 100.000MB/s transfers, Tagged Queueing Enabled
da0 at ciss0 bus 0 target 0 lun 0
da0: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device
da0: 135.168MB/s transfers
da0: 34727MB (71122560 512 byte sectors: 255H 32S/T 8716C)
Mounting root from ufs:/dev/da0s1a
bge0: gigabit link up


--
[url]http://m.mongers.org/weblog/[/url]
__END__

[Dan Nelson]

In the last episode (Feb 21), Morten Liebach said:

> I am trying to use a HP EVA 5000 SAN through a Qlogic ISP 2200 PCI
> FC-AL Adapter on a HP DL-380 (dmesg inline at the end), and so far
> I've failed.
>
> The HBA is recognized as:
> isp0: <Qlogic ISP 2200 PCI FC-AL Adapter> port 0x4000-0x40ff mem 0xf7ff0000-0xf7 ff0fff irq 10 at device 1.0 on pci6
>
> I need to run 'camcontrol rescan all' to see anything more than the
> built in RAID, with ISP_TARGET_MODE and ispfw(4) compiled in. After
> running 'camcontrol rescan all' I get:
>
> # camcontrol devlist -v
> scbus3 on isp0 bus 0:
> <COMPAQ HSV110 (C)COMPAQ 3020> at scbus3 target 0 lun 0 (pass1)
> < > at scbus3 target -1 lun -1 ()
> scbus-1 on xpt0 bus 0:
> < > at scbus-1 target -1 lun -1 (xpt0)
>
> I've been trying to rescan 3:0:0 and 3:0:1 and various other
> combinations. The SAN should have the volume available at LUN 1,
> according to our storage manager, but nothing is found there.

Check your LUN masking; have you made it visible to this host (usually
by specifying the server's port or WWID)? Masking can be done at
either the RAID or the fibre-switch. Switches usually do masking at
the port or wwid level, so since you can see LUN 0 of that array, it's
probably being masked at the RAID array.

> isp0: <Qlogic ISP 2200 PCI FC-AL Adapter> port 0x4000-0x40ff mem 0xf7ff0000-0xf7ff0fff irq 10 at device 1.0 on pci6
> pass1 at isp0 bus 0 target 0 lun 0
> pass1: <COMPAQ HSV110 (C)COMPAQ 3020> Fixed Storage Array SCSI-2 device
> pass1: 100.000MB/s transfers, Tagged Queueing Enabled

LUN 0 looks like it's just a management LUN. A disk device would come
up as "Direct Access", not "Storage Array".

--
Dan Nelson
[email]dnelson@allantgroup.com[/email]

[Morten Liebach]

On 2005-02-21 10:29:48 -0600, Dan Nelson wrote:

> In the last episode (Feb 21), Morten Liebach said:

> > I am trying to use a HP EVA 5000 SAN through a Qlogic ISP 2200 PCI
> > FC-AL Adapter on a HP DL-380 (dmesg inline at the end), and so far
> > I've failed.
> >
> > The HBA is recognized as:
> > isp0: <Qlogic ISP 2200 PCI FC-AL Adapter> port 0x4000-0x40ff mem 0xf7ff0000-0xf7 ff0fff irq 10 at device 1.0 on pci6
> >
> > I need to run 'camcontrol rescan all' to see anything more than the
> > built in RAID, with ISP_TARGET_MODE and ispfw(4) compiled in. After
> > running 'camcontrol rescan all' I get:
> >
> > # camcontrol devlist -v
> > scbus3 on isp0 bus 0:
> > <COMPAQ HSV110 (C)COMPAQ 3020> at scbus3 target 0 lun 0 (pass1)
> > < > at scbus3 target -1 lun -1 ()
> > scbus-1 on xpt0 bus 0:
> > < > at scbus-1 target -1 lun -1 (xpt0)
> >
> > I've been trying to rescan 3:0:0 and 3:0:1 and various other
> > combinations. The SAN should have the volume available at LUN 1,
> > according to our storage manager, but nothing is found there.

>
> Check your LUN masking; have you made it visible to this host (usually
> by specifying the server's port or WWID)? Masking can be done at
> either the RAID or the fibre-switch. Switches usually do masking at
> the port or wwid level, so since you can see LUN 0 of that array, it's
> probably being masked at the RAID array.

These things look OK, we have both Linux, Windows and HP-UX hosts on the
same SAN with the same setup for them.

> > isp0: <Qlogic ISP 2200 PCI FC-AL Adapter> port 0x4000-0x40ff mem 0xf7ff0000-0xf7ff0fff irq 10 at device 1.0 on pci6
> > pass1 at isp0 bus 0 target 0 lun 0
> > pass1: <COMPAQ HSV110 (C)COMPAQ 3020> Fixed Storage Array SCSI-2 device
> > pass1: 100.000MB/s transfers, Tagged Queueing Enabled

>
> LUN 0 looks like it's just a management LUN. A disk device would come
> up as "Direct Access", not "Storage Array".

Thanks, and have a nice day
Morten

--
[url]http://m.mongers.org/weblog/[/url]
__END__

[Matthew Jacob]

>

> These things look OK, we have both Linux, Windows and HP-UX hosts on the
> same SAN with the same setup for them.

Can you clue us in on the actual lun setup exported by the array?
Or give us a /proc/scsi/scsi output dump?

Can you tell us the connection topology other than "same SAN"?

> > LUN 0 looks like it's just a management LUN. A disk device would come
> > up as "Direct Access", not "Storage Array".

>
> Thanks, and have a nice day
> Morten

Sure- we'll try! Hopefully you too!

[Morten Liebach]

On 2005-02-22 11:54:07 -0800, Matthew Jacob wrote:

> >
> > These things look OK, we have both Linux, Windows and HP-UX hosts on the
> > same SAN with the same setup for them.

>
> Can you clue us in on the actual lun setup exported by the array?

500 GB volume exported on LUN 1 single-path. WWPN is autodetected by
the SAN management software and is correct, so at least some data does
come through.

> Or give us a /proc/scsi/scsi output dump?

No such file. (And yes, /proc is mounted).

> Can you tell us the connection topology other than "same SAN"?

A fiber goes straight from the SAN, a HP StorageWorks HSV 110 box, to a
HP StorageWorks SAN Switch 2/8-EL, to which the Qlogic HBA is connected.

I hope this was what you wanted to know.

We tried 5.3-RELEASE on the box, same difference.

Have a nice day
Morten

--
[url]http://m.mongers.org/weblog/[/url]
__END__

[Matthew Jacob]

> > Or give us a /proc/scsi/scsi output dump?

>
> No such file. (And yes, /proc is mounted).

I meant from the linux box.

>

> > Can you tell us the connection topology other than "same SAN"?

>
> A fiber goes straight from the SAN, a HP StorageWorks HSV 110 box, to a
> HP StorageWorks SAN Switch 2/8-EL, to which the Qlogic HBA is connected.

Have you tried direct connect?

>
> I hope this was what you wanted to know.

Partly.

[Morten Liebach]

On 2005-02-24 12:49:48 -0800, Matthew Jacob wrote:

> > > Or give us a /proc/scsi/scsi output dump?

> >
> > No such file. (And yes, /proc is mounted).

>
> I meant from the linux box.

$ cat /proc/scsi/scsi
Attached devices:
Host: scsi0 Channel: 00 Id: 00 Lun: 00
Vendor: COMPAQ Model: HSV110 (C)COMPAQ Rev: 3010
Type: Unknown ANSI SCSI revision: 02
Host: scsi1 Channel: 00 Id: 00 Lun: 00
Vendor: COMPAQ Model: HSV110 (C)COMPAQ Rev: 3020
Type: Unknown ANSI SCSI revision: 02
Host: scsi1 Channel: 00 Id: 00 Lun: 01
Vendor: COMPAQ Model: HSV110 (C)COMPAQ Rev: 3020
Type: Direct-Access ANSI SCSI revision: 02

> > > Can you tell us the connection topology other than "same SAN"?

> >
> > A fiber goes straight from the SAN, a HP StorageWorks HSV 110 box, to a
> > HP StorageWorks SAN Switch 2/8-EL, to which the Qlogic HBA is connected.

>
> Have you tried direct connect?

Can't be done, it's our production environment and there's no ports
free.

Have a nice day
Morten

--
[url]http://m.mongers.org/weblog/[/url]
__END__

[Matthew Jacob]

And just reconfirming- a 'camcontrol rescan 3:0:1' does *not* see the disk?


On Fri, 25 Feb 2005 14:52:12 +0100, Morten Liebach <m@mongers.org> wrote:

> On 2005-02-24 12:49:48 -0800, Matthew Jacob wrote:

> > > > Or give us a /proc/scsi/scsi output dump?
> > >
> > > No such file. (And yes, /proc is mounted).

> >
> > I meant from the linux box.

>
> $ cat /proc/scsi/scsi
> Attached devices:
> Host: scsi0 Channel: 00 Id: 00 Lun: 00
> Vendor: COMPAQ Model: HSV110 (C)COMPAQ Rev: 3010
> Type: Unknown ANSI SCSI revision: 02
> Host: scsi1 Channel: 00 Id: 00 Lun: 00
> Vendor: COMPAQ Model: HSV110 (C)COMPAQ Rev: 3020
> Type: Unknown ANSI SCSI revision: 02
> Host: scsi1 Channel: 00 Id: 00 Lun: 01
> Vendor: COMPAQ Model: HSV110 (C)COMPAQ Rev: 3020
> Type: Direct-Access ANSI SCSI revision: 02
>

> > > > Can you tell us the connection topology other than "same SAN"?
> > >
> > > A fiber goes straight from the SAN, a HP StorageWorks HSV 110 box, to a
> > > HP StorageWorks SAN Switch 2/8-EL, to which the Qlogic HBA is connected.

> >
> > Have you tried direct connect?

>
> Can't be done, it's our production environment and there's no ports
> free.
>
> Have a nice day
> Morten
>
> --
> [url]http://m.mongers.org/weblog/[/url]
> __END__
>

[Morten Liebach]

On 2005-02-25 07:19:58 -0800, Matthew Jacob wrote:

> And just reconfirming- a 'camcontrol rescan 3:0:1' does *not* see the disk?

# camcontrol rescan 3:0:1
Re-scan of 3:0:1 was successful
# camcontrol devlist -v
scbus0 on ciss0 bus 0:
<COMPAQ RAID 1 VOLUME reco> at scbus0 target 0 lun 0 (pass0,da0)
scbus1 on ciss0 bus 32:
scbus2 on ciss0 bus 33:
scbus3 on isp0 bus 0:
<COMPAQ HSV110 (C)COMPAQ 3020> at scbus3 target 0 lun 0 (pass1)
< > at scbus3 target -1 lun -1 ()
scbus-1 on xpt0 bus 0:
< > at scbus-1 target -1 lun -1 (xpt0)

Nope. Still no da1 device...

Morten

--
[url]http://m.mongers.org/weblog/[/url]
__END__