iscsitarget configuration

I’ve created a very simple configuration for iscsitarget (i.e., IET):

Target iqn.2012-11.com.example.san1:sda Lun 0 Path=/dev/drbd7,Type=blockio Lun 1 Path=/dev/drbd8,Type=blockio Lun 2 Path=/dev/drbd9,Type=blockio Lun 3 Path=/dev/drbd10,Type=blockio Target iqn.2012-11.com.example.san1:sdb Lun 0 Path=/dev/drbd107,Type=blockio
However, none of the LUN’s appear on the initiator:

xen1:~ # iscsiadm -m session -P3 iSCSI Transport Class version 2.0-870 version 2.0-872.suse Target: iqn.2012-11.com.example.san1:sdb Current Portal: 192.168.1.1:3260,1 Persistent Portal: 192.168.1.1:3260,1 ********** Interface: ********** Iface Name: default Iface Transport: tcp Iface Initiatorname: iqn.1996-04.de.suse:01:2441bbdc6224 Iface IPaddress: 192.168.1.3 Iface HWaddress: <empty> Iface Netdev: <empty> SID: 1 iSCSI Connection State: LOGGED IN iSCSI Session State: LOGGED_IN Internal iscsid Session State: NO CHANGE ********* Timeouts: ********* Recovery Timeout: 120 Target Reset Timeout: 30 LUN Reset Timeout: 30 Abort Timeout: 15 ***** CHAP: ***** username: <empty> password: ******** username_in: <empty> password_in: ******** ************************ Negotiated iSCSI params: ************************ HeaderDigest: None DataDigest: None MaxRecvDataSegmentLength: 262144 MaxXmitDataSegmentLength: 8192 FirstBurstLength: 65536 MaxBurstLength: 262144 ImmediateData: Yes InitialR2T: Yes MaxOutstandingR2T: 1 ************************ Attached SCSI devices: ************************ Host Number: 6 State: running Target: iqn.2012-11.com.example.san1:sda Current Portal: 192.168.1.1:3260,1 Persistent Portal: 192.168.1.1:3260,1 ********** Interface: ********** Iface Name: default Iface Transport: tcp Iface Initiatorname: iqn.1996-04.de.suse:01:2441bbdc6224 Iface IPaddress: 192.168.1.3 Iface HWaddress: <empty> Iface Netdev: <empty> SID: 2 iSCSI Connection State: LOGGED IN iSCSI Session State: LOGGED_IN Internal iscsid Session State: NO CHANGE ********* Timeouts: ********* Recovery Timeout: 120 Target Reset Timeout: 30 LUN Reset Timeout: 30 Abort Timeout: 15 ***** CHAP: ***** username: <empty> password: ******** username_in: <empty> password_in: ******** ************************ Negotiated iSCSI params: ************************ HeaderDigest: None DataDigest: None MaxRecvDataSegmentLength: 262144 MaxXmitDataSegmentLength: 8192 FirstBurstLength: 65536 MaxBurstLength: 262144 ImmediateData: Yes InitialR2T: Yes MaxOutstandingR2T: 1 ************************ Attached SCSI devices: ************************ Host Number: 7 State: running
Why aren’t the LUN’s visible to the initiator?

Eric P.
Truckee, CA

Reloading iscsitarget on the SAN…

[CODE]> san1:~ # /etc/init.d/iscsitarget reload

Stopping iSCSI target service: done
Starting iSCSI target service: done[/CODE]
…and then clearing the initiator database…

[CODE]xen1:~ # iscsiadm -m discovery --op=delete -p 192.168.1.1

xen1:~ # iscsiadm -m discovery -t st -p 192.168.1.1
192.168.1.1:3260,1 iqn.2012-11.com.example.san1:sdb
192.168.0.1:3260,1 iqn.2012-11.com.example.san1:sdb
192.168.1.1:3260,1 iqn.2012-11.com.example.san1:sda
192.168.0.1:3260,1 iqn.2012-11.com.example.san1:sda

xen1:~ # iscsiadm -m node -p 192.168.1.1 -l
Logging in to [iface: default, target: iqn.2012-11.com.example.san1:sdb, portal: 192.168.1.1,3260] (multiple)
Logging in to [iface: default, target: iqn.2012-11.com.example.san1:sda, portal: 192.168.1.1,3260] (multiple)
Login to [iface: default, target: iqn.2012-11.com.example.san1:sdb, portal: 192.168.1.1,3260] successful.
Login to [iface: default, target: iqn.2012-11.com.example.san1:sda, portal: 192.168.1.1,3260] successful.

xen1:~ # dmesg | tail
[16159.158419] sd 9:0:0:3: [sdf] Write cache: disabled, read cache: disabled, doesn’t support DPO or FUA
[16159.158978] sd 8:0:0:0: [sdb] Attached SCSI disk
[16159.180750] sdc: unknown partition table
[16159.182476] sd 9:0:0:0: [sdc] Attached SCSI disk
[16159.196576] sdd: unknown partition table
[16159.198112] sd 9:0:0:1: [sdd] Attached SCSI disk
[16159.229768] sde: unknown partition table
[16159.231276] sd 9:0:0:2: [sde] Attached SCSI disk
[16159.238949] sdf: unknown partition table
[16159.240762] sd 9:0:0:3: [sdf] Attached SCSI disk

xen1:~ # lsscsi
[0:0:0:0] disk ATA HDS728080PLA380 PF2O /dev/sda
[4:0:1:0] cd/dvd HL-DT-ST RW/DVD GCC-4244N 1.00 /dev/sr0
[8:0:0:0] disk IET VIRTUAL-DISK 0 /dev/sdb
[9:0:0:0] disk IET VIRTUAL-DISK 0 /dev/sdc
[9:0:0:1] disk IET VIRTUAL-DISK 0 /dev/sdd
[9:0:0:2] disk IET VIRTUAL-DISK 0 /dev/sde
[9:0:0:3] disk IET VIRTUAL-DISK 0 /dev/sdf [/CODE]
…seems to have fixed the problem.

Could this be an issue of timing? i.e., Could iscsitarget be trying to export the block devices before DRBD is ready?

Eric P.
Truckee, CA

I left out a very important step (above): I realized afterwards that the exported devices were DRBD devices and that none of the DRBD devices were ready:

[CODE]> san1:/usr/share/doc # cat /proc/drbd

version: 8.4.1 (api:1/proto:86-100)
GIT-hash: 91b4c048c1a0e06777b5f65d312b38d47abaea80 build by phil@fat-tyre, 2011-12-20 12:43:15

7: cs:Connected ro:Secondary/Secondary ds:UpToDate/UpToDate C r-----
ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
8: cs:Connected ro:Secondary/Secondary ds:UpToDate/UpToDate C r-----
ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
9: cs:Connected ro:Secondary/Secondary ds:UpToDate/UpToDate C r-----
ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
10: cs:Connected ro:Secondary/Secondary ds:UpToDate/UpToDate C r-----
ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0

107: cs:Connected ro:Secondary/Secondary ds:UpToDate/UpToDate C r-----
ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0[/CODE]
So, after promoting SAN1 to become the primary, I reloaded iscsitarget on the SAN. i.e., drbd{7,8,9,10} had been read-only because SAN1 was not the primary.

I expect that if/when I figure out why SAN1 didn’t automatically become the primary the problem will be resolved.

Eric P.
Truckee, CA