Details
Description
Issue: When Multipathing is enabled in 8.0 for a SR connected via 2 channel Fibre to a HP 3PAR SAN storage array, then it fails to connect and reports an error 'Invalid Option'
Steps to Reproduce:
- Install 8.0.
- Post installation, run 'yum update' to get up to date.
- In XenCenter
i. Add HBA Storage Repository (I'm connected to an HP 3PAR 8 via Fibre, 2 channels)
ii. Ensure the Storage Repository is listed and available, etc. - Enter Maintenance Mode, Turn on 'Multipathing' and save.
RESULT: Xen fails to reconnect to the Storage Repository (SR) and reports an error 'Invalid Option'. Selecting 'Repair' on the SR reports the same error. - Enter maintenance Mode again, turn 'OFF' Multipathing and save.
RESULT: After selecting 'Repair', the SR is reconnected again.
Repeating steps 3 & 4 produces the same outcome - whenever Multipathing is enabled, it fails to connect to our 3PAR SR.
Note: No issues connecting to the local SR or the NFS drive I also have mounted (these don't support Multipathing).
Expected Result: Post enabling Multipathing, the SR should reconnect.
Actual Result: The SR fails to reconnect and reports an error: 'Invalid Option'
[15112] ***** generic exception: sr_attach: EXCEPTION <class 'SR.SROSError'>, Error reporting error, unknown key DMP failed to activate mapper path
[15112] raise xs_errors.XenError('DMP failed to activate mapper path')
[15112] ***** LVHD over FC: EXCEPTION <class 'SR.SROSError'>, Error reporting error, unknown key DMP failed to activate mapper path
More Information: This is the output from the /var/logs/SMlog when enabling Multipathing.
[15112] Setting LVM_DEVICE to /dev/disk/by-scsid/360002ac000000000000000020001d3ea
[15112] Setting LVM_DEVICE to /dev/disk/by-scsid/360002ac000000000000000020001d3ea
[15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] LVMCache created for VG_XenStorage-9c1eeb54-af8e-8538-c90f-d6ec12404f21
[15112] ['/sbin/vgs', '--readonly', 'VG_XenStorage-9c1eeb54-af8e-8538-c90f-d6ec12404f21']
[15112] pread SUCCESS
[15112] lock: acquired /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] LVMCache: will initialize now
[15112] LVMCache: refreshing
[15112] ['/sbin/lvs', '--noheadings', '--units', 'b', '-o', '+lv_tags', '/dev/VG_XenStorage-9c1eeb54-af8e-8538-c90f-d6ec12404f21']
[15112] pread SUCCESS
[15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] lock: acquired /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] sr_attach {'sr_uuid': '9c1eeb54-af8e-8538-c90f-d6ec12404f21', 'subtask_of': 'DummyRef:|7fd8329d-7974-4bf1-b5fb-3037d14a1c8a|SR.attach', 'args': [], 'host_ref': 'OpaqueRef:1ddd077a-19fa-4112-824f-b661e81eb024', 'session_ref': 'OpaqueRef:428df3a5-59c6-432c-b0c9-18f93c6e51e7', 'device_config':
, 'command': 'sr_attach', 'sr_ref': 'OpaqueRef:75ecd97c-c3cb-4630-9c36-5e3b8d4684ae'}
[15112] === SR 9c1eeb54-af8e-8538-c90f-d6ec12404f21: abort ===
[15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
[15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/gc_active
[15112] lock: tried lock /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running, acquired: True (exists: True)
[15112] abort: releasing the process lock
[15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
[15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
[15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] lock: acquired /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
[15112] lock: acquired /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] RESET for SR 9c1eeb54-af8e-8538-c90f-d6ec12404f21 (master: True)
[15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
[15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
[15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] set_dirty 'OpaqueRef:75ecd97c-c3cb-4630-9c36-5e3b8d4684ae' failed (flag already set?)
[15112] MPATH: multipath activate called
[15112] mpath cmd: help
[15112] mpath output: multipathd> help
[15112] multipath-tools v0.4.9 (05/33, 2016)
[15112] CLI commands reference:
[15112] list|show paths
[15112] list|show paths format $format
[15112] list|show paths raw format $format
[15112] list|show status
[15112] list|show daemon
[15112] list|show maps|multipaths
[15112] list|show maps|multipaths status
[15112] list|show maps|multipaths stats
[15112] list|show maps|multipaths format $format
[15112] list|show maps|multipaths raw format $format
[15112] list|show maps|multipaths topology
[15112] list|show maps|multipaths json
[15112] list|show topology
[15112] list|show map|multipath $map topology
[15112] list|show map|multipath $map json
[15112] list|show config
[15112] list|show blacklist
[15112] list|show devices
[15112] list|show wildcards
[15112] reset maps|multipaths stats
[15112] reset map|multipath $map stats
[15112] add path $path
[15112] remove|del path $path
[15112] add map|multipath $map
[15112] remove|del map|multipath $map
[15112] switch|switchgroup map|multipath $map group $group
[15112] reconfigure
[15112] suspend map|multipath $map
[15112] resume map|multipath $map
[15112] resize map|multipath $map
[15112] reset map|multipath $map
[15112] reload map|multipath $map
[15112] disablequeueing map|multipath $map
[15112] restorequeueing map|multipath $map
[15112] disablequeueing maps|multipaths
[15112] restorequeueing maps|multipaths
[15112] reinstate path $path
[15112] fail path $path
[15112] quit|exit
[15112] shutdown
[15112] map|multipath $map getprstatus
[15112] map|multipath $map setprstatus
[15112] map|multipath $map unsetprstatus
[15112] map|multipath $map getprkey
[15112] map|multipath $map setprkey key $key
[15112] map|multipath $map unsetprkey
[15112] forcequeueing daemon
[15112] restorequeueing daemon
[15112] multipathd>
[15112] MPATH: dm-multipath activated.
[15112] Refreshing LUN 360002ac000000000000000020001d3ea
[15112] ['/usr/sbin/multipath', '-r', '360002ac000000000000000020001d3ea']
[15112] pread SUCCESS
[15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] ***** generic exception: sr_attach: EXCEPTION <class 'SR.SROSError'>, Error reporting error, unknown key DMP failed to activate mapper path
[15112] File "/opt/xensource/sm/SRCommand.py", line 110, in run
[15112] return self._run_locked(sr)
[15112] File "/opt/xensource/sm/SRCommand.py", line 159, in _run_locked
[15112] rv = self._run(sr, target)
[15112] File "/opt/xensource/sm/SRCommand.py", line 349, in _run
[15112] return sr.attach(self.params['sr_uuid'])
[15112] File "/opt/xensource/sm/LVMoHBASR", line 122, in attach
[15112] self.mpathmodule.refresh(self.SCSIid,0)
[15112] File "/opt/xensource/sm/mpath_dmp.py", line 177, in refresh
[15112] _refresh_DMP(sid,npaths)
[15112] File "/opt/xensource/sm/mpath_dmp.py", line 242, in _refresh_DMP
[15112] raise xs_errors.XenError('DMP failed to activate mapper path')
[15112]
[15112] ***** LVHD over FC: EXCEPTION <class 'SR.SROSError'>, Error reporting error, unknown key DMP failed to activate mapper path
[15112] File "/opt/xensource/sm/SRCommand.py", line 372, in run
[15112] ret = cmd.run(sr)
[15112] File "/opt/xensource/sm/SRCommand.py", line 110, in run
[15112] return self._run_locked(sr)
[15112] File "/opt/xensource/sm/SRCommand.py", line 159, in _run_locked
[15112] rv = self._run(sr, target)
[15112] File "/opt/xensource/sm/SRCommand.py", line 349, in _run
[15112] return sr.attach(self.params['sr_uuid'])
[15112] File "/opt/xensource/sm/LVMoHBASR", line 122, in attach
[15112] self.mpathmodule.refresh(self.SCSIid,0)
[15112] File "/opt/xensource/sm/mpath_dmp.py", line 177, in refresh
[15112] _refresh_DMP(sid,npaths)
[15112] File "/opt/xensource/sm/mpath_dmp.py", line 242, in _refresh_DMP
[15112] raise xs_errors.XenError('DMP failed to activate mapper path')
[15112]
[15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
[15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/gc_active
[15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
[15264] sr_update {'sr_uuid': '5082faa8-9df4-1184-8add-012bd023829a', 'subtask_of': 'DummyRef:|bba377ce-62f2-46f3-bedd-af64858128bc|SR.stat', 'args': [], 'host_ref': 'OpaqueRef:1ddd077a-19fa-4112-824f-b661e81eb024', 'session_ref': 'OpaqueRef:e4a45f24-a395-4c29-9328-59d05d4f6eee', 'device_config':
, 'command': 'sr_update', 'sr_ref': 'OpaqueRef:a7aacc3b-8e4d-49e0-a65f-81217011917b'}
[15444] sr_update {'sr_uuid': '5082faa8-9df4-1184-8add-012bd023829a', 'subtask_of': 'DummyRef:|8b0266ac-53a0-405b-8331-1921ca5d30f7|SR.stat', 'args': [], 'host_ref': 'OpaqueRef:1ddd077a-19fa-4112-824f-b661e81eb024', 'session_ref': 'OpaqueRef:027e4a72-f9fc-4e5c-9e10-96753733ea45', 'device_config':
, 'command': 'sr_update', 'sr_ref': 'OpaqueRef:a7aacc3b-8e4d-49e0-a65f-81217011917b'}