Uploaded image for project: 'XenServer Org'
  1. XenServer Org
  2. XSO-965

HBA SR not available when Multipathing enabled in Citrix Hypervisor 8.0

    XMLWordPrintable

Details

    • Bug
    • Resolution: Answered
    • Critical
    • None
    • 8.0
    • Storage
    • None
    • 1) 3x HP Proliant Gen 9 Servers (Apollo's)

      2) 1x HP 3Par 8000 SAN

      3) Connected via Fibre Channels, 2 paths per server

    Description

      Issue: When Multipathing is enabled in 8.0 for a SR connected via 2 channel Fibre to a HP 3PAR SAN storage array, then it fails to connect and reports an error 'Invalid Option'

      Steps to Reproduce:

      1. Install 8.0.
      2. Post installation, run 'yum update' to get up to date.
      3. In XenCenter
        i. Add HBA Storage Repository (I'm connected to an HP 3PAR 8 via Fibre, 2 channels)
        ii. Ensure the Storage Repository is listed and available, etc.
      4. Enter Maintenance Mode, Turn on 'Multipathing' and save.
        RESULT: Xen fails to reconnect to the Storage Repository (SR) and reports an error 'Invalid Option'. Selecting 'Repair' on the SR reports the same error.
      5. Enter maintenance Mode again, turn 'OFF' Multipathing and save.
        RESULT: After selecting 'Repair', the SR is reconnected again.

      Repeating steps 3 & 4 produces the same outcome - whenever Multipathing is enabled, it fails to connect to our 3PAR SR.
      Note: No issues connecting to the local SR or the NFS drive I also have mounted (these don't support Multipathing).

      Expected Result: Post enabling Multipathing, the SR should reconnect.

      Actual Result: The SR fails to reconnect and reports an error: 'Invalid Option'

      [15112] ***** generic exception: sr_attach: EXCEPTION <class 'SR.SROSError'>, Error reporting error, unknown key DMP failed to activate mapper path

      [15112] raise xs_errors.XenError('DMP failed to activate mapper path')
      [15112] ***** LVHD over FC: EXCEPTION <class 'SR.SROSError'>, Error reporting error, unknown key DMP failed to activate mapper path

      More Information: This is the output from the /var/logs/SMlog when enabling Multipathing.

      [15112] Setting LVM_DEVICE to /dev/disk/by-scsid/360002ac000000000000000020001d3ea
      [15112] Setting LVM_DEVICE to /dev/disk/by-scsid/360002ac000000000000000020001d3ea
      [15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] LVMCache created for VG_XenStorage-9c1eeb54-af8e-8538-c90f-d6ec12404f21
      [15112] ['/sbin/vgs', '--readonly', 'VG_XenStorage-9c1eeb54-af8e-8538-c90f-d6ec12404f21']
      [15112] pread SUCCESS
      [15112] lock: acquired /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] LVMCache: will initialize now
      [15112] LVMCache: refreshing
      [15112] ['/sbin/lvs', '--noheadings', '--units', 'b', '-o', '+lv_tags', '/dev/VG_XenStorage-9c1eeb54-af8e-8538-c90f-d6ec12404f21']
      [15112] pread SUCCESS
      [15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] lock: acquired /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] sr_attach {'sr_uuid': '9c1eeb54-af8e-8538-c90f-d6ec12404f21', 'subtask_of': 'DummyRef:|7fd8329d-7974-4bf1-b5fb-3037d14a1c8a|SR.attach', 'args': [], 'host_ref': 'OpaqueRef:1ddd077a-19fa-4112-824f-b661e81eb024', 'session_ref': 'OpaqueRef:428df3a5-59c6-432c-b0c9-18f93c6e51e7', 'device_config':

      {'device': '/dev/disk/mpInuse/360002ac000000000000000020001d3ea', 'SCSIid': '360002ac000000000000000020001d3ea', 'SRmaster': 'true'}

      , 'command': 'sr_attach', 'sr_ref': 'OpaqueRef:75ecd97c-c3cb-4630-9c36-5e3b8d4684ae'}
      [15112] === SR 9c1eeb54-af8e-8538-c90f-d6ec12404f21: abort ===
      [15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
      [15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/gc_active
      [15112] lock: tried lock /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running, acquired: True (exists: True)
      [15112] abort: releasing the process lock
      [15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
      [15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
      [15112] lock: opening lock file /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] lock: acquired /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
      [15112] lock: acquired /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] RESET for SR 9c1eeb54-af8e-8538-c90f-d6ec12404f21 (master: True)
      [15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
      [15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
      [15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] set_dirty 'OpaqueRef:75ecd97c-c3cb-4630-9c36-5e3b8d4684ae' failed (flag already set?)
      [15112] MPATH: multipath activate called
      [15112] mpath cmd: help
      [15112] mpath output: multipathd> help
      [15112] multipath-tools v0.4.9 (05/33, 2016)
      [15112] CLI commands reference:
      [15112] list|show paths
      [15112] list|show paths format $format
      [15112] list|show paths raw format $format
      [15112] list|show status
      [15112] list|show daemon
      [15112] list|show maps|multipaths
      [15112] list|show maps|multipaths status
      [15112] list|show maps|multipaths stats
      [15112] list|show maps|multipaths format $format
      [15112] list|show maps|multipaths raw format $format
      [15112] list|show maps|multipaths topology
      [15112] list|show maps|multipaths json
      [15112] list|show topology
      [15112] list|show map|multipath $map topology
      [15112] list|show map|multipath $map json
      [15112] list|show config
      [15112] list|show blacklist
      [15112] list|show devices
      [15112] list|show wildcards
      [15112] reset maps|multipaths stats
      [15112] reset map|multipath $map stats
      [15112] add path $path
      [15112] remove|del path $path
      [15112] add map|multipath $map
      [15112] remove|del map|multipath $map
      [15112] switch|switchgroup map|multipath $map group $group
      [15112] reconfigure
      [15112] suspend map|multipath $map
      [15112] resume map|multipath $map
      [15112] resize map|multipath $map
      [15112] reset map|multipath $map
      [15112] reload map|multipath $map
      [15112] disablequeueing map|multipath $map
      [15112] restorequeueing map|multipath $map
      [15112] disablequeueing maps|multipaths
      [15112] restorequeueing maps|multipaths
      [15112] reinstate path $path
      [15112] fail path $path
      [15112] quit|exit
      [15112] shutdown
      [15112] map|multipath $map getprstatus
      [15112] map|multipath $map setprstatus
      [15112] map|multipath $map unsetprstatus
      [15112] map|multipath $map getprkey
      [15112] map|multipath $map setprkey key $key
      [15112] map|multipath $map unsetprkey
      [15112] forcequeueing daemon
      [15112] restorequeueing daemon
      [15112] multipathd>
      [15112] MPATH: dm-multipath activated.
      [15112] Refreshing LUN 360002ac000000000000000020001d3ea
      [15112] ['/usr/sbin/multipath', '-r', '360002ac000000000000000020001d3ea']
      [15112] pread SUCCESS
      [15112] lock: released /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] ***** generic exception: sr_attach: EXCEPTION <class 'SR.SROSError'>, Error reporting error, unknown key DMP failed to activate mapper path
      [15112] File "/opt/xensource/sm/SRCommand.py", line 110, in run
      [15112] return self._run_locked(sr)
      [15112] File "/opt/xensource/sm/SRCommand.py", line 159, in _run_locked
      [15112] rv = self._run(sr, target)
      [15112] File "/opt/xensource/sm/SRCommand.py", line 349, in _run
      [15112] return sr.attach(self.params['sr_uuid'])
      [15112] File "/opt/xensource/sm/LVMoHBASR", line 122, in attach
      [15112] self.mpathmodule.refresh(self.SCSIid,0)
      [15112] File "/opt/xensource/sm/mpath_dmp.py", line 177, in refresh
      [15112] _refresh_DMP(sid,npaths)
      [15112] File "/opt/xensource/sm/mpath_dmp.py", line 242, in _refresh_DMP
      [15112] raise xs_errors.XenError('DMP failed to activate mapper path')
      [15112]
      [15112] ***** LVHD over FC: EXCEPTION <class 'SR.SROSError'>, Error reporting error, unknown key DMP failed to activate mapper path
      [15112] File "/opt/xensource/sm/SRCommand.py", line 372, in run
      [15112] ret = cmd.run(sr)
      [15112] File "/opt/xensource/sm/SRCommand.py", line 110, in run
      [15112] return self._run_locked(sr)
      [15112] File "/opt/xensource/sm/SRCommand.py", line 159, in _run_locked
      [15112] rv = self._run(sr, target)
      [15112] File "/opt/xensource/sm/SRCommand.py", line 349, in _run
      [15112] return sr.attach(self.params['sr_uuid'])
      [15112] File "/opt/xensource/sm/LVMoHBASR", line 122, in attach
      [15112] self.mpathmodule.refresh(self.SCSIid,0)
      [15112] File "/opt/xensource/sm/mpath_dmp.py", line 177, in refresh
      [15112] _refresh_DMP(sid,npaths)
      [15112] File "/opt/xensource/sm/mpath_dmp.py", line 242, in _refresh_DMP
      [15112] raise xs_errors.XenError('DMP failed to activate mapper path')
      [15112]
      [15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/sr
      [15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/gc_active
      [15112] lock: closed /var/lock/sm/9c1eeb54-af8e-8538-c90f-d6ec12404f21/running
      [15264] sr_update {'sr_uuid': '5082faa8-9df4-1184-8add-012bd023829a', 'subtask_of': 'DummyRef:|bba377ce-62f2-46f3-bedd-af64858128bc|SR.stat', 'args': [], 'host_ref': 'OpaqueRef:1ddd077a-19fa-4112-824f-b661e81eb024', 'session_ref': 'OpaqueRef:e4a45f24-a395-4c29-9328-59d05d4f6eee', 'device_config':

      {'nfsversion': '4', 'type': 'nfs_iso', 'SRmaster': 'true', 'location': 'seagate:/shares/XenServer/'}

      , 'command': 'sr_update', 'sr_ref': 'OpaqueRef:a7aacc3b-8e4d-49e0-a65f-81217011917b'}
      [15444] sr_update {'sr_uuid': '5082faa8-9df4-1184-8add-012bd023829a', 'subtask_of': 'DummyRef:|8b0266ac-53a0-405b-8331-1921ca5d30f7|SR.stat', 'args': [], 'host_ref': 'OpaqueRef:1ddd077a-19fa-4112-824f-b661e81eb024', 'session_ref': 'OpaqueRef:027e4a72-f9fc-4e5c-9e10-96753733ea45', 'device_config':

      {'nfsversion': '4', 'type': 'nfs_iso', 'SRmaster': 'true', 'location': 'seagate:/shares/XenServer/'}

      , 'command': 'sr_update', 'sr_ref': 'OpaqueRef:a7aacc3b-8e4d-49e0-a65f-81217011917b'}

      Attachments

        Activity

          People

            Unassigned Unassigned
            kentnz Kent Lendrum
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: