Uploaded image for project: 'XenServer Org'
  1. XenServer Org
  2. XSO-852

OpenVSwitch "ovs-switchd" process uses >300% CPU

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done (View Workflow)
    • Priority: Critical
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Networking
    • Labels:
      None
    • Environment:

      Dell PowerEdge R730
      Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
      64GB RAM

      Description

      I originally reported this issue under -XSO-626- and -XSO-659-. Unfortunately we cannot upgrade to XenServer 7.1 or above without incurring a substantial cost, and so either require a workaround or a fix for this issue for XenServer 7.0. I am re-reporting this issue now as the problem has recently started occurring several times a day requiring constant intervention to prevent other VMs and processes taking a performance hit.

      What I haven't previously mentioned is that I have created a cron job within XenServer which executes every minute. The job calls the attached mirror_traffic.sh script, which essentially checks if a valid traffic mirror exists and, if not, creates a mirror to copy traffic from one VM to another. The source VM is our PBX and the destination is a VoIP recording (call recording) server.

      I can only guess that the issue I am experiencing relates to this traffic mirroring configuration, but I could be wrong.

      Just to recap, ovs-switchd process randomly uses >300% CPU until restarted, which has a severe impact on the XenServer host and all VMs running. To resolve the issue, either reboot the host or execute "systemctl restart openvswitch". The latter command is the preferred recovery option as this does not introduce downtime and can be done at any time without disrupting service.

        Attachments

        1. LOG.txt
          5 kB
        2. mirror_traffic.sh
          0.9 kB
        3. TOP.txt
          4 kB
        4. TOPv2.txt
          4 kB
        5. TOPv3.txt
          0.7 kB

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                davidenco David Reade
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: