Install EFA on TPVM in a Multi-Node Deployment

You can install EFA on a TPVM (Third-Party Virtual Machine) in a two-node deployment for high availability.

Before you begin

The EFA tar file must be available on the /efaboot partition of the SLX device. You need root access to the device.

About this task

EFA on TPVM is supported only on the platforms described in Supported Platforms and Deployment Models.

By default, EFA is installed in secure mode. For more information about the modes, see EFA Installation Modes.

Important

Important

Do not use the following IP addresses, which are used by the K3s service:
  • 10.42.0.0/16 subnet
  • 10.43.0.0/16 subnet
  • 169.254.0.0/16 subnet

Procedure

  1. Verify that the TPVM is set up for an EFA deployment.
    1. Verify the versions of TPVM and SLX-OS.
      For the latest supported version information, see Supported Platforms and Deployment Models.
      device# show tpvm status
      device# show version
      
    2. Verify that the TPVM has an assigned IP address.
      device# show tpvm ip-address
    3. Verify that the SSH keys are uploaded.
      device# show tpvm status
    4. (For SLX-OS releases earlier than 20.2.3) Verify that passwordless access is configured.
      device# show tpvm status
    5. (For SLX-OS 20.2.3 and later with TPVM version 4.2.2 and later) Verify that passwordless access is configured for the peer.
      device# show tpvm config trusted-peer
    6. Confirm NTP on the TPVM.
      device# tpvm config ntp add server <ip>
    7. Verify that NTP is synchronized.
      device# show tpvm config ntp 
    8. If necessary, log in to TPVM and configure the NTP time zone.
      device# tpvm config timezone
    9. If necessary, configure unique TPVM host names.
      device# tpvm config host
  2. Enter SLX Linux mode.
    device# start-shell
    # cd /efaboot
    
  3. Copy the EFA tar file to the SLX device.
    # scp efa-x.x.x.tar.gz
  4. Deploy EFA on TPVM from the SLX shell.
    device# efa deploy
    Starting "efa deploy", DO NOT hit CTRL+C
    Step 1: Checking if TPVM is deployed ...
    Step 2: Get IP Addressed assigned to TPVM to deploy EFA
    IP Address of the TPVM 10.x.x.x
    Step 3: Checking for EFA packages in /efaboot directory
    Step 4: Deploying EFA package efa-2.x.x.tar.gz on 10.x.x.x
    Note

    Note

    From SLX version 20.4.1 and above, new install or upgrade of EFA on TPVM in a multi-node deployment displays the following warning banner on the console:
    **********************************************************************
    *                 ! ! ! WARNING ! ! !                                *
    *  Proceeding with Extreme Fabric Automation deployment              *
    *       1. Do not reboot device(s) or TPVM(s)                        *
    *       2. Do not toggle management port on device(s) or TPVM(s)     *
    *       3. Avoid CTRL+C on the installer window                      *
    **********************************************************************

    The EFA Installer begins in a series of dialogs.

  5. When prompted, select Multi-node deployment and OK.
    Tip

    Tip

    Use arrow keys to move between options and the space bar to select an option.
  6. When prompted, enter the peer IP address or FQDN of the other node in the cluster.
  7. When prompted, enter the virtual IP address for the cluster.
  8. When prompted, enter the virtual IPv6 address for the cluster.
    • Select Yes and then provide the virtual IPv6 addresses.
    • Select No to ignore this optional step.
  9. When prompted to configure additional IP addresses for a health check, take one of the following steps.
    • Select Yes and then provide the IP addresses.
    • Select No to ignore this optional step.
  10. When prompted to configure additional management IP networks, take one of the following steps.
    • Select Yes and then provide the following information when prompted. Repeat as often as necessary.
      • Sub-interface name, which is a unique name that contains no more than 11 characters, no white space, and no % or / characters.
      • ID of the VLAN that the management network uses to tag traffic. Valid values range from 2 through 4093.
      • IP subnet address in CIDR format. The subnet must not overlap with any IP subnet that you have already provided.
    • Select No to ignore this optional step or when you have finished entering network information.
  11. When prompted to configure additional management IP network routes, take one of the following steps.
    • Select Yes and then provide the following information when prompted. Repeat as often as necessary.
      • Target network IP address in CIDR format
      • Source IP address for outbound traffic
      • Next-hop or gateway IP address through which access to the destination network is provided
    • Select No to ignore this optional step or when you have finished entering route information.
    The installation proceeds. Messages summarize your selections, describe the progress, and indicate when EFA is deployed.
  12. Verify the installation.
    1. On the SLX device, run the show efa status command to see details of the installation and the state of services.
    2. From the EFA command line, run the efactl status command to see the status of nodes, pods, and services.
    3. From the EFA command line, run the efa status command for concise status information.