VXLAN Overview

VXLAN is a Layer 2 overlay scheme over a Layer 3 network. Overlays are called VXLAN segments and only VMs and physical machines (tenents) within the same segment have Layer 2 connectivity. VXLAN segments are uniquely identified using an identifier called the VXLAN Network Identifier (VNI). The VNI is a 24-bit identifier; therefore, an administrative domain can support up to 16 million overlay networks.

As the scope of the MACs originated by tenants is restricted by the VNI, overlapping MAC addresses across segments can be supported without traffic leaking between tenant segments. When a tenant frame traverses a VXLAN overlay network, it is encapsulated by a VXLAN header that contains the VNI. This frame is further encapsulated in a UDP header and L2/L3 headers.

VXLAN can add up to a 54-byte header to the tenant VM‘s frame. For VXLAN to work correctly, this requires that the IP MTU be set to at least 1554 bytes on the network-side interfaces. IP MTU of 1554 should also be set on all transit nodes which carry VXLAN traffic. The point at which a tenant frame is encapsulated (or decapsulated) is referred to as a VXLAN Tunnel Endpoint (or VTEP). VTEPs are typically located on hypervisors but may also be located on physical network switches. Network switches that act as a VTEP are referred to as VXLAN gateways.

The role to encapsulate/decapsulate a frame is performed by a VXLAN Tunnel Endpoint (VTEP), also referred to as a VXLAN gateway. A VXLAN gateway can be a Layer 2 gateway or Layer 3 gateway depending on its capacity. A Layer 2 gateway acts as a bridge connecting VXLAN segments to VLAN segments. A Layer 3 gateway performs all that of Layer 2 gateway, and capable of routing traffic between tenant VLANs/VMANs.

At tunnel initiation, a gateway looks up the destination MAC address of the frame received from the tenant VM. If the MAC address to remote VTEP IP binding is known, the gateway adds the VXLAN header and the IP/UDP header to the frame and forwards toward the DC network. A gateway node that terminates a tunnel removes the encapsulation headers from the packet and determines the bridge domain of the inner frame by examining the VXLAN network identifier (VNID) received in the VXLAN header. The gateway then looks up the inner MAC destination address (DA) in the tenant VLAN's/VMAN's filtering database and decides either to flood or forward the frame to tenant ports.

The VXLAN segments with the same virtual network ID form a virtual network with one Ethernet broadcast domain.

Note

Note

Universal switches support Layer 3 gateways.

Supported Platforms

VXLAN is supported on Universal switches, and stacks with Universal slots only.

Note

Note

4120, 4220, and 5120 Series do not support VXLAN.

Limitations

The following capabilities are not supported in ExtremeXOS:

Interactions with Existing Features

Feature/CapabilityTenant NetworkUnderlay NetworkRest of the Switch
VLAN with: Multiple C-Tags on the same port or different C-Tags on different portsFutureFutureNo new restrictions
Port-Specific Tag (PSTag)ExtremeXOS 31.2 or laterNot supportedNo new restrictions
MAC-based and Protocol-based VLANsNot supportedNot supportedNo new restrictions
VMANsSupportedNot supportedNo new restrictions
CEPNot supportedNot supportedNo new restrictions
Configuring LAG on ports (static and LACP)ExtremeXOS 21.1 or laterExtremeXOS 21.1 or laterNo new restrictions
Configuring This command is available on all Universal switches supported in this document. on portsExtremeXOS 21.1 or laterExtremeXOS 21.1 or laterExtremeXOS 21.1 or later
Limit learning and MAC lockingExtremeXOS 31.2 or laterNot supportedExtremeXOS 21.1 or later
Configuring IP (v4/v6) address on a VLANExtremeXOS 21.1 or laterExtremeXOS 21.1 or laterNo new restrictions
Enabling IP and IPMC forwardingExtremeXOS 22.5 or laterExtremeXOS 21.1 or laterNo new restrictions
Interface virtual router configurationExtremeXOS 22.5 or laterExtremeXOS 21.1 or laterNo new restrictions
Spanning tree (802.1d, RSTP, MSTP, EMISTP, and PVST+)Not supportedExtremeXOS 21.1 or laterNo new restrictions
Ring protocols (EAPS and ERPS)ExtremeXOS 21.1 or laterExtremeXOS 21.1 or laterNo new restrictions
VRRPExtremeXOS 22.5 or laterExtremeXOS 21.1 or laterNo new restrictions
ESRPNot supportedExtremeXOS 21.1 or laterNo new restrictions
IGMP SnoopingNot supported.ExtremeXOS 21.1 or laterNo new restrictions
Unicast routing protocolsNot supported. ExtremeXOS 21.1 or laterNo new restrictions
PIM (SM, DM, SSM)Not supportedExtremeXOS 21.1 or laterNo new restrictions
PIM BidirNot supportedFutureNo new restrictions
MVRNot supportedFutureNo new restrictions
MPLSNot supportedNot supportedNo new restrictions
VPLS Service VLAN configurationNot supportedNot supportedNo new restrictions
DCBXNot supportedNot supportedNo new restrictions
ETSExtremeXOS 21.1 or laterExtremeXOS 21.1 or laterNo new restrictions
XNVNot supportedNot supportedRestricted
Private VLANs, VLAN aggregation, VLAN translationNot supportedNot supportedNo new restrictions
Identity ManagementNot supportedNot supportedRestricted
IP security (DHCP Snooping, ARP lockdown)Not supportedNot supportedNo new restrictions
802.1ag CFM and Y.1731 performance monitoringNot supportedNo supportedNo new restrictions
BFDNot supportedNot supportedNo new restrictions
AVB protocols (MVRP, gPTP, MSRP, FQTSS)Not supportedNot supportedRestricted
Layer 2 Protocol TunnelingNot supportedNot supportedNo new restrictions
NetLoginExtremeXOS 32.6 or laterNo new restrictions.No new restrictions
Priority Flow ControlNot supportedNo new restrictions. No new restrictions
Note

Note

  1. MLAG requires entire switch to move to software learning mode.
  2. MAC locking and limit learning features require software learning mode.
  3. ExtremeXOS will require that all underlay VLANs be part of the same VR. This VR can be user-created or system-created.
  4. This does not imply that VXLAN encapsulated packets will be snooped. IGMP snooping for multicast contained entirely within the operator network will work.
  5. Current hardware has no support for adding an MPLS label to a VXLAN encapsulated frame. So remote VTEPs cannot be reachable through a MPLS network.
  6. XNV dynamic VLANs, IDM role-based VLANs and MVRP require a global VLAN ID space and hence are not supported.
  7. Single-hop BFD can be configured on operator VLANs.
  8. All multicast traffic are treated as unknown.
  9. Multi-chassis Link Aggregation (MLAG) does not function if the Inter-Switch Connection (ISC) port is added to an untagged tenant VMAN.
  10. Non-Tenant VLANs/VMANs do not function if the port also has an untagged tenant VMAN.