Optimized VXLAN Replication Using Underlay Multicast

Starting with ExtremeXOS 31.2, VXLAN supports underlay multicast (multicast tunnel). This feature provides support for the following:

Head-End Replication

The default method for flooding the broadcast/unicast/multicast (BUM) traffic from VXLAN overlay to remote VTEPs is through head-end replication over VXLAN underlay. This means the originating VTEP sends a separate copy to each of the destination VTEPs over VXLAN unicast tunnel to each VTEP.

Click to expand in new window
Head-end Replication

On receiving overlay BUM traffic, VTEP 100.100.100.1 VXLAN encapsulates and sends two copies – one copy is destined to VTEP 101.101.101.1 and the other to 102.102.102.1.

Note

Note

RED VNI does not span to VTEP 103.103.103.1.

Underlay Multicast Distribution Tree

A multicast group address is assigned to a virtual network VNI. Each VTEP must use the same multicast group address for a given VNI. This must be administratively ensured.

When a VTEP discovers a remote VTEP, it learns the VNIs supported by the remote VTEP. The discovering VTEP triggers PIM (S, G) joins to the remote VTEP, for the multicast groups corresponding to the supported VNIs. As a result, a multicast distribution tree (MDT) is formed for each multicast group or each VNI.

Click to expand in new window
Underlay Multicast Distribution Tree

The RED VNI is assigned with 232.1.1.1 and GREEN VNI is assigned with 232.1.1.2. Observe the PIM joins triggered by each VTEP. The MDT for RED VNI is RED dash-tree (232.1.1.1) and the MDT for GREEN VNI is GREEN dash-tree (232.1.1.2).

The overlay BUM traffic is VXLAN encapsulated with multicast group IP (corresponding to the VNI) as the outer destination IP and sent over the MDT. At the very best scenario, the originating VTEP sends only one copy out. The replication is done en route hop-by-hop by the routers in the multicast tree present in L3 network. The routers in the L3 network must support PIM-SSM but need not be VXLAN aware.

The following figure illustrates how VTEP 100.100.100.1 VXLAN encapsulates the traffic with destination IP as 232.1.1.1 and sends one copy out. The traffic flows across the L3 network over the MDT and reaches 101.101.101.1 and 102.102.102.1:

Click to expand in new window

Automatic Group Assignment and MDT Choices

It is possible to automatically assign multicast group address for each VNI. The group address is picked from a user configured address range. The address is derived as depicted in the below figure. The group prefix is obtained by AND‘ing group address and mask. The group suffix bits come from the VXLAN network identifier (VNID).

Click to expand in new window

Using the command featured in the previous figure, it is possible to choose different variants of MDT as shown here:

  1. Each virtual network VNI can be assigned with discrete multicast group address. Meaning, each virtual network uses a dedicated MDT. The following command auto-assigns separate group address to each VNI:

    configure virtual-network multicast group 232.0.0.0 255.0.0.0

  2. Single multicast group address can be used for all virtual network VNIs. A single MDT is used for overlay BUM traffic on all VNIs. The following command auto-assigns 232.1.1.1 to all VNIs:

    configure virtual-network multicast group 232.1.1.1 255.255.255.255

  3. A combination of (1) and (2) can be used. That is, a cluster of VNIs can use one multicast group address. Another cluster can use a different multicast group address. The following command forms four cluster of VNIs and uses four shared MDTs:

    configure virtual-network multicast group 232.1.1.0 255.255.255.252

Virtual Network VNIs Shared MDT
1, 5, 9, 13, 17, and so on 232.1.1.1
2, 6, 10, 14, 18, and so on 232.1.1.2
3, 7, 11, 15, 19, and so on 232.1.1.3
4, 8, 12, 16, 20, and so on 232.1.1.0

In any of the previous options, a single VNI cannot use more than one multicast group address.

Supported Platforms

ExtremeSwitching X590, X695, and X465 series switches.

Limitations

This feature has the following limitations:
  • Supported only for overlay BUM traffic.
  • Supported only with PIM-SSM.
  • BUD node operation is not supported with MLAG.
  • Multicast group range used for this feature must not be configured/used for regular multicast traffic.
Note

Note

This feature should not be used with Assisted Replication.