Cross-Connect MLAG Topology Configuration Example
In the following example:
- The Fabric Attach (FA) client connected to bridge port extender (BPE) port sends VLAN/NSI mappings to the FA proxy controlling bridge (CB) MLAG peers connected in cross-connect topology.
- The FA proxy CB MLAG peers see their LLDP neighbor as the FA client.
- When mappings are received on a BPE port, the FA proxy CB creates a dynamic VLAN, and adds ISC port, extended port, and uplink server port to the dynamic VLAN that matches the received VLAN/NSI mappings.
- Uplink ports connected to the FA server MLAG peers on the CB MLAG peers should be MLAG enabled.
- FA server peers in following example are non-Extended Edge Switching nodes, which can be ExtremeXOS or VSP switches.
- The FA server approves the mappings and moves the VLAN/NSI mapping to the active state in FA database. The ExtremeXOS FA server MLAG peers act as VXLAN VTEPs.
- When creation of dynamic virtual networks is enabled (configure virtual-network dynamic on), MLAG peers create dynamic virtual networks for the VLAN-VNI pair that matches the VLAN/NSI(I-SID) mappings in the FA database.
Cross-Connect MLAG Topology
Controlling Bridge 1 (FA Proxy CB1)
# show lldp ports 125:9 neighbors detailed
-----------------------------------------------------------------------------
LLDP Port 125:9 detected 1 neighbor
Neighbor: 00:04:96:9D:42:32/15, age 3 seconds
- Chassis ID type: MAC address (4)
Chassis ID : 00:04:96:9D:42:32
- Port ID type: ifName (5)
Port ID : "15"
- Time To Live: 120 seconds
- System Name: "X690-48t-2q-4c"
- System Description: "ExtremeXOS (X690-48t-2q-4c) version 30.5.0.257 30\
.5.0.257 by release-manager on Mon Nov 4 22:39:20\
EST 2019"
- Avaya/Extreme Fabric Attach element
Element Type : 5
State : 0
Management Vlan: 0
SystemId : 00:04:96:9d:42:32
Link Info : 00-01-00-0f
# show fabric attach assignments
Fabric Attach Mode: Proxy
Port VLAN VLAN Name Type ISID/NSI Status
------- ---- -------------------------------- ------- -------- --------
125:5 100 SYS_VLAN_0100 Dynamic 2800100 Active
125:5 101 SYS_VLAN_0101 Dynamic 2800101 Active
(pacman debug) Slot-1 VPEX CB1-465.12 # show fabric attach elements
Fabric Attach Mode: Proxy
Mgmt Auto
System Id Port Type VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9d-42-32-00-01-00-1f 1:1 Proxy (No Auth) None Mix Disabled
00-04-96-9a-8d-6c-00-01-00-0f 1:25 Server (No Auth) None Mix Disabled
00-04-96-9c-d4-5a-00-01-00-12 1:26 Server (No Auth) None Mix Disabled
00-04-96-9a-8d-45-00-01-00-2f 1:27 Proxy (No Auth) None Mix Disabled
00-04-96-98-a9-1a-00-01-00-11 125:5 Switch None Mix Disabled
00-04-96-9d-42-32-00-01-00-0f 125:9 Proxy (No Auth) None Mix Disabled
# show vlan 100 | include Tag
VLAN 100: show vlan SYS_VLAN_0100 | include Tag
Admin State: Enabled Tagging: 802.1Q Tag 100
Tag: *125:5F,*1:27gF,*1:25gGF
(x) VMAN Tag Translated port
(pacman debug) Slot-1 VPEX CB1-465.14 #
(pacman debug) Slot-1 VPEX CB1-465.26 # show mlag ports
Local Local Remote
MLAG Local Link Remote Peer Fail Fail
Id Port State Link Peer Status Count Count
================================================================================
20 1:25 A Up right-peer Up 0 0
10 1:28 A Up right-peer Up 0 0
================================================================================
Local Link State: A - Active, D - Disabled, R - Ready, NP - Port not present
Remote Link : Up - One or more links are active on the remote switch,
Down - No links are active on the remote switch,
N/A - The peer has not communicated link state for this MLAG port,
Virtual - MLAG peer switch does not have physical port.
Number of Multi-switch Link Aggregation Groups : 2
Convergence control : Conserve Access Lists
Reload Delay Interval : 30 seconds
Reload Delay : Disabled
Link Up Isolation : Off
27 # show mlag peer Multi-switch Link Aggregation Peers: MLAG Peer : right-peer VLAN : isc Virtual Router : VR-Default Local IP Address : 45.0.0.1 Peer IP Address : 45.0.0.2 MLAG ports : 2 Tx-Interval : 1000 ms Checkpoint Status : Up Peer Tx-Interval : 1000 ms Rx-Hellos : 18771 Tx-Hellos : 18772 Rx-Checkpoint Msgs: 14572 Tx-Checkpoint Msgs: 17087 Rx-Hello Errors : 0 Tx-Hello Errors : 826 Hello Timeouts : 1 Checkpoint Errors : 0 Up Time : 0d:5h:4m:33s Peer Conn.Failures: 1 Local MAC : 00:11:88:fe:f3:66 Peer MAC : 00:04:96:9a:8d:45 Config'd LACP MAC : None Current LACP MAC : 00:04:96:9a:8d:45 Authentication : None Alternate path information: None
# show sharing
Load Sharing Monitor
Config Current Agg Min Ld Share Ld Share Agg Link Link Up
Master Master Control Active Algorithm Flags Group Mbr State Transitions
================================================================================
1:25 1:25 LACP 1 L2 A 1:25 Y A 0
L2 1:26 Y A 0
1:27 1:27 LACP 1 L2 A 1:27 Y A 0
1:28 1:28 LACP 1 L2 A 1:28 Y A 0
================================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Minimum Active: (<) Group is down. # active links less than configured minimum
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
(L3_L4) Layer 3 address and Layer 4 port based
(custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Custom Hash Seed: Switch MAC address (0x88FEF366)
Flags:
A - All: Distribute to all members,
d - Dynamically created shared port,
L - Local Slot: Distribute to members local to ingress slot,
P - Port Lists: Distribute to per-slot configurable subset of members,
R - Resilient Hashing enabled.
Number of load sharing trunks: 3
# show configuration vsm
#
# Module vsm configuration.
#
create mlag peer "right-peer"
configure mlag peer "right-peer" ipaddress 45.0.0.2 vr VR-Default
enable mlag port 1:25 peer "right-peer" id 20
enable mlag port 1:28 peer "right-peer" id 10
* (pacman debug) Slot-1 VPEX CB1-465.22 # show configuration vpex
#
# Module vpex configuration.
#
configure vpex port 1:28 slot 125
configure vpex ring rebalancing off
* (pacman debug) Slot-1 VPEX CB1-465.23 #
* (pacman debug) Slot-1 VPEX CB1-465.23 # show vpex topology
Topology: Cascade
Native cascade port 1:28
Slots: 125
Controlling Bridge1 (FA Proxy CB2)
# show fabric attach elements
Fabric Attach Mode: Proxy
Mgmt Auto
System Id Port Type VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9a-8d-6c-00-01-00-21 1:16 Server (No Auth) None Mix Disabled
00-04-96-9c-d4-5a-00-01-00-05 1:24 Server (No Auth) None Mix Disabled
00-04-96-99-9e-31-00-01-00-33 1:33 Switch None Mix Disabled
00-11-88-fe-f3-66-00-01-00-1b 1:47 Proxy (No Auth) None Mix Disabled
00-04-96-98-a9-1a-00-01-00-11 125:5 Switch None Mix Disabled
00-04-96-9d-42-32-00-01-00-0f 125:9 Proxy (No Auth) None Mix Disabled
(pacman debug) Slot-1 VPEX CB2-670.2 # show fabric attach assignments
Fabric Attach Mode: Proxy
Port VLAN VLAN Name Type ISID/NSI Status
------- ---- -------------------------------- ------- -------- --------
125:5 100 SYS_VLAN_0100 Dynamic 2800100 Active
125:5 101 SYS_VLAN_0101 Dynamic 2800101 Active
(pacman debug) Slot-1 VPEX CB2-670.3 #
(pacman debug) Slot-1 VPEX CB2-670.3 # show lldp ports 125:5 neighbors detailed
-----------------------------------------------------------------------------
LLDP Port 125:5 detected 1 neighbor
Neighbor: 00:04:96:98:A9:1A/17, age 18 seconds
- Chassis ID type: MAC address (4)
Chassis ID : 00:04:96:98:A9:1A
- Port ID type: ifName (5)
Port ID : "17"
- Time To Live: 120 seconds
- System Name: "FAClient-450G2"
- System Description: "ExtremeXOS (X450G2-24t-G4) version 30.4.0.524 30.\
4.0.524 by release-manager on Fri Oct 25 15:01:31\
EDT 2019"
- Avaya/Extreme Fabric Attach element
Element Type : 8
State : 0
Management Vlan: 0
SystemId : 00:04:96:98:a9:1a
Link Info : 00-01-00-11
- Extreme Fabric Attach NSI(I-SID)/VLAN map
Status VlanID NSI(I-SID)
------ ------ --------
2 100 2800100
2 101 2800101
# show vlan 100 | include Tag
VLAN 100: show vlan SYS_VLAN_0100 | include Tag
Admin State: Enabled Tagging: 802.1Q Tag 100
Tag: *125:5F,*1:47gF,*1:16gGF
(x) VMAN Tag Translated port
# show mlag ports
Local Local Remote
MLAG Local Link Remote Peer Fail Fail
Id Port State Link Peer Status Count Count
================================================================================
20 1:16 A Up left-peer Up 0 0
10 1:29 A Up left-peer Up 0 0
================================================================================
Local Link State: A - Active, D - Disabled, R - Ready, NP - Port not present
Remote Link : Up - One or more links are active on the remote switch,
Down - No links are active on the remote switch,
N/A - The peer has not communicated link state for this MLAG port,
Virtual - MLAG peer switch does not have physical port.
Number of Multi-switch Link Aggregation Groups : 2
Convergence control : Conserve Access Lists
Reload Delay Interval : 30 seconds
Reload Delay : Disabled
Link Up Isolation : Off
# show mlag peer Multi-switch Link Aggregation Peers: MLAG Peer : left-peer VLAN : isc Virtual Router : VR-Default Local IP Address : 45.0.0.2 Peer IP Address : 45.0.0.1 MLAG ports : 2 Tx-Interval : 1000 ms Checkpoint Status : Up Peer Tx-Interval : 1000 ms Rx-Hellos : 18811 Tx-Hellos : 18838 Rx-Checkpoint Msgs: 17113 Tx-Checkpoint Msgs: 14591 Rx-Hello Errors : 0 Tx-Hello Errors : 103 Hello Timeouts : 1 Checkpoint Errors : 0 Up Time : 0d:5h:5m:12s Peer Conn.Failures: 1 Local MAC : 00:04:96:9a:8d:45 Peer MAC : 00:11:88:fe:f3:66 Config'd LACP MAC : None Current LACP MAC : 00:04:96:9a:8d:45 Authentication : None Alternate path information: None
# show sharing
Load Sharing Monitor
Config Current Agg Min Ld Share Ld Share Agg Link Link Up
Master Master Control Active Algorithm Flags Group Mbr State Transitions
================================================================================
1:16 1:16 LACP 1 L2 A 1:16 Y A 0
L2 1:24 Y A 0
1:29 1:29 LACP 1 L2 A 1:29 Y A 0
1:47 1:47 LACP 1 L2 A 1:47 Y A 0
================================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Minimum Active: (<) Group is down. # active links less than configured minimum
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
(L3_L4) Layer 3 address and Layer 4 port based
(custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Custom Hash Seed: Switch MAC address (0x969A8D45)
Flags:
A - All: Distribute to all members,
d - Dynamically created shared port,
L - Local Slot: Distribute to members local to ingress slot,
P - Port Lists: Distribute to per-slot configurable subset of members,
R - Resilient Hashing enabled.
Number of load sharing trunks: 3
# show configuration vsm # # Module vsm configuration. # create mlag peer "left-peer" configure mlag peer "left-peer" ipaddress 45.0.0.1 vr VR-Default enable mlag port 1:16 peer "left-peer" id 20 enable mlag port 1:29 peer "left-peer" id 10
14 # show configuration vpex # # Module vpex configuration. # configure vpex port 1:29 slot 125 configure vpex ring rebalancing off * (pacman debug) Slot-1 VPEX CB2-670.15 #
# show vpex topology
Topology: Cascade
Native cascade port 1:29
Slots: 125
FA Server 1
# show virtual-network
Virtual Network Flags Tenant VLAN
Encap ID Encap Flags
================================================================================
SYS_VNET_02800100 --S SYS_VLAN_0100
VXLAN 2800100 LRX
SYS_VNET_02800101 --S SYS_VLAN_0101
VXLAN 2800101 LRX
================================================================================
Flags: (S) System Configured, (T) OTM Configured, (V) OVSDB Configured
Encap Flags: (L) Local Endpoints Configured,
(R) Remote Endpoints Associated,
(X) Exclude Tag
----------------------------------------
Total number of Virtual Networks : 2
Local Endpoints : 3.3.4.4 (VR-Default)
Network Ports [VXLAN] : 1-64
Dynamic Virtual Networks : On
* (CIT_30.4.0.524) FAserver2VPEX_1.215 # show fabric attach assignments
Fabric Attach Mode: Server
Port VLAN VLAN Name Type ISID/NSI Status
------- ---- -------------------------------- ------- -------- --------
5 100 SYS_VLAN_0100 Dynamic 2800100 Active
5 101 SYS_VLAN_0101 Dynamic 2800101 Active
# show fabric attach elements
Fabric Attach Mode: Server
Mgmt Auto
System Id Port Type VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9a-8d-45-00-01-00-18 5 Proxy (No Auth) None Mix Disabled
00-11-88-fe-f3-66-00-01-00-1a 18 Proxy (No Auth) None Mix Disabled
# show fdb MAC VLAN Name( Tag) Age Flags Port / Virtual Port List ------------------------------------------------------------------------------------------------------ 00:04:96:98:a9:1a