The Fabric Attach (FA) client connected to bridge port extender (BPE) port sends
VLAN/NSI mappings to the FA proxy controlling bridge (CB) MLAG peers connected in cross-connect topology.
The FA proxy CB MLAG peers see their LLDP neighbor as the FA client.
When mappings are received on a BPE port, the FA proxy CB creates a dynamic
VLAN, and adds ISC port, extended port, and uplink server port to the dynamic
VLAN that matches the received VLAN/NSI mappings.
Uplink ports connected to the FA server MLAG peers on the CB MLAG peers should
be MLAG enabled.
FA server peers in following example are non-Extended Edge
Switching nodes, which can be ExtremeXOS or VSP
switches.
The FA server approves the mappings and moves the VLAN/NSI mapping to the active
state in FA database. The ExtremeXOS FA server MLAG peers act as
VXLAN VTEPs.
When creation of dynamic virtual networks is enabled (configure
virtual-network dynamic on), MLAG peers create dynamic virtual
networks for the VLAN-VNI pair that matches the VLAN/NSI(I-SID) mappings in the
FA database.
Cross-Connect MLAG Topology
Controlling Bridge 1 (FA Proxy CB1)
# show lldp ports 125:9 neighbors detailed
-----------------------------------------------------------------------------
LLDP Port 125:9 detected 1 neighbor
Neighbor: 00:04:96:9D:42:32/15, age 3 seconds
- Chassis ID type: MAC address (4)
Chassis ID : 00:04:96:9D:42:32
- Port ID type: ifName (5)
Port ID : "15"
- Time To Live: 120 seconds
- System Name: "X690-48t-2q-4c"
- System Description: "ExtremeXOS (X690-48t-2q-4c) version 30.5.0.257 30\
.5.0.257 by release-manager on Mon Nov 4 22:39:20\
EST 2019"
- Avaya/Extreme Fabric Attach element
Element Type : 5
State : 0
Management Vlan: 0
SystemId : 00:04:96:9d:42:32
Link Info : 00-01-00-0f
# show fabric attach assignments
Fabric Attach Mode: Proxy
Port VLAN VLAN Name Type ISID/NSI Status
------- ---- -------------------------------- ------- -------- --------
125:5 100 SYS_VLAN_0100 Dynamic 2800100 Active
125:5 101 SYS_VLAN_0101 Dynamic 2800101 Active
(pacman debug) Slot-1 VPEX CB1-465.12 # show fabric attach elements
Fabric Attach Mode: Proxy
Mgmt Auto
System Id Port Type VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9d-42-32-00-01-00-1f 1:1 Proxy (No Auth) None Mix Disabled
00-04-96-9a-8d-6c-00-01-00-0f 1:25 Server (No Auth) None Mix Disabled
00-04-96-9c-d4-5a-00-01-00-12 1:26 Server (No Auth) None Mix Disabled
00-04-96-9a-8d-45-00-01-00-2f 1:27 Proxy (No Auth) None Mix Disabled
00-04-96-98-a9-1a-00-01-00-11 125:5 Switch None Mix Disabled
00-04-96-9d-42-32-00-01-00-0f 125:9 Proxy (No Auth) None Mix Disabled
# show vlan 100 | include Tag
VLAN 100: show vlan SYS_VLAN_0100 | include Tag
Admin State: Enabled Tagging: 802.1Q Tag 100
Tag: *125:5F,*1:27gF,*1:25gGF
(x) VMAN Tag Translated port
(pacman debug) Slot-1 VPEX CB1-465.14 #
(pacman debug) Slot-1 VPEX CB1-465.26 # show mlag ports
Local Local Remote
MLAG Local Link Remote Peer Fail Fail
Id Port State Link Peer Status Count Count
================================================================================
20 1:25 A Up right-peer Up 0 0
10 1:28 A Up right-peer Up 0 0
================================================================================
Local Link State: A - Active, D - Disabled, R - Ready, NP - Port not present
Remote Link : Up - One or more links are active on the remote switch,
Down - No links are active on the remote switch,
N/A - The peer has not communicated link state for this MLAG port,
Virtual - MLAG peer switch does not have physical port.
Number of Multi-switch Link Aggregation Groups : 2
Convergence control : Conserve Access Lists
Reload Delay Interval : 30 seconds
Reload Delay : Disabled
Link Up Isolation : Off
27 # show mlag peer
Multi-switch Link Aggregation Peers:
MLAG Peer : right-peer
VLAN : isc Virtual Router : VR-Default
Local IP Address : 45.0.0.1 Peer IP Address : 45.0.0.2
MLAG ports : 2 Tx-Interval : 1000 ms
Checkpoint Status : Up Peer Tx-Interval : 1000 ms
Rx-Hellos : 18771 Tx-Hellos : 18772
Rx-Checkpoint Msgs: 14572 Tx-Checkpoint Msgs: 17087
Rx-Hello Errors : 0 Tx-Hello Errors : 826
Hello Timeouts : 1 Checkpoint Errors : 0
Up Time : 0d:5h:4m:33s Peer Conn.Failures: 1
Local MAC : 00:11:88:fe:f3:66 Peer MAC : 00:04:96:9a:8d:45
Config'd LACP MAC : None Current LACP MAC : 00:04:96:9a:8d:45
Authentication : None
Alternate path information: None
# show sharing
Load Sharing Monitor
Config Current Agg Min Ld Share Ld Share Agg Link Link Up
Master Master Control Active Algorithm Flags Group Mbr State Transitions
================================================================================
1:25 1:25 LACP 1 L2 A 1:25 Y A 0
L2 1:26 Y A 0
1:27 1:27 LACP 1 L2 A 1:27 Y A 0
1:28 1:28 LACP 1 L2 A 1:28 Y A 0
================================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Minimum Active: (<) Group is down. # active links less than configured minimum
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
(L3_L4) Layer 3 address and Layer 4 port based
(custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Custom Hash Seed: Switch MAC address (0x88FEF366)
Flags:
A - All: Distribute to all members,
d - Dynamically created shared port,
L - Local Slot: Distribute to members local to ingress slot,
P - Port Lists: Distribute to per-slot configurable subset of members,
R - Resilient Hashing enabled.
Number of load sharing trunks: 3
# show configuration vsm
#
# Module vsm configuration.
#
create mlag peer "right-peer"
configure mlag peer "right-peer" ipaddress 45.0.0.2 vr VR-Default
enable mlag port 1:25 peer "right-peer" id 20
enable mlag port 1:28 peer "right-peer" id 10
* (pacman debug) Slot-1 VPEX CB1-465.22 # show configuration vpex
#
# Module vpex configuration.
#
configure vpex port 1:28 slot 125
configure vpex ring rebalancing off
* (pacman debug) Slot-1 VPEX CB1-465.23 #
* (pacman debug) Slot-1 VPEX CB1-465.23 # show vpex topology
Topology: Cascade
Native cascade port 1:28
Slots: 125
Controlling Bridge1 (FA Proxy CB2)
# show fabric attach elements
Fabric Attach Mode: Proxy
Mgmt Auto
System Id Port Type VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9a-8d-6c-00-01-00-21 1:16 Server (No Auth) None Mix Disabled
00-04-96-9c-d4-5a-00-01-00-05 1:24 Server (No Auth) None Mix Disabled
00-04-96-99-9e-31-00-01-00-33 1:33 Switch None Mix Disabled
00-11-88-fe-f3-66-00-01-00-1b 1:47 Proxy (No Auth) None Mix Disabled
00-04-96-98-a9-1a-00-01-00-11 125:5 Switch None Mix Disabled
00-04-96-9d-42-32-00-01-00-0f 125:9 Proxy (No Auth) None Mix Disabled
(pacman debug) Slot-1 VPEX CB2-670.2 # show fabric attach assignments
Fabric Attach Mode: Proxy
Port VLAN VLAN Name Type ISID/NSI Status
------- ---- -------------------------------- ------- -------- --------
125:5 100 SYS_VLAN_0100 Dynamic 2800100 Active
125:5 101 SYS_VLAN_0101 Dynamic 2800101 Active
(pacman debug) Slot-1 VPEX CB2-670.3 #
(pacman debug) Slot-1 VPEX CB2-670.3 # show lldp ports 125:5 neighbors detailed
-----------------------------------------------------------------------------
LLDP Port 125:5 detected 1 neighbor
Neighbor: 00:04:96:98:A9:1A/17, age 18 seconds
- Chassis ID type: MAC address (4)
Chassis ID : 00:04:96:98:A9:1A
- Port ID type: ifName (5)
Port ID : "17"
- Time To Live: 120 seconds
- System Name: "FAClient-450G2"
- System Description: "ExtremeXOS (X450G2-24t-G4) version 30.4.0.524 30.\
4.0.524 by release-manager on Fri Oct 25 15:01:31\
EDT 2019"
- Avaya/Extreme Fabric Attach element
Element Type : 8
State : 0
Management Vlan: 0
SystemId : 00:04:96:98:a9:1a
Link Info : 00-01-00-11
- Extreme Fabric Attach NSI(I-SID)/VLAN map
Status VlanID NSI(I-SID)
------ ------ --------
2 100 2800100
2 101 2800101
# show vlan 100 | include Tag
VLAN 100: show vlan SYS_VLAN_0100 | include Tag
Admin State: Enabled Tagging: 802.1Q Tag 100
Tag: *125:5F,*1:47gF,*1:16gGF
(x) VMAN Tag Translated port
# show mlag ports
Local Local Remote
MLAG Local Link Remote Peer Fail Fail
Id Port State Link Peer Status Count Count
================================================================================
20 1:16 A Up left-peer Up 0 0
10 1:29 A Up left-peer Up 0 0
================================================================================
Local Link State: A - Active, D - Disabled, R - Ready, NP - Port not present
Remote Link : Up - One or more links are active on the remote switch,
Down - No links are active on the remote switch,
N/A - The peer has not communicated link state for this MLAG port,
Virtual - MLAG peer switch does not have physical port.
Number of Multi-switch Link Aggregation Groups : 2
Convergence control : Conserve Access Lists
Reload Delay Interval : 30 seconds
Reload Delay : Disabled
Link Up Isolation : Off
# show mlag peer
Multi-switch Link Aggregation Peers:
MLAG Peer : left-peer
VLAN : isc Virtual Router : VR-Default
Local IP Address : 45.0.0.2 Peer IP Address : 45.0.0.1
MLAG ports : 2 Tx-Interval : 1000 ms
Checkpoint Status : Up Peer Tx-Interval : 1000 ms
Rx-Hellos : 18811 Tx-Hellos : 18838
Rx-Checkpoint Msgs: 17113 Tx-Checkpoint Msgs: 14591
Rx-Hello Errors : 0 Tx-Hello Errors : 103
Hello Timeouts : 1 Checkpoint Errors : 0
Up Time : 0d:5h:5m:12s Peer Conn.Failures: 1
Local MAC : 00:04:96:9a:8d:45 Peer MAC : 00:11:88:fe:f3:66
Config'd LACP MAC : None Current LACP MAC : 00:04:96:9a:8d:45
Authentication : None
Alternate path information: None
# show sharing
Load Sharing Monitor
Config Current Agg Min Ld Share Ld Share Agg Link Link Up
Master Master Control Active Algorithm Flags Group Mbr State Transitions
================================================================================
1:16 1:16 LACP 1 L2 A 1:16 Y A 0
L2 1:24 Y A 0
1:29 1:29 LACP 1 L2 A 1:29 Y A 0
1:47 1:47 LACP 1 L2 A 1:47 Y A 0
================================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Minimum Active: (<) Group is down. # active links less than configured minimum
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
(L3_L4) Layer 3 address and Layer 4 port based
(custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Custom Hash Seed: Switch MAC address (0x969A8D45)
Flags:
A - All: Distribute to all members,
d - Dynamically created shared port,
L - Local Slot: Distribute to members local to ingress slot,
P - Port Lists: Distribute to per-slot configurable subset of members,
R - Resilient Hashing enabled.
Number of load sharing trunks: 3
# show configuration vsm
#
# Module vsm configuration.
#
create mlag peer "left-peer"
configure mlag peer "left-peer" ipaddress 45.0.0.1 vr VR-Default
enable mlag port 1:16 peer "left-peer" id 20
enable mlag port 1:29 peer "left-peer" id 10
14 # show configuration vpex
#
# Module vpex configuration.
#
configure vpex port 1:29 slot 125
configure vpex ring rebalancing off
* (pacman debug) Slot-1 VPEX CB2-670.15 #
# show vpex topology
Topology: Cascade
Native cascade port 1:29
Slots: 125
FA Server 1
# show virtual-network
Virtual Network Flags Tenant VLAN
Encap ID Encap Flags
================================================================================
SYS_VNET_02800100 --S SYS_VLAN_0100
VXLAN 2800100 LRX
SYS_VNET_02800101 --S SYS_VLAN_0101
VXLAN 2800101 LRX
================================================================================
Flags: (S) System Configured, (T) OTM Configured, (V) OVSDB Configured
Encap Flags: (L) Local Endpoints Configured,
(R) Remote Endpoints Associated,
(X) Exclude Tag
----------------------------------------
Total number of Virtual Networks : 2
Local Endpoints : 3.3.4.4 (VR-Default)
Network Ports [VXLAN] : 1-64
Dynamic Virtual Networks : On
* (CIT_30.4.0.524) FAserver2VPEX_1.215 # show fabric attach assignments
Fabric Attach Mode: Server
Port VLAN VLAN Name Type ISID/NSI Status
------- ---- -------------------------------- ------- -------- --------
5 100 SYS_VLAN_0100 Dynamic 2800100 Active
5 101 SYS_VLAN_0101 Dynamic 2800101 Active
# show fabric attach elements
Fabric Attach Mode: Server
Mgmt Auto
System Id Port Type VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9a-8d-45-00-01-00-18 5 Proxy (No Auth) None Mix Disabled
00-11-88-fe-f3-66-00-01-00-1a 18 Proxy (No Auth) None Mix Disabled
# show fdb
MAC VLAN Name( Tag) Age Flags Port / Virtual Port List
------------------------------------------------------------------------------------------------------
00:04:96:98:a9:1a SYS_VLAN_0100(0100) 0005 d m S 5
00:04:96:99:9e:43 SYS_VLAN_0100(0100) 0000 s SXE VR-Default:2.3.44.5
00:04:96:9a:8d:6c SYS_BGP_0002(4082) 0000 s m S 57
00:04:96:9a:8d:6c isc(3999) 0000 s m S 57
00:04:96:9a:8d:b8 SYS_VLAN_0100(0100) 0000 s SXE VR-Default:2.3.44.5
00:04:96:9a:8d:b8 SYS_BGP_0003(4081) 0058 d m 49
Flags : d - Dynamic, s - Static, p - Permanent, n - NetLogin, m - MAC, i - IP,
x - IPX, l - lockdown MAC, L - lockdown-timeout MAC, M- Mirror, B - Egress Blackhole,
b - Ingress Blackhole, v - MAC-Based VLAN, P - Private VLAN, T - VLAN translation,
D - drop packet, h - Hardware Aging, o - IEEE 802.1ah Backbone MAC,
S - Software Controlled Deletion, r - MSRP,
X - VXLAN, Z - OpenFlow, E - EVPN
Total: 6 Static: 4 Perm: 0 Dyn: 2 Dropped: 0 Locked: 0 Locked with Timeout: 0
FDB Aging time: 300
# show iparp
VR Destination Mac Age Static VLAN VID Port
VR-Default 50.1.1.10 00:04:96:9a:8d:b8 0 YES SYS_VLAN_0100 100 VR-Default:2.3.44.5
VR-Default 50.1.1.100 00:04:96:99:9e:43 0 YES SYS_VLAN_0100 100 VR-Default:2.3.44.5
VR-Default 2.3.44.5 00:04:96:9a:8d:b8 20 NO SYS_BGP_0003 4081 49
VR-Default 99.1.1.100 00:04:96:9a:8d:6c 20 NO isc 3999 57
FA Server 2
# show fabric attach elements
Fabric Attach Mode: Server
Mgmt Auto
System Id Port Type VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9a-8d-45-00-01-00-18 15 Proxy (No Auth) None Mix Disabled
00-04-96-9a-8d-45-00-01-00-10 33 Proxy (No Auth) None Mix Disabled
* (pacman debug) FAserver2VPEX_2.11 # show fabric attach assignments
Fabric Attach Mode: Server
Port VLAN VLAN Name Type ISID/NSI Status
------- ---- -------------------------------- ------- -------- --------
15 100 SYS_VLAN_0100 Dynamic 2800100 Active
15 101 SYS_VLAN_0101 Dynamic 2800101 Active
# show virtual-network
Virtual Network Flags Tenant VLAN
Encap ID Encap Flags
================================================================================
SYS_VNET_02800100 --S SYS_VLAN_0100
VXLAN 2800100 LRX
SYS_VNET_02800101 --S SYS_VLAN_0101
VXLAN 2800101 LRX
================================================================================
Flags: (S) System Configured, (T) OTM Configured, (V) OVSDB Configured
Encap Flags: (L) Local Endpoints Configured,
(R) Remote Endpoints Associated,
(X) Exclude Tag
----------------------------------------
Total number of Virtual Networks : 2
Local Endpoints : 3.3.4.4 (VR-Default)
Network Ports [VXLAN] : 1-64
Dynamic Virtual Networks : On
# show fdb
MAC VLAN Name( Tag) Age Flags Port / Virtual Port List
------------------------------------------------------------------------------------------------------
00:04:96:98:a9:1a SYS_VLAN_0100(0100) 0076 d m S 15
00:04:96:99:9e:43 SYS_VLAN_0100(0100) 0000 s SXE VR-Default:2.3.44.5
00:04:96:9a:8d:b8 SYS_VLAN_0100(0100) 0000 s SXE VR-Default:2.3.44.5
00:04:96:9a:8d:b8 SYS_BGP_0003(4086) 0040 d m 61
00:04:96:9c:d4:5a SYS_BGP_0002(4087) 0000 s m S 53
00:04:96:9c:d4:5a isc(3999) 0000 s m S 53
Flags : d - Dynamic, s - Static, p - Permanent, n - NetLogin, m - MAC, i - IP,
x - IPX, l - lockdown MAC, L - lockdown-timeout MAC, M- Mirror, B - Egress Blackhole,
b - Ingress Blackhole, v - MAC-Based VLAN, P - Private VLAN, T - VLAN translation,
D - drop packet, h - Hardware Aging, o - IEEE 802.1ah Backbone MAC,
S - Software Controlled Deletion, r - MSRP,
X - VXLAN, Z - OpenFlow, E - EVPN
Total: 6 Static: 4 Perm: 0 Dyn: 2 Dropped: 0 Locked: 0 Locked with Timeout: 0
FDB Aging time: 300
# show iparp
VR Destination Mac Age Static VLAN VID Port
VR-Default 50.1.1.1 00:04:96:98:a9:1a 1 NO SYS_VLAN_0100 100 15
VR-Default 50.1.1.10 00:04:96:9a:8d:b8 0 YES SYS_VLAN_0100 100 VR-Default:2.3.44.5
VR-Default 50.1.1.100 00:04:96:99:9e:43 0 YES SYS_VLAN_0100 100 VR-Default:2.3.44.5
VR-Default 2.3.44.5 00:04:96:9a:8d:b8 20 NO SYS_BGP_0003 4086 61
VR-Default 99.1.1.1 00:04:96:9c:d4:5a 20 NO isc 3999 53
Dynamic Entries : 3 Static Entries : 2
Pending Entries : 0
ARP address check: Enabled ARP refresh : Enabled
Timeout : 20 minutes ARP Sender-Mac Learning : Disabled
Locktime : 1000 milliseconds
Retransmit Time : 1000 milliseconds
Reachable Time : 900000 milliseconds (Auto)
Fast Convergence : On
ARP Global Settings
Max Entries : 21096
Max Pending Entries : 256
Max Proxy Entries : 256
