Cross-Connect MLAG Topology Configuration Example

In the following example:
Click to expand in new window
Cross-Connect MLAG Topology

Controlling Bridge 1 (FA Proxy CB1)

# show lldp ports 125:9 neighbors detailed 

-----------------------------------------------------------------------------
LLDP Port 125:9 detected 1 neighbor
  Neighbor: 00:04:96:9D:42:32/15, age 3 seconds
   - Chassis ID type: MAC address (4)
      Chassis ID     : 00:04:96:9D:42:32
    - Port ID type: ifName (5)
      Port ID     : "15"
    - Time To Live: 120 seconds
    - System Name: "X690-48t-2q-4c"
    - System Description: "ExtremeXOS (X690-48t-2q-4c) version 30.5.0.257 30\
                           .5.0.257 by release-manager on Mon Nov 4 22:39:20\
                            EST 2019"
    - Avaya/Extreme Fabric Attach element
      Element Type   : 5
      State          : 0
      Management Vlan: 0
      SystemId       : 00:04:96:9d:42:32
      Link Info      : 00-01-00-0f
# show fabric attach assignments 
Fabric Attach Mode: Proxy
Port     VLAN  VLAN Name                         Type     ISID/NSI  Status
-------  ----  --------------------------------  -------  --------  --------
125:5     100  SYS_VLAN_0100                     Dynamic   2800100  Active  
125:5     101  SYS_VLAN_0101                     Dynamic   2800101  Active  
(pacman debug) Slot-1 VPEX CB1-465.12 # show fabric attach elements 
Fabric Attach Mode: Proxy
                                                       Mgmt     Auto
System Id                     Port    Type             VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9d-42-32-00-01-00-1f 1:1     Proxy (No Auth)  None Mix Disabled      
00-04-96-9a-8d-6c-00-01-00-0f 1:25    Server (No Auth) None Mix Disabled      
00-04-96-9c-d4-5a-00-01-00-12 1:26    Server (No Auth) None Mix Disabled      
00-04-96-9a-8d-45-00-01-00-2f 1:27    Proxy (No Auth)  None Mix Disabled      
00-04-96-98-a9-1a-00-01-00-11 125:5   Switch           None Mix Disabled      
00-04-96-9d-42-32-00-01-00-0f 125:9   Proxy (No Auth)  None Mix Disabled      
# show vlan 100 | include Tag
VLAN 100: show vlan SYS_VLAN_0100 | include Tag
    Admin State:         Enabled     Tagging:   802.1Q Tag 100 
       Tag:   *125:5F,*1:27gF,*1:25gGF
                  (x) VMAN Tag Translated port
(pacman debug) Slot-1 VPEX CB1-465.14 #
(pacman debug) Slot-1 VPEX CB1-465.26 # show mlag ports 

                Local                                             Local   Remote 
MLAG    Local   Link     Remote                           Peer    Fail    Fail   
Id      Port    State    Link    Peer                     Status  Count   Count  
================================================================================ 
20      1:25    A        Up      right-peer               Up          0       0
10      1:28    A        Up      right-peer               Up          0       0
================================================================================ 
Local Link State: A - Active, D - Disabled, R - Ready, NP - Port not present
Remote Link     : Up - One or more links are active on the remote switch,
                  Down - No links are active on the remote switch,
                  N/A - The peer has not communicated link state for this MLAG port,
                  Virtual - MLAG peer switch does not have physical port.

Number of Multi-switch Link Aggregation Groups  : 2
Convergence control                             : Conserve Access Lists
Reload Delay Interval                           : 30 seconds
Reload Delay                                    : Disabled
Link Up Isolation                               : Off
27 # show mlag peer 
Multi-switch Link Aggregation Peers:

MLAG Peer         : right-peer
VLAN              : isc                    Virtual Router    : VR-Default  
Local IP Address  : 45.0.0.1               Peer IP Address   : 45.0.0.2    
MLAG ports        : 2                      Tx-Interval       : 1000 ms
Checkpoint Status : Up                     Peer Tx-Interval  : 1000 ms
Rx-Hellos         : 18771                  Tx-Hellos         : 18772       
Rx-Checkpoint Msgs: 14572                  Tx-Checkpoint Msgs: 17087       
Rx-Hello Errors   : 0                      Tx-Hello Errors   : 826         
Hello Timeouts    : 1                      Checkpoint Errors : 0           
Up Time           : 0d:5h:4m:33s           Peer Conn.Failures: 1           
Local MAC         : 00:11:88:fe:f3:66      Peer MAC          : 00:04:96:9a:8d:45
Config'd LACP MAC : None                   Current LACP MAC  : 00:04:96:9a:8d:45
Authentication    : None                   

Alternate path information: None
# show sharing 
Load Sharing Monitor
Config    Current Agg     Min    Ld Share        Ld Share  Agg Link  Link Up
Master    Master  Control Active Algorithm Flags Group     Mbr State Transitions
================================================================================
  1:25   1:25     LACP       1    L2        A     1:25      Y     A       0
                                  L2              1:26      Y     A       0
  1:27   1:27     LACP       1    L2        A     1:27      Y     A       0
  1:28   1:28     LACP       1    L2        A     1:28      Y     A       0
================================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Minimum Active: (<) Group is down. # active links less than configured minimum
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
                        (L3_L4) Layer 3 address and Layer 4 port based
                        (custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Custom Hash Seed: Switch MAC address (0x88FEF366)
Flags:
    A - All: Distribute to all members,
    d - Dynamically created shared port,
    L - Local Slot: Distribute to members local to ingress slot,
    P - Port Lists: Distribute to per-slot configurable subset of members,
    R - Resilient Hashing enabled.
Number of load sharing trunks: 3
# show configuration vsm 
#
# Module vsm configuration.
#
create mlag peer "right-peer" 
configure mlag peer "right-peer" ipaddress 45.0.0.2 vr VR-Default 
enable mlag port 1:25 peer "right-peer" id 20 
enable mlag port 1:28 peer "right-peer" id 10 
* (pacman debug) Slot-1 VPEX CB1-465.22 # show configuration vpex 
#
# Module vpex configuration.
#
configure vpex port 1:28 slot 125
configure vpex ring rebalancing off
* (pacman debug) Slot-1 VPEX CB1-465.23 # 
* (pacman debug) Slot-1 VPEX CB1-465.23 # show vpex topology 

Topology: Cascade
  Native cascade port 1:28     
    Slots: 125

Controlling Bridge1 (FA Proxy CB2)

# show fabric attach elements 
Fabric Attach Mode: Proxy
                                                       Mgmt     Auto
System Id                     Port    Type             VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9a-8d-6c-00-01-00-21 1:16    Server (No Auth) None Mix Disabled      
00-04-96-9c-d4-5a-00-01-00-05 1:24    Server (No Auth) None Mix Disabled      
00-04-96-99-9e-31-00-01-00-33 1:33    Switch           None Mix Disabled      
00-11-88-fe-f3-66-00-01-00-1b 1:47    Proxy (No Auth)  None Mix Disabled      
00-04-96-98-a9-1a-00-01-00-11 125:5   Switch           None Mix Disabled      
00-04-96-9d-42-32-00-01-00-0f 125:9   Proxy (No Auth)  None Mix Disabled      
(pacman debug) Slot-1 VPEX CB2-670.2 # show fabric attach assignments 
Fabric Attach Mode: Proxy
Port     VLAN  VLAN Name                         Type     ISID/NSI  Status
-------  ----  --------------------------------  -------  --------  --------
125:5     100  SYS_VLAN_0100                     Dynamic   2800100  Active  
125:5     101  SYS_VLAN_0101                     Dynamic   2800101  Active  
(pacman debug) Slot-1 VPEX CB2-670.3 # 
(pacman debug) Slot-1 VPEX CB2-670.3 # show lldp ports 125:5 neighbors detailed 

-----------------------------------------------------------------------------
LLDP Port 125:5 detected 1 neighbor
  Neighbor: 00:04:96:98:A9:1A/17, age 18 seconds
    - Chassis ID type: MAC address (4)
      Chassis ID     : 00:04:96:98:A9:1A
    - Port ID type: ifName (5)
      Port ID     : "17"
    - Time To Live: 120 seconds
    - System Name: "FAClient-450G2"
    - System Description: "ExtremeXOS (X450G2-24t-G4) version 30.4.0.524 30.\
                           4.0.524 by release-manager on Fri Oct 25 15:01:31\
                            EDT 2019"
    - Avaya/Extreme Fabric Attach element
      Element Type   : 8
      State          : 0
      Management Vlan: 0
      SystemId       : 00:04:96:98:a9:1a
      Link Info      : 00-01-00-11

    - Extreme Fabric Attach NSI(I-SID)/VLAN map
    Status  VlanID  NSI(I-SID)
    ------  ------  --------
         2     100    2800100
         2     101    2800101
# show vlan 100 | include Tag
VLAN 100: show vlan SYS_VLAN_0100 | include Tag
    Admin State:         Enabled     Tagging:   802.1Q Tag 100 
       Tag:   *125:5F,*1:47gF,*1:16gGF
                  (x) VMAN Tag Translated port
# show mlag ports 

                Local                                             Local   Remote 
MLAG    Local   Link     Remote                           Peer    Fail    Fail   
Id      Port    State    Link    Peer                     Status  Count   Count  
================================================================================ 
20      1:16    A        Up      left-peer                Up          0       0
10      1:29    A        Up      left-peer                Up          0       0
================================================================================ 
Local Link State: A - Active, D - Disabled, R - Ready, NP - Port not present
Remote Link     : Up - One or more links are active on the remote switch,
                  Down - No links are active on the remote switch,
                  N/A - The peer has not communicated link state for this MLAG port,
                  Virtual - MLAG peer switch does not have physical port.

Number of Multi-switch Link Aggregation Groups  : 2
Convergence control                             : Conserve Access Lists
Reload Delay Interval                           : 30 seconds
Reload Delay                                    : Disabled
Link Up Isolation                               : Off
# show mlag peer 
Multi-switch Link Aggregation Peers:

MLAG Peer         : left-peer
VLAN              : isc                    Virtual Router    : VR-Default  
Local IP Address  : 45.0.0.2               Peer IP Address   : 45.0.0.1    
MLAG ports        : 2                      Tx-Interval       : 1000 ms
Checkpoint Status : Up                     Peer Tx-Interval  : 1000 ms
Rx-Hellos         : 18811                  Tx-Hellos         : 18838       
Rx-Checkpoint Msgs: 17113                  Tx-Checkpoint Msgs: 14591       
Rx-Hello Errors   : 0                      Tx-Hello Errors   : 103         
Hello Timeouts    : 1                      Checkpoint Errors : 0           
Up Time           : 0d:5h:5m:12s           Peer Conn.Failures: 1           
Local MAC         : 00:04:96:9a:8d:45      Peer MAC          : 00:11:88:fe:f3:66
Config'd LACP MAC : None                   Current LACP MAC  : 00:04:96:9a:8d:45
Authentication    : None                   

Alternate path information: None
# show sharing 
Load Sharing Monitor
Config    Current Agg     Min    Ld Share        Ld Share  Agg Link  Link Up
Master    Master  Control Active Algorithm Flags Group     Mbr State Transitions
================================================================================
  1:16   1:16     LACP       1    L2        A     1:16      Y     A       0
                                  L2              1:24      Y     A       0
  1:29   1:29     LACP       1    L2        A     1:29      Y     A       0
  1:47   1:47     LACP       1    L2        A     1:47      Y     A       0
================================================================================
Link State: A-Active, D-Disabled, R-Ready, NP-Port not present, L-Loopback
Minimum Active: (<) Group is down. # active links less than configured minimum
Load Sharing Algorithm: (L2) Layer 2 address based, (L3) Layer 3 address based
                        (L3_L4) Layer 3 address and Layer 4 port based
                        (custom) User-selected address-based configuration
Custom Algorithm Configuration: ipv4 L3-and-L4, xor
Custom Hash Seed: Switch MAC address (0x969A8D45)
Flags:
    A - All: Distribute to all members,
    d - Dynamically created shared port,
    L - Local Slot: Distribute to members local to ingress slot,
    P - Port Lists: Distribute to per-slot configurable subset of members,
    R - Resilient Hashing enabled.
Number of load sharing trunks: 3
# show configuration vsm 
#
# Module vsm configuration.
#
create mlag peer "left-peer" 
configure mlag peer "left-peer" ipaddress 45.0.0.1 vr VR-Default 
enable mlag port 1:16 peer "left-peer" id 20 
enable mlag port 1:29 peer "left-peer" id 10 
14 # show configuration vpex
#
# Module vpex configuration.
#
configure vpex port 1:29 slot 125
configure vpex ring rebalancing off
* (pacman debug) Slot-1 VPEX CB2-670.15 # 
# show vpex topology 

Topology: Cascade
  Native cascade port 1:29     
    Slots: 125

FA Server 1

# show virtual-network 
Virtual Network                      Flags     Tenant VLAN                      
              Encap       ID     Encap Flags         
================================================================================
SYS_VNET_02800100                    --S       SYS_VLAN_0100                    
              VXLAN    2800100   LRX                 
SYS_VNET_02800101                    --S       SYS_VLAN_0101                    
              VXLAN    2800101   LRX                 
================================================================================
Flags: (S) System Configured, (T) OTM Configured, (V) OVSDB Configured 
Encap Flags: (L) Local Endpoints Configured,
       (R) Remote Endpoints Associated,
       (X) Exclude Tag
----------------------------------------
Total number of Virtual Networks  : 2
Local Endpoints                   : 3.3.4.4 (VR-Default)
Network Ports [VXLAN]             : 1-64
Dynamic Virtual Networks          : On
* (CIT_30.4.0.524) FAserver2VPEX_1.215 # show fabric attach assignments 
Fabric Attach Mode: Server
Port     VLAN  VLAN Name                         Type     ISID/NSI  Status
-------  ----  --------------------------------  -------  --------  --------
5         100  SYS_VLAN_0100                     Dynamic   2800100  Active  
5         101  SYS_VLAN_0101                     Dynamic   2800101  Active  
# show fabric attach elements 
Fabric Attach Mode: Server
                                                       Mgmt     Auto
System Id                     Port    Type             VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9a-8d-45-00-01-00-18 5       Proxy (No Auth)  None Mix Disabled      
00-11-88-fe-f3-66-00-01-00-1a 18      Proxy (No Auth)  None Mix Disabled      
# show fdb 
MAC                                      VLAN Name( Tag)  Age  Flags          Port / Virtual Port List
------------------------------------------------------------------------------------------------------
00:04:96:98:a9:1a                    SYS_VLAN_0100(0100) 0005  d m        S   5
00:04:96:99:9e:43                    SYS_VLAN_0100(0100) 0000  s          SXE VR-Default:2.3.44.5
00:04:96:9a:8d:6c                     SYS_BGP_0002(4082) 0000  s m        S   57
00:04:96:9a:8d:6c                              isc(3999) 0000  s m        S   57
00:04:96:9a:8d:b8                    SYS_VLAN_0100(0100) 0000  s          SXE VR-Default:2.3.44.5
00:04:96:9a:8d:b8                     SYS_BGP_0003(4081) 0058  d m            49

Flags : d - Dynamic, s - Static, p - Permanent, n - NetLogin, m - MAC, i - IP,
        x - IPX, l - lockdown MAC, L - lockdown-timeout MAC, M- Mirror, B - Egress Blackhole,
        b - Ingress Blackhole, v - MAC-Based VLAN, P - Private VLAN, T - VLAN translation,
        D - drop packet, h - Hardware Aging, o - IEEE 802.1ah Backbone MAC,
        S - Software Controlled Deletion, r - MSRP,
        X - VXLAN, Z - OpenFlow, E - EVPN

Total: 6 Static: 4  Perm: 0  Dyn: 2  Dropped: 0  Locked: 0  Locked with Timeout: 0
FDB Aging time: 300
# show iparp 
VR            Destination      Mac                Age  Static  VLAN          VID   Port
VR-Default    50.1.1.10        00:04:96:9a:8d:b8    0     YES  SYS_VLAN_0100  100   VR-Default:2.3.44.5
VR-Default    50.1.1.100       00:04:96:99:9e:43    0     YES  SYS_VLAN_0100  100   VR-Default:2.3.44.5
VR-Default    2.3.44.5         00:04:96:9a:8d:b8   20      NO  SYS_BGP_0003  4081  49
VR-Default    99.1.1.100       00:04:96:9a:8d:6c   20      NO  isc           3999  57

FA Server 2

# show fabric attach elements 
Fabric Attach Mode: Server
                                                       Mgmt     Auto
System Id                     Port    Type             VLAN Tag Provision
----------------------------- ------- ---------------- ---- --- --------------
00-04-96-9a-8d-45-00-01-00-18 15      Proxy (No Auth)  None Mix Disabled      
00-04-96-9a-8d-45-00-01-00-10 33      Proxy (No Auth)  None Mix Disabled      
* (pacman debug) FAserver2VPEX_2.11 # show fabric attach assignments 
Fabric Attach Mode: Server
Port     VLAN  VLAN Name                         Type     ISID/NSI  Status
-------  ----  --------------------------------  -------  --------  --------
15        100  SYS_VLAN_0100                     Dynamic   2800100  Active  
15        101  SYS_VLAN_0101                     Dynamic   2800101  Active  
# show virtual-network
Virtual Network                      Flags     Tenant VLAN                      
              Encap       ID     Encap Flags         
================================================================================
SYS_VNET_02800100                    --S       SYS_VLAN_0100                    
              VXLAN    2800100   LRX                 
SYS_VNET_02800101                    --S       SYS_VLAN_0101                    
              VXLAN    2800101   LRX                 
================================================================================
Flags: (S) System Configured, (T) OTM Configured, (V) OVSDB Configured 
Encap Flags: (L) Local Endpoints Configured,
       (R) Remote Endpoints Associated,
       (X) Exclude Tag
----------------------------------------
Total number of Virtual Networks  : 2
Local Endpoints                   : 3.3.4.4 (VR-Default)
Network Ports [VXLAN]             : 1-64
Dynamic Virtual Networks          : On
# show fdb
MAC                                      VLAN Name( Tag)  Age  Flags          Port / Virtual Port List
------------------------------------------------------------------------------------------------------
00:04:96:98:a9:1a                    SYS_VLAN_0100(0100) 0076  d m        S   15
00:04:96:99:9e:43                    SYS_VLAN_0100(0100) 0000  s          SXE VR-Default:2.3.44.5
00:04:96:9a:8d:b8                    SYS_VLAN_0100(0100) 0000  s          SXE VR-Default:2.3.44.5
00:04:96:9a:8d:b8                     SYS_BGP_0003(4086) 0040  d m            61
00:04:96:9c:d4:5a                     SYS_BGP_0002(4087) 0000  s m        S   53
00:04:96:9c:d4:5a                              isc(3999) 0000  s m        S   53

Flags : d - Dynamic, s - Static, p - Permanent, n - NetLogin, m - MAC, i - IP,
        x - IPX, l - lockdown MAC, L - lockdown-timeout MAC, M- Mirror, B - Egress Blackhole,
        b - Ingress Blackhole, v - MAC-Based VLAN, P - Private VLAN, T - VLAN translation,
        D - drop packet, h - Hardware Aging, o - IEEE 802.1ah Backbone MAC,
        S - Software Controlled Deletion, r - MSRP,
        X - VXLAN, Z - OpenFlow, E - EVPN

Total: 6 Static: 4  Perm: 0  Dyn: 2  Dropped: 0  Locked: 0  Locked with Timeout: 0
FDB Aging time: 300
# show iparp 
VR            Destination      Mac                Age  Static  VLAN          VID   Port
VR-Default    50.1.1.1         00:04:96:98:a9:1a    1      NO  SYS_VLAN_0100  100   15
VR-Default    50.1.1.10        00:04:96:9a:8d:b8    0     YES  SYS_VLAN_0100  100   VR-Default:2.3.44.5
VR-Default    50.1.1.100       00:04:96:99:9e:43    0     YES  SYS_VLAN_0100  100   VR-Default:2.3.44.5
VR-Default    2.3.44.5         00:04:96:9a:8d:b8   20      NO  SYS_BGP_0003  4086  61
VR-Default    99.1.1.1         00:04:96:9c:d4:5a   20      NO  isc           3999  53

Dynamic Entries  :           3             Static Entries            :          2
Pending Entries  :           0

ARP address check:    Enabled              ARP refresh               :    Enabled
Timeout          :          20 minutes     ARP Sender-Mac Learning   :   Disabled
Locktime         :        1000 milliseconds
Retransmit Time  :        1000 milliseconds
Reachable Time   :      900000 milliseconds (Auto)
Fast Convergence :          On 

ARP Global Settings
Max Entries         :    21096 
Max Pending Entries :      256 
Max Proxy Entries   :      256