EVPN with eBGP Between Leaf and Spine Configuration Example

EVPN with eBGP between leaf and spine. Spines are on a dedicated ASn, Each leaf is on separate ASn. MLAG peers share ASn.

Configuration Notes

Configure and apply IP Anycast on leafs (see IP and MAC Anycast, and configure IP address on tenant VLAN and enable IP forwarding.

EVI with manual RT is configured. Here is an example:

create bgp EVPN instance evi_1 
configure bgp EVPN instance evi_1 VXLAN vni 100 
create bgp EVPN instance evi_2 
configure bgp EVPN instance evi_2 VXLAN vni 200 
configure bgp EVPN instance evi_1 route-target both add 100:100 
configure bgp EVPN instance evi_2 route-target both add 200:200

MLAG peers share the same LTEP IP, ASNUM, but use different BGP router IDs.
BGP adjacency between MLAG peers is recommended for alternate path. (additional L3 VLAN between MLAG peers).
OSPF routes are exported to BGP on Spine1.
eBGP between leaf and spines. MLAG peers use ASNUM 10000; spines use ASNUM 20000; Leaf 3 uses ASNUM 30000.
Allow-as-in on leaf nodes (VTEPs). This is to ensure EVPN routes from other leaf nodes are not dropped due to BGP split horizon (ASPATH present in route).
BGP fast-external-fallover is enabled on all nodes.
Spines are configured with “next-hop-unchanged” for L2VPN-EVPN routes.
Static LACP MAC is configured on MLAG peers.
BGP maximum paths is set to 2 for this topology and IP route sharing is enabled.
ARP suppression is enabled on tenant VLANs.

Note

On SLX and other platforms “retain route-targets” should be enabled on spine/transit L3 nodes. ExtremeXOS by default retains all RTs and does not have a command to turn it off.

Leaf 1

#
# Module vlan configuration.
#
configure vlan default delete ports all
configure vr VR-Default delete ports 1-36
configure vr VR-Default add ports 1-36
configure vlan default delete ports 1,4-5,7,16,19,21
enable jumbo-frame ports all
create vlan "isc"
configure vlan isc tag 4000
create vlan "loop"
enable loopback-mode vlan loop
create vlan "mlagvtep"
enable loopback-mode vlan mlagvtep
create vlan "tenant"
configure vlan tenant tag 10
configure vlan tenant suppress arp-only
create vlan "trunk1_2"
configure vlan trunk1_2 tag 4001
create vlan "trunk1_3"
create vlan "trunk1_4"
create vlan "untagtenant"
configure vlan untagtenant suppress arp-only
configure ports 1 auto off speed 10000 duplex full
configure ports 2 auto off speed 10000 duplex full
configure ports 3 auto off speed 10000 duplex full
configure ports 4 auto off speed 10000 duplex full
configure ports 5 auto off speed 10000 duplex full
configure ports 6 auto off speed 10000 duplex full
configure ports 7 auto off speed 10000 duplex full
configure ports 8 auto off speed 10000 duplex full
configure ports 9 auto off speed 10000 duplex full
configure ports 10 auto off speed 10000 duplex full
configure ports 11 auto off speed 10000 duplex full
configure ports 12 auto off speed 10000 duplex full
configure ports 13 auto off speed 10000 duplex full
configure ports 14 auto off speed 10000 duplex full
configure ports 15 auto off speed 10000 duplex full
configure ports 16 auto off speed 10000 duplex full
configure ports 17 auto off speed 10000 duplex full
configure ports 18 auto off speed 10000 duplex full
configure ports 19 auto off speed 10000 duplex full
configure ports 20 auto off speed 10000 duplex full
configure ports 21 auto off speed 10000 duplex full
configure ports 22 auto off speed 10000 duplex full
configure ports 23 auto off speed 10000 duplex full
configure ports 24 auto off speed 10000 duplex full
configure ports 26 auto off speed 10000 duplex full
configure ports 27 auto off speed 10000 duplex full
configure ports 28 auto off speed 10000 duplex full
enable sharing 1 grouping 1 algorithm address-based L2 lacp
configure vlan Default add ports 2-3,6,8-15,17-18,20,22-36 untagged
configure vlan isc add ports 21 tagged
configure vlan tenant add ports 1,16,21 tagged
configure vlan trunk1_2 add ports 21 tagged
configure vlan trunk1_3 add ports 5 untagged
configure vlan trunk1_4 add ports 7 untagged
configure vlan untagtenant add ports 1,16,21 untagged
configure vlan isc ipaddress 172.16.1.0 255.255.255.254
configure vlan loop ipaddress 1.1.1.1 255.255.255.255
enable ipforwarding vlan loop
configure vlan Mgmt ipaddress 10.127.16.27 255.255.255.0
configure vlan mlagvtep ipaddress 1.1.1.200 255.255.255.255
enable ipforwarding vlan mlagvtep
configure vlan tenant ipaddress 10.1.100.100 255.255.255.0
enable ipforwarding vlan tenant
configure vlan trunk1_2 ipaddress 192.168.5.0 255.255.255.254
enable ipforwarding vlan trunk1_2
configure vlan trunk1_3 ipaddress 192.168.1.0 255.255.255.254
enable ipforwarding vlan trunk1_3
configure vlan trunk1_4 ipaddress 192.168.2.0 255.255.255.254
enable ipforwarding vlan trunk1_4
configure vlan untagtenant ipaddress 20.1.100.100 255.255.255.0
enable ipforwarding vlan untagtenant

#
# Module mcmgr configuration.
#
disable igmp snooping vlan "tenant"
disable igmp snooping vlan "untagtenant"

#
# Module vsm configuration.
#
create mlag peer "leaf2"
configure mlag peer "leaf2" ipaddress 172.16.1.1 vr VR-Default
configure mlag peer "leaf2" lacp-mac 00:00:de:ad:be:ef
enable mlag port 1 peer "leaf2" id 1

#
# Module bgp configuration.
#
configure bgp AS-number 10000
configure bgp routerid 1.1.1.1
configure bgp maximum-paths 2
enable bgp fast-external-fallover
configure bgp add network 1.1.1.1/32
configure bgp add network 1.1.1.200/32
create bgp neighbor 192.168.1.1 remote-AS-number 20000
enable bgp neighbor 192.168.1.1
create bgp neighbor 192.168.2.1 remote-AS-number 20000
enable bgp neighbor 192.168.2.1
create bgp neighbor 192.168.5.1 remote-AS-number 10000
enable bgp neighbor 192.168.5.1
configure bgp neighbor 192.168.1.1 allowas-in max-as-occurrence 3
enable bgp neighbor 192.168.1.1 capability l2vpn-EVPN
configure bgp neighbor 192.168.2.1 allowas-in max-as-occurrence 3
enable bgp neighbor 192.168.2.1 capability l2vpn-EVPN
configure bgp neighbor 192.168.5.1 allowas-in max-as-occurrence 3
enable bgp neighbor 192.168.5.1 capability l2vpn-EVPN
enable bgp export direct address-family ipv4-unicast
enable bgp
create bgp EVPN instance evi_1
configure bgp EVPN instance evi_1 VXLAN vni 100
create bgp EVPN instance evi_2
configure bgp EVPN instance evi_2 VXLAN vni 200
configure bgp EVPN instance evi_1 route-target both add 100:100
configure bgp EVPN instance evi_2 route-target both add 200:200
#
# Module otm configuration.
#
configure virtual-network local-endpoint ipaddress 1.1.1.200 vr "VR-Default"
create virtual-network "vni1" flooding standard
configure virtual-network "vni1" VXLAN vni 100
configure virtual-network "vni1" add vlan tenant
create virtual-network "vni2" flooding standard
configure virtual-network "vni2" VXLAN vni 200
configure virtual-network "vni2" add vlan untagtenant

Leaf 2

#
# Module vlan configuration.
#
configure vlan default delete ports all
configure vr VR-Default delete ports 1-72
configure vr VR-Default add ports 1-72
configure vlan default delete ports 1-72
enable jumbo-frame ports all
create vlan "isc"
configure vlan isc tag 4000
create vlan "loop"
enable loopback-mode vlan loop
create vlan "loop2"
enable loopback-mode vlan loop2
create vlan "mlagvtep"
enable loopback-mode vlan mlagvtep
create vlan "tenant"
configure vlan tenant tag 10
configure vlan tenant suppress arp-only
create vlan "trunk1_2"
configure vlan trunk1_2 tag 4001
create vlan "trunk2_3"
create vlan "trunk2_4"
create vlan "untagtenant"
configure vlan untagtenant suppress arp-only
configure ports 50 auto off speed 10000 duplex full
configure ports 51 auto off speed 10000 duplex full
configure ports 52 auto off speed 10000 duplex full
enable sharing 53 grouping 53-56 algorithm address-based L2 lacp
configure vlan isc add ports 66 tagged
configure vlan tenant add ports 4-5,53,66 tagged
configure vlan trunk1_2 add ports 66 tagged
configure vlan trunk2_3 add ports 57 untagged
configure vlan trunk2_4 add ports 49 untagged
configure vlan untagtenant add ports 4-5,53,66 untagged
configure vlan isc ipaddress 172.16.1.1 255.255.255.254
configure vlan loop ipaddress 2.2.2.2 255.255.255.255
enable ipforwarding vlan loop
configure vlan loop2 ipaddress 2.2.2.100 255.255.255.255
enable ipforwarding vlan loop2
configure vlan Mgmt ipaddress 10.127.16.19 255.255.255.0
configure vlan mlagvtep ipaddress 1.1.1.200 255.0.0.0
enable ipforwarding vlan mlagvtep
configure vlan tenant ipaddress 10.1.100.100 255.255.255.0
enable ipforwarding vlan tenant
configure vlan trunk1_2 ipaddress 192.168.5.1 255.255.255.254
enable ipforwarding vlan trunk1_2
configure vlan trunk2_3 ipaddress 192.168.3.0 255.255.255.254
enable ipforwarding vlan trunk2_3
configure vlan trunk2_4 ipaddress 192.168.4.0 255.255.255.254
enable ipforwarding vlan trunk2_4
configure vlan untagtenant ipaddress 20.1.100.100 255.255.255.0
enable ipforwarding vlan untagtenant
#
# Module mcmgr configuration.
#
disable igmp snooping vlan "tenant"
disable igmp snooping vlan "untagtenant"


#
# Module otm configuration.
#
configure virtual-network local-endpoint ipaddress 1.1.1.200 vr "VR-Default"
create virtual-network "vni1" flooding standard
configure virtual-network "vni1" VXLAN vni 100
configure virtual-network "vni1" add vlan tenant
create virtual-network "vni2" flooding standard
configure virtual-network "vni2" VXLAN vni 200
configure virtual-network "vni2" add vlan untagtenant

#
# Module bgp configuration.
#
#
configure bgp AS-number 10000
configure bgp routerid 2.2.2.2
configure bgp maximum-paths 2
enable bgp fast-external-fallover
configure bgp add network 1.1.1.200/32
configure bgp add network 2.2.2.2/32
create bgp neighbor 192.168.3.1 remote-AS-number 20000
enable bgp neighbor 192.168.3.1
create bgp neighbor 192.168.4.1 remote-AS-number 20000
enable bgp neighbor 192.168.4.1
create bgp neighbor 192.168.5.0 remote-AS-number 10000
enable bgp neighbor 192.168.5.0
configure bgp neighbor 192.168.3.1 allowas-in max-as-occurrence 3
enable bgp neighbor 192.168.3.1 capability l2vpn-EVPN
configure bgp neighbor 192.168.4.1 allowas-in max-as-occurrence 3
enable bgp neighbor 192.168.4.1 capability l2vpn-EVPN
configure bgp neighbor 192.168.5.0 allowas-in max-as-occurrence 3
enable bgp neighbor 192.168.5.0 capability l2vpn-EVPN
enable bgp export direct address-family ipv4-unicast
enable bgp
create bgp EVPN instance evi_1
configure bgp EVPN instance evi_1 VXLAN vni 100
create bgp EVPN instance evi_2
configure bgp EVPN instance evi_2 VXLAN vni 200
configure bgp EVPN instance evi_1 route-target both add 100:100
configure bgp EVPN instance evi_2 route-target both add 200:200
# Module vrrp configuration.
#
create vrrp vlan tenant vrid 1
configure vrrp vlan tenant vrid 1 priority 255
create vrrp vlan untagtenant vrid 1
configure vrrp vlan untagtenant vrid 1 priority 255
configure vrrp vlan tenant vrid 1 add 10.1.100.100
configure vrrp vlan untagtenant vrid 1 add 20.1.100.100
enable vrrp vlan tenant vrid 1
enable vrrp vlan untagtenant vrid 1

#
# Module vsm configuration.
#
create mlag peer "leaf1"
configure mlag peer "leaf1" ipaddress 172.16.1.0 vr VR-Default
configure mlag peer "leaf1" lacp-mac 00:00:de:ad:be:ef
enable mlag port 53 peer "leaf1" id 1

Leaf 3

#
# Module vlan configuration.
#
configure vlan default delete ports all
configure vr VR-Default delete ports 1-56
configure vr VR-Default add ports 1-56
configure vlan default delete ports 1,50-51
enable jumbo-frame ports all
create vlan "leaf3_trunk1"
create vlan "leaf3_trunk2"
create vlan "loop"
enable loopback-mode vlan loop
create vlan "tenant"
configure vlan tenant tag 10
configure vlan tenant suppress arp-only
create vlan "untagtenant"
configure vlan untagtenant suppress arp-only
configure ports 49 auto off speed 10000 duplex full
configure ports 50 auto off speed 10000 duplex full
configure ports 51 auto off speed 10000 duplex full
configure ports 52 auto off speed 10000 duplex full
configure ports 54 auto off speed 10000 duplex full
configure ports 55 auto off speed 10000 duplex full
configure ports 56 auto off speed 10000 duplex full
configure vlan Default add ports 2-49,52-56 untagged
configure vlan leaf3_trunk1 add ports 51 untagged
configure vlan leaf3_trunk2 add ports 50 untagged
configure vlan tenant add ports 1 tagged
configure vlan untagtenant add ports 1 untagged
configure vlan leaf3_trunk1 ipaddress 192.168.6.0 255.255.255.254
enable ipforwarding vlan leaf3_trunk1
configure vlan leaf3_trunk2 ipaddress 192.168.7.0 255.255.255.254
enable ipforwarding vlan leaf3_trunk2
configure vlan loop ipaddress 5.5.5.5 255.255.255.255
enable ipforwarding vlan loop
configure vlan Mgmt ipaddress 10.127.16.17 255.255.255.0
configure vlan tenant ipaddress 10.1.100.100 255.255.255.0
enable ipforwarding vlan tenant
configure vlan untagtenant ipaddress

# Module mcmgr configuration.
#
disable igmp snooping vlan "tenant"
disable igmp snooping vlan "untagtenant"

#
# Module otm configuration.
#
configure virtual-network local-endpoint ipaddress 5.5.5.5 vr "VR-Default"
create virtual-network "vni1" flooding standard
configure virtual-network "vni1" VXLAN vni 100
configure virtual-network "vni1" add vlan tenant
create virtual-network "vni2" flooding standard
configure virtual-network "vni2" VXLAN vni 200
configure virtual-network "vni2" add vlan untagtenant

#
# Module bgp configuration.
#
configure bgp AS-number 30000
configure bgp routerid 5.5.5.5
configure bgp maximum-paths 2
enable bgp fast-external-fallover
configure bgp restart both
configure bgp add network 5.5.5.5/32
create bgp neighbor 192.168.6.1 remote-AS-number 20000
enable bgp neighbor 192.168.6.1
create bgp neighbor 192.168.7.1 remote-AS-number 20000
enable bgp neighbor 192.168.7.1
configure bgp neighbor 192.168.6.1 allowas-in max-as-occurrence 3
enable bgp neighbor 192.168.6.1 capability l2vpn-EVPN
configure bgp neighbor 192.168.7.1 allowas-in max-as-occurrence 3
enable bgp neighbor 192.168.7.1 capability l2vpn-EVPN
enable bgp
create bgp EVPN instance evi_1
configure bgp EVPN instance evi_1 VXLAN vni 100
create bgp EVPN instance evi_2
configure bgp EVPN instance evi_2 VXLAN vni 200
configure bgp EVPN instance evi_1 route-target both add 100:100
configure bgp EVPN instance evi_2 route-target both add 200:200
#
# Module vrrp configuration.
#
create vrrp vlan tenant vrid 1
configure vrrp vlan tenant vrid 1 priority 255
create vrrp vlan untagtenant vrid 1
configure vrrp vlan untagtenant vrid 1 priority 255
configure vrrp vlan tenant vrid 1 add 10.1.100.100
configure vrrp vlan untagtenant vrid 1 add 20.1.100.100
enable vrrp vlan tenant vrid 1
enable vrrp vlan untagtenant vrid 1

Spine 1

configure vlan default delete ports all
configure vr VR-Default delete ports 1-128
configure vr VR-Default add ports 1-128
configure vlan default delete ports 33,57,89,105
enable jumbo-frame ports all
create vlan "leaf3_trunk1"
create vlan "loop"
enable loopback-mode vlan loop
create vlan "routed"
configure vlan routed tag 4030
create vlan "trunk1_3"
create vlan "trunk2_3"
configure vlan Default add ports 1-32,34-56,58-88,90-104,106-128 untagged
configure vlan leaf3_trunk1 add ports 89 untagged
configure vlan routed add ports 33 tagged
configure vlan trunk1_3 add ports 57 untagged
configure vlan trunk2_3 add ports 105 untagged
configure vlan leaf3_trunk1 ipaddress 192.168.6.1 255.255.255.254
enable ipforwarding vlan leaf3_trunk1
configure vlan loop ipaddress 3.3.3.100 255.0.0.0
enable ipforwarding vlan loop
configure vlan Mgmt ipaddress 10.127.16.24 255.255.255.0
configure vlan routed ipaddress 172.16.1.1 255.255.255.0
enable ipforwarding vlan routed
configure vlan trunk1_3 ipaddress 192.168.1.1 255.255.255.254
enable ipforwarding vlan trunk1_3
configure vlan trunk2_3 ipaddress 192.168.3.1 255.255.255.254
enable ipforwarding vlan trunk2_3

#
# Module bgp configuration.
#
#
configure bgp AS-number 20000
configure bgp routerid 3.3.3.3
configure bgp maximum-paths 2
enable bgp fast-external-fallover
create bgp neighbor 192.168.1.0 remote-AS-number 10000
enable bgp neighbor 192.168.1.0
create bgp neighbor 192.168.3.0 remote-AS-number 10000
enable bgp neighbor 192.168.3.0
create bgp neighbor 192.168.6.0 remote-AS-number 30000
enable bgp neighbor 192.168.6.0
enable bgp neighbor 192.168.1.0 capability l2vpn-EVPN
enable bgp neighbor 192.168.1.0 address-family l2vpn-EVPN next-hop-unchanged
enable bgp neighbor 192.168.3.0 capability l2vpn-EVPN
enable bgp neighbor 192.168.3.0 address-family l2vpn-EVPN next-hop-unchanged
enable bgp neighbor 192.168.6.0 capability l2vpn-EVPN
enable bgp neighbor 192.168.6.0 address-family l2vpn-EVPN next-hop-unchanged
enable bgp export ospf-extern1 address-family ipv4-unicast
enable bgp export ospf-extern2 address-family ipv4-unicast
enable bgp export ospf-inter address-family ipv4-unicast
enable bgp export ospf-intra address-family ipv4-unicast
enable bgp
# Module ospf configuration.
#
enable ospf
configure ospf add vlan routed area 0.0.0.0

Spine 2

#
# Module vlan configuration.
#
configure vlan default delete ports all
configure vr VR-Default delete ports 1-64
configure vr VR-Default add ports 1-64
configure vlan default delete ports 25,27,49
create vlan "leaf3_trunk2"
create vlan "loop"
enable loopback-mode vlan loop
create vlan "trunk1_4"
create vlan "trunk2_4"
configure ports 1 auto off speed 10000 duplex full
configure ports 2 auto off speed 10000 duplex full
configure ports 3 auto off speed 10000 duplex full
configure ports 4 auto off speed 10000 duplex full
configure ports 5 auto off speed 10000 duplex full
configure ports 6 auto off speed 10000 duplex full
configure ports 7 auto off speed 10000 duplex full
configure ports 8 auto off speed 10000 duplex full
configure ports 9 auto off speed 10000 duplex full
configure ports 10 auto off speed 10000 duplex full
configure ports 11 auto off speed 10000 duplex full
configure ports 12 auto off speed 10000 duplex full
configure ports 13 auto off speed 10000 duplex full
configure ports 14 auto off speed 10000 duplex full
configure ports 15 auto off speed 10000 duplex full
configure ports 16 auto off speed 10000 duplex full
configure ports 17 auto off speed 10000 duplex full
configure ports 18 auto off speed 10000 duplex full
configure ports 19 auto off speed 10000 duplex full
configure ports 20 auto off speed 10000 duplex full
configure ports 21 auto off speed 10000 duplex full
configure ports 22 auto off speed 10000 duplex full
configure ports 23 auto off speed 10000 duplex full
configure ports 24 auto off speed 10000 duplex full
configure ports 25 auto off speed 10000 duplex full
configure ports 26 auto off speed 10000 duplex full
configure ports 27 auto off speed 10000 duplex full
configure ports 28 auto off speed 10000 duplex full
configure ports 29 auto off speed 10000 duplex full
configure ports 30 auto off speed 10000 duplex full
configure ports 31 auto off speed 10000 duplex full
configure ports 32 auto off speed 10000 duplex full
configure ports 33 auto off speed 10000 duplex full
configure ports 34 auto off speed 10000 duplex full
configure ports 35 auto off speed 10000 duplex full
configure ports 36 auto off speed 10000 duplex full
configure ports 37 auto off speed 10000 duplex full
configure ports 38 auto off speed 10000 duplex full
configure ports 39 auto off speed 10000 duplex full
configure ports 40 auto off speed 10000 duplex full
configure ports 41 auto off speed 10000 duplex full
configure ports 42 auto off speed 10000 duplex full
configure ports 43 auto off speed 10000 duplex full
configure ports 44 auto off speed 10000 duplex full
configure ports 45 auto off speed 10000 duplex full
configure ports 46 auto off speed 10000 duplex full
configure ports 47 auto off speed 10000 duplex full
configure ports 48 auto off speed 10000 duplex full
configure vlan Default add ports 1-24,26,28-48,50-64 untagged
configure vlan leaf3_trunk2 add ports 25 untagged
configure vlan trunk1_4 add ports 27 untagged
configure vlan trunk2_4 add ports 49 untagged
configure vlan leaf3_trunk2 ipaddress 192.168.7.1 255.255.255.254
enable ipforwarding vlan leaf3_trunk2
configure vlan loop ipaddress 4.4.4.4 255.255.255.255
enable ipforwarding vlan loop
configure vlan Mgmt ipaddress 10.127.13.10 255.255.255.0
configure vlan trunk1_4 ipaddress 192.168.2.1 255.255.255.254
enable ipforwarding vlan trunk1_4
configure vlan trunk2_4 ipaddress 192.168.4.1 255.255.255.254
enable ipforwarding vlan trunk2_4
#
# Module bgp configuration.
#
configure bgp AS-number 20000
configure bgp routerid 4.4.4.4
configure bgp maximum-paths 2
enable bgp fast-external-fallover
configure bgp add network 3.3.3.100/32
configure bgp add network 4.4.4.4/32
create bgp neighbor 192.168.2.0 remote-AS-number 10000
enable bgp neighbor 192.168.2.0
create bgp neighbor 192.168.4.0 remote-AS-number 10000
enable bgp neighbor 192.168.4.0
create bgp neighbor 192.168.7.0 remote-AS-number 30000
enable bgp neighbor 192.168.7.0
enable bgp neighbor 192.168.2.0 capability l2vpn-EVPN
enable bgp neighbor 192.168.2.0 address-family l2vpn-EVPN next-hop-unchanged
enable bgp neighbor 192.168.4.0 capability l2vpn-EVPN
enable bgp neighbor 192.168.4.0 address-family l2vpn-EVPN next-hop-unchanged
enable bgp neighbor 192.168.7.0 capability l2vpn-EVPN
enable bgp neighbor 192.168.7.0 address-family l2vpn-EVPN next-hop-unchanged
enable bgp export ospf-extern1 address-family ipv4-unicast
enable bgp export ospf-extern2 address-family ipv4-unicast
enable bgp

Verification

Verify BGP Adjacency

Leaf1.21 # show bgp neighbor

     Peer                                    AS         Weight State        InMsgs OutMsgs(InQ)  Up/Down
------------------------------------------------------------------------------------------------------------
Ee-- 192.168.1.1                             20000      1      ESTABLISHED  45     62    (0    ) 0:0:08:40
Ee-- 192.168.2.1                             20000      1      ESTABLISHED  27     74    (0    ) 0:0:08:50
Ie-- 192.168.5.1                             10000      1      ESTABLISHED  57     60    (0    ) 0:0:08:35

Leaf2.10 # show bgp neighbor

     Peer                                    AS         Weight State        InMsgs OutMsgs(InQ)  Up/Down
------------------------------------------------------------------------------------------------------------
Ee-- 192.168.3.1                             20000      1      ESTABLISHED  75     64    (0    ) 0:0:09:08
Ee-- 192.168.4.1                             20000      1      ESTABLISHED  64     77    (0    ) 0:0:09:01
Ie-- 192.168.5.0                             10000      1      ESTABLISHED  61     58    (0    ) 0:0:09:04

Leaf3.11 # show bgp neighbor

     Peer                                    AS         Weight State        InMsgs OutMsgs(InQ)  Up/Down
------------------------------------------------------------------------------------------------------------
Ee-- 192.168.6.1                             20000      1      ESTABLISHED  57     36    (0    ) 0:0:09:22
Ee-- 192.168.7.1                             20000      1      ESTABLISHED  50     73    (0    ) 0:0:09:14

Spine1.2 # show bgp neighbor

     Peer                                    AS         Weight State        InMsgs OutMsgs(InQ)  Up/Down
------------------------------------------------------------------------------------------------------------
Ee-- 192.168.1.0                             10000      1      ESTABLISHED  63     46    (0    ) 0:0:09:36
Ee-- 192.168.3.0                             10000      1      ESTABLISHED  64     76    (0    ) 0:0:09:35
Ee-- 192.168.6.0                             30000      1      ESTABLISHED  37     57    (0    ) 0:0:09:35

Flags: (d) disabled, (e) enabled, (E) external peer, (I) internal peer
       (m) EBGP multihop, (r) route reflector client

BGP Peer Statistics
  Total Peers       : 3
  EBGP Peers        : 3                 IBGP Peers          : 0
  RR Client         : 0                 EBGP Multihop       : 0
  Enabled           : 3                 Disabled            : 0

Spine2.14 # show bgp neighbor

     Peer                                    AS         Weight State        InMsgs OutMsgs(InQ)  Up/Down
------------------------------------------------------------------------------------------------------------
Ee-- 192.168.2.0                             10000      1      ESTABLISHED  234    186   (0    ) 0:0:10:00
Ee-- 192.168.4.0                             10000      1      ESTABLISHED  218    244   (0    ) 0:0:09:42
Ee-- 192.168.7.0                             30000      1      ESTABLISHED  146    134   (0    ) 0:0:09:41

Flags: (d) disabled, (e) enabled, (E) external peer, (I) internal peer
       (m) EBGP multihop, (r) route reflector client

BGP Peer Statistics
  Total Peers       : 3
  EBGP Peers        : 3                 IBGP Peers          : 0
  RR Client         : 0                 EBGP Multihop       : 0
  Enabled           : 3                 Disabled            : 0

Verify Type 2 MAC Routes

Leaf1.5 # show bgp EVPN mac
Src EVI-Idx MAC               BGP Next Hop           VNI ESI                            ESI-Port   In Use Sequence
--- ------- ----------------- --------------- ---------- ------------------------------ ---------- ------ --------
R        10 00:00:00:1c:7e:60 3.3.3.100              100                                           Yes
R        10 00:00:00:47:ce:72 5.5.5.5                100                                           Yes
L        10 00:00:0b:cb:21:a4                        100                                           Yes
L        10 00:00:0c:14:88:4b                        100                                           Yes
L        10 00:00:0c:34:c1:ed                        100                                           Yes
L        10 00:04:96:9d:42:32                        100                                           Yes
L        10 00:04:96:a3:fb:b0                        100                                           Yes
R        10 00:11:88:ff:04:74 5.5.5.5                100                                           Yes
L      4087 00:00:00:1c:7e:5f                        200                                           Yes
R      4087 00:00:00:1c:7e:61 3.3.3.100              200                                           Yes
R      4087 00:00:00:47:ce:73 5.5.5.5                200                                           Yes
L      4087 00:00:04:d6:4d:6e                        200                                           Yes
L      4087 00:00:04:d6:4d:6f                        200                                           Yes
L      4087 00:04:96:9d:42:32                        200                                           Yes
L      4087 00:04:96:a3:fb:b0                        200                                           Yes
R      4087 00:11:88:ff:04:74 5.5.5.5                200                                           Yes

Src: (L) Local, (R) Remote
In Use: Yes/No - Indicates if entry is installed in MAC forwarding database.

Total MAC/IP entries displayed: 16

Leaf2.5 # show bgp EVPN mac
Src EVI-Idx MAC               BGP Next Hop           VNI ESI                            ESI-Port   In Use Sequence
--- ------- ----------------- --------------- ---------- ------------------------------ ---------- ------ --------
R        10 00:00:00:1c:7e:60 3.3.3.100              100                                           Yes
R        10 00:00:00:47:ce:72 5.5.5.5                100                                           Yes
L        10 00:00:0b:cb:21:a4                        100                                           Yes
L        10 00:00:0c:14:88:4b                        100                                           Yes
L        10 00:00:0c:34:c1:ed                        100                                           Yes
L        10 00:04:96:9d:42:32                        100                                           Yes
L        10 00:04:96:a3:fb:b0                        100                                           Yes
R        10 00:11:88:ff:04:74 5.5.5.5                100                                           Yes
L      4088 00:00:00:1c:7e:5f                        200                                           Yes
R      4088 00:00:00:1c:7e:61 3.3.3.100              200                                           Yes
R      4088 00:00:00:47:ce:73 5.5.5.5                200                                           Yes
L      4088 00:00:04:d6:4d:6e                        200                                           Yes
L      4088 00:00:04:d6:4d:6f                        200                                           Yes
L      4088 00:04:96:9d:42:32                        200                                           Yes
L      4088 00:04:96:a3:fb:b0                        200                                           Yes
R      4088 00:11:88:ff:04:74 5.5.5.5                200                                           Yes

Src: (L) Local, (R) Remote
In Use: Yes/No - Indicates if entry is installed in MAC forwarding database.

Total MAC/IP entries displayed: 16
Leaf3.12 #  show bgp EVPN mac
Src EVI-Idx MAC               BGP Next Hop           VNI ESI                            ESI-Port   In Use Sequence
--- ------- ----------------- --------------- ---------- ------------------------------ ---------- ------ --------
R        10 00:00:00:1c:7e:60 3.3.3.100              100                                           Yes
L        10 00:00:00:47:ce:72                        100                                           Yes
R        10 00:00:0b:cb:21:a4 1.1.1.200              100                                           Yes
R        10 00:00:0c:14:88:4b 1.1.1.200              100                                           Yes
R        10 00:00:0c:34:c1:ed 1.1.1.200              100                                           Yes
R        10 00:04:96:9d:42:32 1.1.1.200              100                                           Yes
R        10 00:04:96:a3:fb:b0 1.1.1.200              100                                           Yes
L        10 00:11:88:ff:04:74                        100                                           Yes
R      4090 00:00:00:1c:7e:5f 1.1.1.200              200                                           Yes
R      4090 00:00:00:1c:7e:5f 1.1.1.200              200                                           Yes
R      4090 00:00:00:1c:7e:61 3.3.3.100              200                                           Yes
L      4090 00:00:00:47:ce:73                        200                                           Yes
R      4090 00:00:04:d6:4d:6e 1.1.1.200              200                                           Yes
R      4090 00:00:04:d6:4d:6e 1.1.1.200              200                                           Yes
R      4090 00:00:04:d6:4d:6f 1.1.1.200              200                                           Yes
R      4090 00:00:04:d6:4d:6f 1.1.1.200              200                                           Yes
R      4090 00:04:96:9d:42:32 1.1.1.200              200                                           Yes
R      4090 00:04:96:9d:42:32 1.1.1.200              200                                           Yes
R      4090 00:04:96:a3:fb:b0 1.1.1.200              200                                           Yes
R      4090 00:04:96:a3:fb:b0 1.1.1.200              200                                           Yes
L      4090 00:11:88:ff:04:74                        200                                           Yes

Src: (L) Local, (R) Remote
In Use: Yes/No - Indicates if entry is installed in MAC forwarding database.

Total MAC/IP entries displayed: 21

Spine1.7 # show bgp EVPN mac
Src EVI-Idx MAC               BGP Next Hop           VNI ESI                            ESI-Port   In Use Sequence
--- ------- ----------------- --------------- ---------- ------------------------------ ---------- ------ --------
L        10 00:00:00:1c:7e:60                        100                                           Yes
R        10 00:00:00:47:ce:72 5.5.5.5                100                                           Yes
R        10 00:00:0b:cb:21:a4 1.1.1.200              100                                           Yes
R        10 00:00:0c:14:88:4b 1.1.1.200              100                                           Yes
R        10 00:00:0c:34:c1:ed 1.1.1.200              100                                           Yes
R        10 00:04:96:9d:42:32 1.1.1.200              100                                           Yes
R        10 00:04:96:a3:fb:b0 1.1.1.200              100                                           Yes
R        10 00:11:88:ff:04:74 5.5.5.5                100                                           Yes
R      4091 00:00:00:1c:7e:5f 1.1.1.200              200                                           Yes
R      4091 00:00:00:1c:7e:5f 1.1.1.200              200                                           Yes
L      4091 00:00:00:1c:7e:61                        200                                           Yes
R      4091 00:00:00:47:ce:73 5.5.5.5                200                                           Yes
R      4091 00:00:04:d6:4d:6e 1.1.1.200              200                                           Yes
R      4091 00:00:04:d6:4d:6e 1.1.1.200              200                                           Yes
R      4091 00:00:04:d6:4d:6f 1.1.1.200              200                                           Yes
R      4091 00:00:04:d6:4d:6f 1.1.1.200              200                                           Yes
R      4091 00:04:96:9d:42:32 1.1.1.200              200                                           Yes
R      4091 00:04:96:9d:42:32 1.1.1.200              200                                           Yes
R      4091 00:04:96:a3:fb:b0 1.1.1.200              200                                           Yes
R      4091 00:04:96:a3:fb:b0 1.1.1.200              200                                           Yes
R      4091 00:11:88:ff:04:74 5.5.5.5                200                                           Yes

Src: (L) Local, (R) Remote
In Use: Yes/No - Indicates if entry is installed in MAC forwarding database.

Total MAC/IP entries displayed: 21

Verify Type 2 IPv4 Routes

Leaf1.6 # show bgp EVPN ipv4
Src EVI-Idx Destination     MAC               BGP Next Hop           VNI ESI                            ESI-Port   In Use
--- ------- --------------- ----------------- --------------- ---------- ------------------------------ ---------- ------
R        10 10.1.100.3      00:00:00:1c:7e:60 3.3.3.100              100                                           Yes
R        10 10.1.100.6      00:00:00:47:ce:72 5.5.5.5                100                                           Yes
L        10 10.1.100.1      00:00:0b:cb:21:a4                        100                                           Yes
L        10 10.1.100.5      00:00:0c:14:88:4b                        100                                           Yes
L        10 10.1.100.100    00:04:96:a3:fb:b0                        100                                           Yes
R        10 10.1.100.100    00:11:88:ff:04:74 5.5.5.5                100                                           Yes
L      4087 20.1.100.5      00:00:00:1c:7e:5f                        200                                           Yes
R      4087 20.1.100.3      00:00:00:1c:7e:61 3.3.3.100              200                                           Yes
R      4087 20.1.100.6      00:00:00:47:ce:73 5.5.5.5                200                                           Yes
L      4087 20.1.100.1      00:00:04:d6:4d:6e                        200                                           Yes
L      4087 20.1.100.2      00:00:04:d6:4d:6f                        200                                           Yes
L      4087 20.1.100.100    00:04:96:a3:fb:b0                        200                                           Yes
R      4087 20.1.100.100    00:11:88:ff:04:74 5.5.5.5                200                                           Yes

Src: (L) Local, (R) Remote
In Use: Yes/No - Indicates if entry is installed in IP ARP cache.

Total MAC/IP entries displayed: 13

Leaf2.6 # show bgp EVPN ipv4
Src EVI-Idx Destination     MAC               BGP Next Hop           VNI ESI                            ESI-Port   In Use
--- ------- --------------- ----------------- --------------- ---------- ------------------------------ ---------- ------
R        10 10.1.100.3      00:00:00:1c:7e:60 3.3.3.100              100                                           Yes
R        10 10.1.100.6      00:00:00:47:ce:72 5.5.5.5                100                                           Yes
L        10 10.1.100.1      00:00:0b:cb:21:a4                        100                                           Yes
L        10 10.1.100.5      00:00:0c:14:88:4b                        100                                           Yes
L        10 10.1.100.2      00:00:0c:34:c1:ed                        100                                           Yes
L        10 10.1.100.100    00:04:96:9d:42:32                        100                                           Yes
R        10 10.1.100.100    00:11:88:ff:04:74 5.5.5.5                100                                           Yes
L      4088 20.1.100.5      00:00:00:1c:7e:5f                        200                                           Yes
R      4088 20.1.100.3      00:00:00:1c:7e:61 3.3.3.100              200                                           Yes
R      4088 20.1.100.6      00:00:00:47:ce:73 5.5.5.5                200                                           Yes
L      4088 20.1.100.1      00:00:04:d6:4d:6e                        200                                           Yes
L      4088 20.1.100.2      00:00:04:d6:4d:6f                        200                                           Yes
L      4088 20.1.100.100    00:04:96:9d:42:32                        200                                           Yes
R      4088 20.1.100.100    00:11:88:ff:04:74 5.5.5.5                200                                           Yes

Src: (L) Local, (R) Remote
In Use: Yes/No - Indicates if entry is installed in IP ARP cache.

Total MAC/IP entries displayed: 14

Leaf3.13 # show bgp EVPN ipv4
Src EVI-Idx Destination     MAC               BGP Next Hop           VNI ESI                            ESI-Port   In Use
--- ------- --------------- ----------------- --------------- ---------- ------------------------------ ---------- ------
R        10 10.1.100.3      00:00:00:1c:7e:60 3.3.3.100              100                                           Yes
L        10 10.1.100.6      00:00:00:47:ce:72                        100                                           Yes
R        10 10.1.100.1      00:00:0b:cb:21:a4 1.1.1.200              100                                           Yes
R        10 10.1.100.5      00:00:0c:14:88:4b 1.1.1.200              100                                           Yes
R        10 10.1.100.2      00:00:0c:34:c1:ed 1.1.1.200              100                                           Yes
R        10 10.1.100.100    00:04:96:9d:42:32 1.1.1.200              100                                           Yes
R        10 10.1.100.100    00:04:96:a3:fb:b0 1.1.1.200              100                                           Yes
L        10 10.1.100.100    00:11:88:ff:04:74                        100                                           Yes
R      4090 20.1.100.5      00:00:00:1c:7e:5f 1.1.1.200              200                                           Yes
R      4090 20.1.100.5      00:00:00:1c:7e:5f 1.1.1.200              200                                           Yes
R      4090 20.1.100.3      00:00:00:1c:7e:61 3.3.3.100              200                                           Yes
L      4090 20.1.100.6      00:00:00:47:ce:73                        200                                           Yes
R      4090 20.1.100.1      00:00:04:d6:4d:6e 1.1.1.200              200                                           Yes
R      4090 20.1.100.1      00:00:04:d6:4d:6e 1.1.1.200              200                                           Yes
R      4090 20.1.100.2      00:00:04:d6:4d:6f 1.1.1.200              200                                           Yes
R      4090 20.1.100.2      00:00:04:d6:4d:6f 1.1.1.200              200                                           Yes
R      4090 20.1.100.100    00:04:96:9d:42:32 1.1.1.200              200                                           Yes
R      4090 20.1.100.100    00:04:96:a3:fb:b0 1.1.1.200              200                                           Yes
L      4090 20.1.100.100    00:11:88:ff:04:74                        200                                           Yes

Src: (L) Local, (R) Remote
In Use: Yes/No - Indicates if entry is installed in IP ARP cache.

Total MAC/IP entries displayed: 19

Spine1.13 # show bgp EVPN ipv4
Src EVI-Idx Destination     MAC               BGP Next Hop           VNI ESI                            ESI-Port   In Use
--- ------- --------------- ----------------- --------------- ---------- ------------------------------ ---------- ------
L        10 10.1.100.3      00:00:00:1c:7e:60                        100                                           Yes
R        10 10.1.100.6      00:00:00:47:ce:72 5.5.5.5                100                                           Yes
R        10 10.1.100.1      00:00:0b:cb:21:a4 1.1.1.200              100                                           Yes
R        10 10.1.100.5      00:00:0c:14:88:4b 1.1.1.200              100                                           Yes
R        10 10.1.100.2      00:00:0c:34:c1:ed 1.1.1.200              100                                           Yes
R        10 10.1.100.100    00:04:96:9d:42:32 1.1.1.200              100                                           Yes
R        10 10.1.100.100    00:04:96:a3:fb:b0 1.1.1.200              100                                           Yes
R        10 10.1.100.100    00:11:88:ff:04:74 5.5.5.5                100                                           Yes
R      4091 20.1.100.5      00:00:00:1c:7e:5f 1.1.1.200              200                                           Yes
R      4091 20.1.100.5      00:00:00:1c:7e:5f 1.1.1.200              200                                           Yes
L      4091 20.1.100.3      00:00:00:1c:7e:61                        200                                           Yes
R      4091 20.1.100.6      00:00:00:47:ce:73 5.5.5.5                200                                           Yes
R      4091 20.1.100.1      00:00:04:d6:4d:6e 1.1.1.200              200                                           Yes
R      4091 20.1.100.1      00:00:04:d6:4d:6e 1.1.1.200              200                                           Yes
R      4091 20.1.100.2      00:00:04:d6:4d:6f 1.1.1.200              200                                           Yes
R      4091 20.1.100.2      00:00:04:d6:4d:6f 1.1.1.200              200                                           Yes
R      4091 20.1.100.100    00:04:96:9d:42:32 1.1.1.200              200                                           Yes
R      4091 20.1.100.100    00:04:96:a3:fb:b0 1.1.1.200              200                                           Yes
R      4091 20.1.100.100    00:11:88:ff:04:74 5.5.5.5                200                                           Yes

Src: (L) Local, (R) Remote
In Use: Yes/No - Indicates if entry is installed in IP ARP cache.

Total MAC/IP entries displayed: 19

Verify ARP and FDB Entries

Leaf1.7 # show iparp
VR            Destination      Mac                Age  Static  VLAN          VID   Port
VR-Default    10.1.100.1       00:00:0b:cb:21:a4   17      NO  tenant        10    16
VR-Default    10.1.100.5       00:00:0c:14:88:4b    7      NO  tenant        10    1
VR-Default    10.1.100.6       00:00:00:47:ce:72    0     YES  tenant        10    VR-Default:5.5.5.5
VR-Default    192.168.1.1      00:04:96:9c:2d:24   20      NO  trunk1_3      4089  5
VR-Default    192.168.2.1      00:04:96:9b:b7:c9   20      NO  trunk1_4      4088  7
VR-Default    20.1.100.1       00:00:04:d6:4d:6e   12      NO  untagtenant   4087  16
VR-Default    20.1.100.2       00:00:04:d6:4d:6f    7      NO  untagtenant   4087  21
VR-Default    20.1.100.5       00:00:00:1c:7e:5f    7      NO  untagtenant   4087  1
VR-Default    20.1.100.6       00:00:00:47:ce:73    0     YES  untagtenant   4087  VR-Default:5.5.5.5
VR-Default    192.168.5.1      00:04:96:9d:42:32   20      NO  trunk1_2      4001  21
VR-Default    172.16.1.1       00:04:96:9d:42:32   20      NO  isc           4000  21

Dynamic Entries  :           9             Static Entries            :          2
Pending Entries  :           0

ARP address check:    Enabled              ARP refresh               :    Enabled
Timeout          :          20 minutes     ARP Sender-Mac Learning   :   Disabled
Locktime         :        1000 milliseconds
Retransmit Time  :        1000 milliseconds
Reachable Time   :      900000 milliseconds (Auto)
Fast Convergence :         Off

ARP Global Settings
Max Entries         :    12288
Max Pending Entries :      256
Max Proxy Entries   :      256

Leaf1.8 #  show fdb
MAC                                      VLAN Name( Tag)  Age  Flags          Port / Virtual Port List
------------------------------------------------------------------------------------------------------
00:00:00:1c:7e:5f                      untagtenant(4087) 0000  d mi       S   1
00:00:00:47:ce:72                           tenant(0010) 0000  s m        SXE VR-Default:5.5.5.5
00:00:00:47:ce:73                      untagtenant(4087) 0000  s m        SXE VR-Default:5.5.5.5
00:00:04:d6:4d:6e                      untagtenant(4087) 0000  d mi           16
00:00:04:d6:4d:6f                      untagtenant(4087) 0000  d mi       S   21
00:00:0b:cb:21:a4                           tenant(0010) 0000  d mi           16
00:00:0c:14:88:4b                           tenant(0010) 0000  d mi       S   1
00:00:0c:34:c1:ed                           tenant(0010) 0078  d m        S   21
00:04:96:9b:b7:c9                         trunk1_4(4088) 0000  d mi           7
00:04:96:9c:2d:24                         trunk1_3(4089) 0000  d mi           5
00:04:96:9d:42:32                           tenant(0010) 0000  s m        S   21
00:04:96:9d:42:32                      untagtenant(4087) 0000  s m        S   21
00:04:96:9d:42:32                         trunk1_2(4001) 0000  s m        S   21
00:04:96:9d:42:32                              isc(4000) 0000  s m        S   21
00:11:88:ff:04:74                           tenant(0010) 0000  s m        SXE VR-Default:5.5.5.5
00:11:88:ff:04:74