Software BFD Session Support on CEP

You can configure software Bidirectional Forwarding Detection (BFD) sessions on a Cluster Edge Port (CEP) on SLX 9150 and SLX 9250 devices. The EPG Port Property shows the bfd-software-session attribute, using which you can choose a software or hardware BFD session.

BFD Session Formation with SRIOV Server

During initial state of BFD session formation with SRIOV (single-root input or output virtualization) server:
  • For MCT-1:
    • The nexthop reachability for 10.1.1.3 is via ICL.
    • It forms a software BFD session with 10.1.1.3 via ICL. It also forms a software BFD session with 10.1.1.3.
  • For MCT-2:
    • The nexthop reachability for 10.1.1.3 is via CEP port eth 0/1.
    • It forms a hardware BFD session with 10.1.1.3.

BFD Session Formation with SRIOV Server after Link Failover

During the link failover of BFD session formation with SRIOV (single-root input/output virtualization) server:
  • For MCT-1:
    • The Nexthop reachability for 10.1.1.3 changes from ICL to its CEP eth 0/1.
    • The BFD session changes from software to hardware. BFD reachability for 10.1.1.3 changes from ICL to its CEP eth 0/1.
  • For MCT-2:
    • The Nexthop reachability for 10.1.1.3 changes from CEP eth 0/1 to ICL.
    • The BFD session changes from hardware to software BFD.

BFD Session Formation with SRIOV Server

cep-bfd-session-type Automation on EPG (Endpoint Group) Port Property

XCO automates the cep-bfd-session-type on the CEP interfaces based on the logic with no additional input from the users.

SLX Hardware Type XCO: Fabric Links (Leaf to Spine) XCO: Extension EPG XCO: L3-Handoff EPG
CEP SRIOV CEP Non-SRIOV CEP
SLX 9250 Hardware Software Software Hardware
SLX 8720 Hardware Software Software Hardware
SLX 9740 and other SLX versions Hardware Hardware Hardware Hardware
(efa:root)root-2:-# efa fabric show
Fabric Name: default, Fabric Description: Default Fabric, Fabric Stage: 3, Fabric Type: clos, Fabric Status: created
+--------+-----+-----+-----+------+-------+------+-----------+--------+-----+----+
| IP     | POD | HOST| ASN | ROLE | DEVICE| APP  | CONFIG GEN| PENDING| VTLB| LB |
| ADDRESS|     | NAME|     |      | STATE | STATE| REASON    | CONFIGS| ID  | ID |
+--------+-----+-----+-----+------+-------+------+-----------+--------+-----+----+

Fabric Name: fs, Fabric Description: , Fabric Stage: 3, Fabric Type: clos, Fabric Status: settings-updated

Updated Fabric Settings: BGP-LL

+-------------+---+------+-------+------+---------------------+------------+------------+---------------+---------+---+
| IP ADDRESS  |POD| HOST | ASN   | ROLE | DEVICE STATE        | APP STATE  | CONFIG GEN | PENDING       | VTLB ID | LB|
|             |   | Name |       |      |                     |            |            | REASON        | CONFIGS | ID|
+-------------+---+------+-------+------+---------------------+------------+------------+---------------+---------+---+
| 10.20.246.1 |   | SLX-1| 64512 | Spine| provisioned         | cfg in-sync| NA         | NA            | NA      | 1 |
| 10.20.246.7 |   | SLX  | 65000 | Leaf | provisioning failed | cfg ready  | IA,IU,MD,DA| SYSP-C,MCT-C  |         |   |
|             |   |      |       |      |                     |            |            | MCT-PA,BGP-C  |         |   |
|             |   |      |       |      |                     |            |            | INTIP-C,EVPN-C|         |   |
|             |   |      |       |      |                     |            |            | O-C           | 2       | 1 |
| 10.20.246.8 |   | slx-8| 65000 | Leaf | provisioned         | cfg in-sync| NA         | NA            | 2       | 1 |
+-------------+---+------+-------+------+---------------------+------------+------------+---------------+---------+---+
FABRIC SETTING:
BGPLL - BGP Dynamic Peer Listen Limit, BGP-MD5 - BGP MD5 Password , BFD-RX - Bfd Rx Timer, BFD-TX - Bfd Tx Timer, BFD-MULTIPLIER - Bfd multiplier,
BFD-ENABLE - Enable Bfd, BGP-MULTIHOP - BGP ebgp multihop, P2PLR - Point-to-Point Link Range, MCTLR - MCT Link Range, LOIP - Loopback IP Range


CONFIG GEN REASON:
LA/LD - Link Add/Delete, IA/ID/IU - Interface Add/Delete/Update, PLC/PLD/PLU - IPPrefixList Create/Delete/Update
MD/MU - MCT Delete/Update, OD/OU - Overlay Gateway Delete/Update, EU/ED - Evpn Delete/Update, PC/PD/PU - RouterPim Create/Delete/Update
DD - Dependent Device Update, DA/DR - Device Add/ReAdd, ASN - Asn Update, SYS - System Properties Update
MD5 - BGP MD5 Password, BGPU - Router BGP Update, BGPLL - BGP Listen Limit, POU - Port Channel Update, NA - Not Applicable

PENDING CONFIGS:
MCT - MCT Cluster, O - Overlay Gateway, SYSP - System Properties, INTIP - Interface IP, BGP - Router BGP
C/D/U - Create/Delete/Update, PA/PD - Port Add/Port Delete
(efa:root)root-2:-# efa tenant show
+------+---------+-------+-------+-------+------+--------+----------------------+
| Name |   Type  | VLAN  | L2VNI | L3VNI | VRF  | Enable |         Ports        | 
|      |         | Range | Range | Range | Count| BD     |                      |
+------+---------+-------+-------+-------+------+--------+----------------------+
| ten1 | Private | 11-20 |       |       | 10   | false  | 10.20.246.6[0/1-10]| |
|      |         |       |       |       |      |        | 10.20.246.5[0/1-10]| |
+------+---------+-------+-------+-------+------+--------+----------------------+

efa tenant vrf create --name ten1vrf1 --tenant ten1

EPG Create

Run the following command to create a cep-bfd-session-type automation on EPG port property:

efa tenant epg create --name ten1epg1 --tenant ten1 
   --port 10.20.246.5[0/1],10.20.246.6[0/1] 
   --switchport-mode trunk
   --vrf ten1vrf1 --ctag-range 11
   --anycast-ip 11:20.0.11.1/24 
   --local-ip 11,10.20.246.5:10.1.1.1/24 --local-ip 11,10.20.246.6:10.1.1.2/24

Example:

(efa:root)root@node-2:-# efa tenant epg show  --detail
===============================================================
Name          : ten1epg1
Tenant        : ten1
Type          : extension
State         :
Description   :

Ports         : 10.20.246.5[0/1]
              : 10.20.246.6[0/1]
POs           : 
Port Property : SwithchPort Mode    : trunk
              : Native Vlan Tagging : false
              : BFD Session Type    : Auto
NW Policy     : Ctag Range         : 11
              : VRF                : ten1vrf1
              : L3Vni              : 8192
+------+---------------+-------+-----+--------------+--------+--------------------------+------+----------------+--------------+-------------+------------+
| Ctag |     Ctag      | L2Vni | BD  | Anycast IPv4 | Anycast|         Local IP         |IPv6  |     IPv6 ND    |    IPv6 ND   |  Dev State  |  App State |
|      |  Description  |       | Name|              | IPv6   |  [Device-IP->Local-IP]   |ND Mtu| Managed Config | Other Config |             |            |
+------+---------------+-------+-----+--------------+--------+--------------------------+------+----------------+--------------+-------------+------------+
|  11  | Tenant L3     |  11   |     | 20/0.11.1/24 |        | 10.20.246.5->10.1.1.1/24 |      |      false     |     false    | provisioned | cfg-in-sync|
|      | Extended VLAN |       |     |              |        | 10.20.246.6->10.1.1.1/24 |      |                |              |             |            |  
+------+---------------+-------+-----+--------------+--------+--------------------------+------+----------------+--------------+-------------+------------+
Network Property [Flags : * - Native Vlan]
+------+----------------+--------------+----------------+--------------------+-------------+
| CTAG | IPv6 ND Prefix | No Advertise | Valid Lifetime | Preferred Lifetime | Config Type |
+------+----------------+--------------+----------------+--------------------+-------------+
IPv6 ND Prefix Flags

For 'unstable' entities, run 'efa tenant po/vrf show' for details
====================================================================================

VRF Update

Run the following command to update a tenant VRF on the static route BFD:

efa tenant vrf update --name ten1vrf1 --tenant ten1 
        --operation static-route-bfd-add 
        --ipv4-static-route-bfd 10.20.246.5,10.1.1.3,10.1.1.1
        --ipv4-static-route-bfd 10.20.246.6,10.1.1.3,10.1.1.2

Example

(efa:root)root@node-2:-# efa tenant vrf show  --detail
===============================================================
Name                    : ten1vrf1
Tenant                  : ten1
Type                    : extension
Routing Type            : distributed
Centralized Routers     :
Redistribute            : connected
Max Path                : 8
Local ASN               :
L3VNI                   : 8192
EVPN IRB BD             : 4096
EVPN IRB VE             : 8192
BR VNI                  : 4096
BR BD                   :
BR VE                   :
RH Max Path             : 
Enable RH ECMP          : false
Enable Graceful Restart : false
Route Target            : import 101:101
                        : export 101:101
Static Route            :
Static Rout BFD         : Switch-IP->[DestIP,SourceIP][Interval,Min-Rx,Multiplier], ...
                        : 10.20.246.6->10.1.1.3,10.1.1.2
                        : 10.20.246.5->10.1.1.3,10.1.1.1
State                   : vrf-device-created
Dev State               : provisioned
App State               : cfg-in-sync

====================================================================================

Switch Config

Rack1-Device1(config)# do show running-config vlan 11
vlan 11
 router interface Ve 11
 suppress-arp
 description Tenant L3 Extended VLAN
!
Rack1-Device1(config)# do show running config interface Ve 11
interface Ve 11
 vrf forwarding ten1vrf1
 ip anycast address 20.0.11.1/24
 ip address 10.1.1.1/24
 no shutdown
!
Rack1-Device1(config)# do show running config interface Ethernet 0/1
interface Ethernet 0/1
 cluster-track
 bfd software session
 switchport
 switchport mode trunk
 switchport trunk allowed vlan add 11
 no switchport trunk tag native-vlan
 no shutdown
!
Rack1-Device1(config)# do show running config vrf ten1vrf1 address family
ipv4 unicast
vrf ten1vrf1
 address family ipv4 unicast
  route target export 101:101 evpn
  route target import 101:101 evpn
  ip route static bfd 10.1.1.3 10.1.1.1
 !
!
Rack1-Device1(config)#
Rack1-Device2(config)# do show running config vlan 11
vlan 11
 router interface Ve 11
 suppress arp
 description Tenant L3 Extended VLAN
!
Rack1Device2(config)# do show running config in Ve 11
interface Ve 11
 vrf forwarding ten1vrf1
 ip anycast address 20.0.11.1/24
 ip address 10.1.1.2/24
 no shutdown
!
Rack1Device2(config)# do show running config int eth 0/1
interface Ethernet 0/1
 cluster track
 bfd software session
 switchport
 switchport mode trunk
 switchport trunk allowed vlan add 11
 no switchport trunk tag native-vlan 
 no shutdown
!
Rack1-Device2(config)# do show running config vrf ten1vrf1 address family
ipv4 unicast
vrf ten1vrf1
 address family ipv4 unicast
  route target export 101:101 evpn
  route target import 101:101 evpn
  ip route static bfd 10.1.1.3 10.1.1.2
 !
!
Rack1-Device2(config)#

cep-bfd-session-type on EPG Port Property

Operation Command
Create EPG
efa tenant epg create --name < epg-name> --tenant <tenant-name>
 --port <port-list> po <po-list>
 --switchport-mode <access | trunk> --cep-bfd-session-type {auto | software | hardware}
Update EPG
efa tenant epg update --name < epg-name> tenant <tenant-name>
 --operation port group add
 --port <port-list> --po <po-list>
 switchport-mode < access|trunk > --cep-bfd-session-type {auto | software | hardware}
CEP SRIOV and Non-SRIOV Upgrade Handling
  • XCO cannot distinguish between the SRIOV and non-SRIOV connections. Hence both the CEP SRIOV and CEP non-SRIOV phy or port channel are treated in same manner.

  • To use a “hardware” BFD sessions for the CEP non-SRIOV connections, create an EPG containing all the non-SRIOV CEP with cep bfd session type=hardware.

During upgrade from EFA 2.5.5 and onwards, all the CEP ports (on SLX 9250 and SLX 8720 platforms) used in the “extension” EPG must have cep bfd session type as software. You must perform an explicit DRC to reconcile the XCO configuration to synchronize with the SLX.

Co-existence of centralize and distributed routing on a CEP