APS: Pre-provisioning Support by Modifying the Target Device List to Include the MCT Neighbor

Scenario 2.3.2 Target Device List 2.4.0 Target Device List EFA 2.3.2 Resultant Topology EFA 2.4.0 Resultant Topology
Single Homed PO Create with PO member on Rack1Device2 Rack1Device2 Rack1Device1 Rack1Device2 Complete Failure Partial Success
Endpoint group (EPG) create with cluster edge port (CEP) member on Rack1Device2 Rack1Device2

Rack1Device1

Rack1Device1 Rack1Device2 Partial Success Partial Success
BGP Peer Group create with the peer-group residing on Rack1Device2 Rack1Device2 Rack1Device1 Rack1Device2 Complete Failure Partial Success
BGP Peer Create with the static or dynamic BGP peers residing on Rack1Device2 Rack1Device2 Rack1Device1 Rack1Device2 Complete Failure Partial Success
VRF update with SR or SR-BFD residing on Rack1Device2 Rack1Device2 Rack1Device1 Rack1Device2 Complete Failure Partial Success
efa tenant show
+------+-------------+-------------+------------+-----------+-----------+---------+----------------------+
| Name | L2VNI-Range | L3VNI-Range | VLAN-Range | VRF-Count | Enable-BD |  Type   |        Ports         |
+------+-------------+-------------+------------+-----------+-----------+---------+----------------------+
| ten1 |             |             | 11-20      | 10        | False     | private | 10.20.246.15[0/1-10] |
|      |             |             |            |           |           |         | 10.20.246.16[0/1-10] |
+------+-------------+-------------+------------+-----------+-----------+---------+----------------------+
Tenant Details

efa inventory admin-state down --ip 10.20.246.15
AdminStateDown [success]
Admin State Down execution UUID: 6eaa1ebe-40fe-4628-8d5c-df11ffc4521e
execute the CLI to get details : efa inventory admin-state detail --uuid 6eaa1ebe-40fe-4628-8d5c-df11ffc4521e

efa inventory admin-state detail --uuid 6eaa1ebe-40fe-4628-8d5c-df11ffc4521e
+--------------------------------+--------------------------------------+
|              NAME              |                VALUE                 |
+--------------------------------+--------------------------------------+
| UUID                           | 6eaa1ebe-40fe-4628-8d5c-df11ffc4521e |
+--------------------------------+--------------------------------------+
| Device IP                      | 10.20.246.15                         |
+--------------------------------+--------------------------------------+
| Admin State Action             | down                                 |
+--------------------------------+--------------------------------------+
| Status                         | success                              |
+--------------------------------+--------------------------------------+
| Fabric Status                  | success                              |
+--------------------------------+--------------------------------------+
| Tenant Status                  | success                              |
+--------------------------------+--------------------------------------+
| Maintenance Mode Enable Status | success                              |
+--------------------------------+--------------------------------------+
| Start Time                     | 2021-02-06 21:18:53 -0800 PST        |
+--------------------------------+--------------------------------------+
| Last Modified                  | 2021-02-06 21:19:59 -0800 PST        |
+--------------------------------+--------------------------------------+
| Duration                       | 1m5.517263907s                       |
+--------------------------------+--------------------------------------+

Behavior in 2.3.2

efa tenant po create --name ten1po1 --tenant ten1 --port 10.20.246.15[0/1-2] --speed 10Gbps --negotiation active
	PortChannel creation failed:
			Error: Device 10.20.246.15 is administratively down

efa tenant po create --name ten1po1 --tenant ten1 --port 10.20.246.16[0/1-2] --speed 10Gbps --negotiation active
	PortChannel created successfully.

efa tenant epg create --name ten1epg1 --tenant ten1 --po ten1po1 --switchport-mode trunk --ctag-range 11-12 --anycast-ip 11:10.0.11.1/24 --anycast-ip 12:10.0.12.1/24 --vrf ten1vrf1 --l2-vni 11:11 --l2-vni 12:12 --l3-vni 8192
	EndpointGroup created successfully.

efa tenant service bgp peer create --name ten1bgppeer1 --tenant ten1 --ipv4-uc-nbr 10.20.246.15,ten1vrf1:10.0.0.0,65001
	BgpService creation Failed:
			Error: Devices [10.20.246.15] are administratively down

efa tenant service bgp peer-group create --name ten1bgppeergroup1 --tenant ten1 --pg-name 10.20.246.15:pg1 --pg-asn 10.20.246.15,pg1:65010
	BgpService creation Failed:
			Error: Devices [10.20.246.15] are administratively down

Behavior in 2.4.0

efa tenant po create --name ten1po1 --tenant ten1 --port 10.20.246.15[0/1-2] --speed 10Gbps --negotiation active

efa tenant epg create --name ten1epg1 --tenant ten1 --po ten1po1 --switchport-mode trunk --ctag-range 11-12 --anycast-ip 11:10.0.11.1/24 --anycast-ip 12:10.0.12.1/24 --vrf ten1vrf1

efa tenant service bgp peer create --name ten1bgppeer1 --tenant ten1 --ipv4-uc-nbr 10.20.246.15,ten1vrf1:10.0.0.0,65001

efa tenant service bgp peer-group create --name ten1bgppeergroup1 --tenant ten1 --pg-name 10.20.246.15:pg1 --pg-asn 10.20.246.15,pg1:65010

efa tenant po show --name ten1po1 --tenant ten1
+---------+--------+----+--------+-------------+----------+---------+---------------------+------------+-----------------+-----------+
|  Name   | Tenant | ID | Speed  | Negotiation | Min Link |  Lacp   |        Ports        |   State    |    Dev State    | App State |
|         |        |    |        |             |  Count   | Timeout |                     |            |                 |           |
+---------+--------+----+--------+-------------+----------+---------+---------------------+------------+-----------------+-----------+
| ten1po1 |  ten1  | 1  | 10Gbps |   active    |    1     |  long   | 10.20.246.15[0/1-2] | po-created | not-provisioned | cfg-ready |
+---------+--------+----+--------+-------------+----------+---------+---------------------+------------+-----------------+-----------+

efa tenant vrf show --name ten1vrf1 --tenant ten1
(efa:root)root@node-2:~# efa tenant vrf show --name ten1vrf1 --tenant ten1
+----------+--------+--------------+---------------------+------------------+----------+-----------+-----------+------------+-----------------+-----------+
|   Name   | Tenant | Routing Type | Centralized Routers |   Redistribute   | Max Path | Local Asn | Enable GR |   State    |    Dev State    | App State |
+----------+--------+--------------+---------------------+------------------+----------+-----------+-----------+------------+-----------------+-----------+
| ten1vrf1 |  ten1  | distributed  |                     | connected,static |    50    |   65002   |   false   | vrf-create | not-provisioned | cfg-ready |
+----------+--------+--------------+---------------------+------------------+----------+-----------+-----------+------------+-----------------+-----------+


efa tenant epg show --detail
===============================================================================================================================================================
Name          : ten1epg1
Tenant        : ten1
Description   :
Type          : extension
Ports         :
POs           :
              : unstable            : ten1po1
Port Property : switchport mode     : trunk
              : native-vlan-tagging : false
NW Policy     : ctag-range          : 11-12
              : vrf                 : ten1vrf1 [unstable]
              : l3-vni              : 8192
Network Property [Flags : * - Native Vlan]
+------+--------+--------------+--------------+---------+--------------------------------+-------------------------+-------------+-----------------------+---------------------+-----------------+-----------+
| Ctag | L2-Vni | Anycast-IPv4 | Anycast-IPv6 | BD-name | Local IP (Device-IP->Local-IP) |    Ctag-Description     | Mtu-IPv6-ND | ManagedConfig-IPv6-ND | OtherConfig-IPv6-ND |    Dev-state    | App-state |
+------+--------+--------------+--------------+---------+--------------------------------+-------------------------+-------------+-----------------------+---------------------+-----------------+-----------+
| 11   | 11     | 10.0.11.1/24 |              |         |                                | Tenant L3 Extended VLAN |             | False                 | False               | not-provisioned | cfg-ready |
+------+--------+--------------+--------------+---------+--------------------------------+-------------------------+-------------+-----------------------+---------------------+-----------------+-----------+
| 12   | 12     | 10.0.12.1/24 |              |         |                                | Tenant L3 Extended VLAN |             | False                 | False               | not-provisioned | cfg-ready |
+------+--------+--------------+--------------+---------+--------------------------------+-------------------------+-------------+-----------------------+---------------------+-----------------+-----------+

efa tenant service bgp peer-group show
===============================================================================================================================================================
Name        : ten1bgppeergroup1
Tenant      : ten1
State       : bgp-pg-state-created
Description :
+--------------+-----------------+------------+-------------+--------------+--------+----------------+---------------+------------------+-----------------+-----------+
|  Device IP   | PEER-GROUP-NAME | REMOTE ASN | BFD Enabled | BFD Interval | BFD Rx | BFD Multiplier | Next-Hop-Self | Update-Source-IP |    Dev-state    | App-state |
+--------------+-----------------+------------+-------------+--------------+--------+----------------+---------------+------------------+-----------------+-----------+
| 10.20.246.15 | pg1             | 65010      | false       | 0            | 0      | 0              | false         |                  | not-provisioned | cfg-ready |
+--------------+-----------------+------------+-------------+--------------+--------+----------------+---------------+------------------+-----------------+-----------+

efa tenant service bgp peer show
============================================================================================================================================================================================
Name        : ten1bgppeer1
Tenant      : ten1
State       : bs-state-created
Description :
Static Peer:
+--------------+----------+------+---------+-----------+------------+-------------+--------------+--------+----------------+---------------+------------------+-----------------+-----------+
|  Device IP   |   VRF    | AFI  |  SAFI   | REMOTE IP | REMOTE ASN | BFD Enabled | BFD Interval | BFD Rx | BFD Multiplier | Next Hop Self | Update Source IP |    Dev-state    | App-state |
+--------------+----------+------+---------+-----------+------------+-------------+--------------+--------+----------------+---------------+------------------+-----------------+-----------+
| 10.20.246.15 | ten1vrf1 | ipv4 | unicast | 10.0.0.0  | 65001      | false       | 0            | 0      | 0              | false         |                  | not-provisioned | cfg-ready |
+--------------+----------+------+---------+-----------+------------+-------------+--------------+--------+----------------+---------------+------------------+-----------------+-----------+
Dynamic Peer:
+-----------+-----+-----+------+--------------+------------+--------------+-----------+-----------+
| Device IP | VRF | AFI | SAFI | Listen Range | Peer Group | Listen Limit | Dev-state | App-state |
+-----------+-----+-----+------+--------------+------------+--------------+-----------+-----------+
============================================================================================================================================================================================

efa inventory admin-state up --ip 10.20.246.15
AdminStateUp [success]
Admin State Up started execution UUID: 0ae0db00-c0de-4d55-8410-6d67bca4ad65


efa inventory admin-state detail --uuid 0ae0db00-c0de-4d55-8410-6d67bca4ad65
+-----------------------------+--------------------------------------+
|            NAME             |                VALUE                 |
+-----------------------------+--------------------------------------+
| UUID                        | 0ae0db00-c0de-4d55-8410-6d67bca4ad65 |
+-----------------------------+--------------------------------------+
| Device IP                   | 10.20.246.15                         |
+-----------------------------+--------------------------------------+
| Admin State Action          | up                                   |
+-----------------------------+--------------------------------------+
| Status                      | success                              |
+-----------------------------+--------------------------------------+
| Fabric Status               | success                              |
+-----------------------------+--------------------------------------+
| Tenant Status               | success                              |
+-----------------------------+--------------------------------------+
| Drift and Reconcile id      | a3c987ea-f709-4f7c-8ae4-bc5c9481cc55 |
+-----------------------------+--------------------------------------+
| Drift and Reconcile Status  | DR Completed                         |
+-----------------------------+--------------------------------------+
| Start Time                  | 2021-02-06 21:39:09 -0800 PST        |
+-----------------------------+--------------------------------------+
| Last Modified               | 2021-02-06 21:47:09 -0800 PST        |
+-----------------------------+--------------------------------------+
| Duration                    | 8m0.126957723s                       |
+-----------------------------+--------------------------------------+
--- Time Elapsed: 47.334754ms ---
(efa:root)root@node-2:~#

efa tenant vrf show --name ten1vrf1 --tenant ten1
+----------+--------+--------------+---------------------+------------------+----------+-----------+-----------+--------------------+-------------+-------------+
|   Name   | Tenant | Routing Type | Centralized Routers |   Redistribute   | Max Path | Local Asn | Enable GR |       State        |  Dev State  |  App State  |
+----------+--------+--------------+---------------------+------------------+----------+-----------+-----------+--------------------+-------------+-------------+
| ten1vrf1 |  ten1  | distributed  |                     | connected,static |    50    |   65002   |   false   | vrf-device-created | provisioned | cfg-in-sync |
+----------+--------+--------------+---------------------+------------------+----------+-----------+-----------+--------------------+-------------+-------------+

efa tenant po show
+---------+--------+----+--------------------------+--------+-------------+--------------+---------------------+-------------+------------+-------------+--------------+
|  Name   | Tenant | ID |       Description        | Speed  | Negotiation | MinLinkCount |        Ports        | LacpTimeout |   State    |  Dev-State  |   App-State  |
+---------+--------+----+--------------------------+--------+-------------+--------------+---------------------+-------------+------------+-------------+--------------+
| ten1po1 | ten1   | 1  | EFA Port-channel ten1po1 | 10Gbps | active      | 1            | 10.20.246.15[0/1-2] | long        | po-created | provisioned |  cfg-in-sync |
+---------+--------+----+--------------------------+--------+-------------+--------------+---------------------+-------------+------------+-------------+--------------+

efa tenant epg show
===============================================================================================================================================================
Name          : ten1epg1
Tenant        : ten1
Description   :
Type          : extension
Ports         :
POs           :
              : unstable            : ten1po1
Port Property : switchport mode     : trunk
              : native-vlan-tagging : false
NW Policy     : ctag-range          : 11-12
              : vrf                 : ten1vrf1
              : l3-vni              : 8192
Network Property [Flags : * - Native Vlan]
+------+--------+--------------+--------------+---------+--------------------------------+-------------------------+-------------+-----------------------+---------------------+-------------+--------------+
| Ctag | L2-Vni | Anycast-IPv4 | Anycast-IPv6 | BD-name | Local IP (Device-IP->Local-IP) |    Ctag-Description     | Mtu-IPv6-ND | ManagedConfig-IPv6-ND | OtherConfig-IPv6-ND |  Dev-state  |   App-state  |
+------+--------+--------------+--------------+---------+--------------------------------+-------------------------+-------------+-----------------------+---------------------+-------------+--------------+
| 11   | 11     | 10.0.11.1/24 |              |         |                                | Tenant L3 Extended VLAN |             | False                 | False               | provisioned |  cfg-in-sync |
+------+--------+--------------+--------------+---------+--------------------------------+-------------------------+-------------+-----------------------+---------------------+-------------+--------------+
| 12   | 12     | 10.0.12.1/24 |              |         |                                | Tenant L3 Extended VLAN |             | False                 | False               | provisioned |  cfg-in-sync |
+------+--------+--------------+--------------+---------+--------------------------------+-------------------------+-------------+-----------------------+---------------------+-------------+--------------+
For 'unstable' entities, run 'efa tenant po/vrf show' for details
===============================================================================================================================================================


efa tenant service bgp peer-group show
===============================================================================================================================================================
Name        : ten1bgppeergroup1
Tenant      : ten1
State       : bgp-pg-state-created
Description :
+--------------+-----------------+------------+-------------+--------------+--------+----------------+---------------+------------------+-------------+-------------+
|  Device IP   | PEER-GROUP-NAME | REMOTE ASN | BFD Enabled | BFD Interval | BFD Rx | BFD Multiplier | Next-Hop-Self | Update-Source-IP |  Dev-state  |  App-state  |
+--------------+-----------------+------------+-------------+--------------+--------+----------------+---------------+------------------+-------------+-------------+
| 10.20.246.15 | pg1             | 65010      | false       | 0            | 0      | 0              | false         |                  | provisioned | cfg-in-sync |
+--------------+-----------------+------------+-------------+--------------+--------+----------------+---------------+------------------+-------------+-------------+
===============================================================================================================================================================

efa tenant service bgp peer show
============================================================================================================================================================================================
Name        : ten1bgppeer1
Tenant      : ten1
State       : bs-state-created
Description :
Static Peer:
+--------------+----------+------+---------+-----------+------------+-------------+--------------+--------+----------------+---------------+------------------+-------------+-------------+
|  Device IP   |   VRF    | AFI  |  SAFI   | REMOTE IP | REMOTE ASN | BFD Enabled | BFD Interval | BFD Rx | BFD Multiplier | Next Hop Self | Update Source IP |  Dev-state  |  App-state  |
+--------------+----------+------+---------+-----------+------------+-------------+--------------+--------+----------------+---------------+------------------+-------------+-------------+
| 10.20.246.15 | ten1vrf1 | ipv4 | unicast | 10.0.0.0  | 65001      | false       | 0            | 0      | 0              | false         |                  | provisioned | cfg-in-sync |
+--------------+----------+------+---------+-----------+------------+-------------+--------------+--------+----------------+---------------+------------------+-------------+-------------+
Dynamic Peer:
+-----------+-----+-----+------+--------------+------------+--------------+-----------+-----------+
| Device IP | VRF | AFI | SAFI | Listen Range | Peer Group | Listen Limit | Dev-state | App-state |
+-----------+-----+-----+------+--------------+------------+--------------+-----------+-----------+
============================================================================================================================================================================================