The following sample output configures two MCT pairs in a 3-stage Clos fabric:
(efa:user)user@dev-server:~$ efa fabric device add-bulk --leaf 10.20.246.5,10.20.246.6,10.20.246.3,10.20.246.4 --name fab3
Inventory Device(s) Registration[Success]
+----+-------------+-----------+-------+--------------+-------------------------------+--------+--------+
| ID | IP Address | Host Name | Model | Chassis Name | Firmware | Status | Reason |
+----+-------------+-----------+-------+--------------+-------------------------------+--------+--------+
| 11 | 10.20.246.3 | NH-Leaf1 | 3012 | SLX9250-32C | 20.4.2slxos20.4.2_220803_1000 | | |
+----+-------------+-----------+-------+--------------+-------------------------------+--------+--------+
| 9 | 10.20.246.4 | NH-Leaf2 | 3012 | SLX9250-32C | 20.4.2slxos20.4.2_220803_1000 | | |
+----+-------------+-----------+-------+--------------+-------------------------------+--------+--------+
| 3 | 10.20.246.5 | NHF-Leaf1 | 3009 | SLX9150-48Y | 20.4.1b | | |
+----+-------------+-----------+-------+--------------+-------------------------------+--------+--------+
| 1 | 10.20.246.6 | NHF-Leaf2 | 3009 | SLX9150-48Y | 20.4.1b | | |
+----+-------------+-----------+-------+--------------+-------------------------------+--------+--------+
Device Details
Updating devices that are already registered: [10.20.246.3 10.20.246.4 10.20.246.5 10.20.246.6]
Inventory Update with ip-address = 10.20.246.5 [Succeeded]
Inventory Update with ip-address = 10.20.246.6 [Succeeded]
Inventory Update with ip-address = 10.20.246.4 [Succeeded]
Inventory Update with ip-address = 10.20.246.3 [Succeeded]
Add Device(s) [Success]
Addition of Leaf device with ip-address = 10.20.246.6 [Succeeded]
Addition of Spine device with ip-address = 10.20.246.2 [Succeeded]
Addition of Leaf device with ip-address = 10.20.246.5 [Succeeded]
Addition of Leaf device with ip-address = 10.20.246.3 [Succeeded]
Addition of Spine device with ip-address = 10.20.246.1 [Succeeded]
Addition of Leaf device with ip-address = 10.20.246.4 [Succeeded]
Validate Fabric [Success]
(efa:user)user@dev-server:~$ efa fabric show --name fab3
Fabric Name: fab3, Fabric Description: , Fabric Stage: 3, Fabric Type: clos, Fabric Status: Green, Fabric Health: Red
+-------------+-----+-----------+-------+-------+-----------------+-----------+-------------------+----------------------------------------------+---------+-------+
| IP ADDRESS | POD | HOST NAME | ASN | ROLE | DEVICE STATE | APP STATE | CONFIG GEN REASON | PENDING CONFIGS | VTLB ID | LB ID |
+-------------+-----+-----------+-------+-------+-----------------+-----------+-------------------+----------------------------------------------+---------+-------+
| 10.20.246.1 | | NH-1 | 64512 | spine | not provisioned | cfg ready | DD,DA | SYSP-C,BGP-C,INTIP-C | NA | 1 |
| 10.20.246.2 | | NH-2 | 64512 | spine | not provisioned | cfg ready | DD,DA | SYSP-C,BGP-C,INTIP-C | NA | 1 |
| 10.20.246.3 | | NH-Leaf1 | 65000 | leaf | not provisioned | cfg ready | DA | SYSP-C,MCT-C,MCT-PA,BGP-C,INTIP-C,EVPN-C,O-C | 2 | 1 |
| 10.20.246.4 | | NH-Leaf2 | 65000 | leaf | not provisioned | cfg ready | DA | SYSP-C,MCT-C,MCT-PA,BGP-C,INTIP-C,EVPN-C,O-C | 2 | 1 |
| 10.20.246.5 | | NHF-Leaf1 | 65001 | leaf | not provisioned | cfg ready | DA | SYSP-C,MCT-C,MCT-PA,BGP-C,INTIP-C,EVPN-C,O-C | 2 | 1 |
| 10.20.246.6 | | NHF-Leaf2 | 65001 | leaf | not provisioned | cfg ready | DA | SYSP-C,MCT-C,MCT-PA,BGP-C,INTIP-C,EVPN-C,O-C | 2 | 1 |
+-------------+-----+-----------+-------+-------+-----------------+-----------+-------------------+----------------------------------------------+---------+-------+
CONFIG GEN REASON:
LA/LD - Link Add/Delete, IA/ID/IU - Interface Add/Delete/Update, PLC/PLD/PLU - IPPrefixList Create/Delete/Update
MD/MU - MCT Delete/Update, OD/OU - Overlay Gateway Delete/Update, EU/ED - Evpn Delete/Update, PC/PD/PU - RouterPim Create/Delete/Update
DD - Dependent Device Update, DA/DR - Device Add/ReAdd, ASN - Asn Update, SYS - System Properties Update
MD5 - BGP MD5 Password, BGPU - Router BGP Update, BGPLL - BGP Listen Limit, POU - Port Channel Update, NA - Not Applicable
PENDING CONFIGS:
MCT - MCT Cluster, O - Overlay Gateway, SYSP - System Properties, INTIP - Interface IP, BGP - Router BGP
C/D/U - Create/Delete/Update, PA/PD - Port Add/Port Delete
For App or Device Error/Failure reason, run "efa fabric error show" for details
For config refresh reason, run "efa fabric debug config-gen-reason" for details
--- Time Elapsed: 155.196132ms ---
When you add spine and leaf devices, the fabric level physical topology state becomes Green. But the device health will be in Red state as cluster and BGP neighbors are not configured on the device. These are device level errors.
(efa:user)user@dev-server:~$ efa fabric health show --name fab3
===============================================================================================================================================================
Fabric Name : fab3
Fabric Type : clos
Fabric Health : Red
Fabric Status : Green
Fabric Level Physical Topology Health : Green
Fabric Device Health
+-------------+-------+---------------------+-------------------+---------------+
| IP ADDRESS | ROLE | CONFIG STATE HEALTH | OPER STATE HEALTH | DEVICE HEALTH |
+-------------+-------+---------------------+-------------------+---------------+
| 10.20.246.6 | Leaf | Red | Red | Red |
| 10.20.246.5 | Leaf | Red | Red | Red |
| 10.20.246.1 | Spine | Red | Red | Red |
| 10.20.246.2 | Spine | Red | Red | Red |
| 10.20.246.4 | Leaf | Red | Red | Red |
| 10.20.246.3 | Leaf | Red | Red | Red |
+-------------+-------+---------------------+-------------------+---------------+
===============================================================================================================================================================
--- Time Elapsed: 46.271008ms ---
(efa:user)user@dev-server:~$ efa fabric health show --name fab3 --detail
===============================================================================================================================================================
Fabric Name : fab3
Fabric Type : clos
Fabric Health : Red
Fabric Status : Green
Fabric Level Physical Topology Health : Green
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Fabric Device Health
Device IP [Role] : 10.20.246.6 [Leaf]
Device Health : Red
Configuration State Health : Red
Dev State : not provisioned
App State : cfg ready
Operational State Health : Red
Cluster Health : Red
Operational State : false
Peer Operational State : false
Peer Keepalive Operational State : false
Physical Topology Device Health : Green
Underlay Topology Device Health : Red
Device underlay topology errors
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| SOURCE DEVICE IP | DESTINATION DEVICE IP | SOURCE DEVICE ROUTER ID | NEIGHBOR IP | SOURCE DEVICE ASN | DESTINATION DEVICE ASN | VRF | NEIGHBOR AFI STATE | NEIGHBOR SAFI | UNDERLAY STATE | ERROR |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| 10.20.246.6 | 10.20.246.5 | 172.31.254.92 | 10.20.20.13 | 65001 | 65001 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.6 | 10.20.246.2 | 172.31.254.92 | 10.10.10.27 | 65001 | 64512 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.6 | 10.20.246.2 | 172.31.254.92 | 10.10.10.27 | 65001 | 64512 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.6 | 10.20.246.1 | 172.31.254.92 | 10.10.10.25 | 65001 | 64512 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.6 | 10.20.246.1 | 172.31.254.92 | 10.10.10.25 | 65001 | 64512 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
--------------------------------------------------------
Device IP [Role] : 10.20.246.5 [Leaf]
Device Health : Red
Configuration State Health : Red
Dev State : not provisioned
App State : cfg ready
Operational State Health : Red
Cluster Health : Red
Operational State : false
Peer Operational State : false
Peer Keepalive Operational State : false
Physical Topology Device Health : Green
Underlay Topology Device Health : Red
Device underlay topology errors
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| SOURCE DEVICE IP | DESTINATION DEVICE IP | SOURCE DEVICE ROUTER ID | NEIGHBOR IP | SOURCE DEVICE ASN | DESTINATION DEVICE ASN | VRF | NEIGHBOR AFI STATE | NEIGHBOR SAFI | UNDERLAY STATE | ERROR |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| 10.20.246.5 | 10.20.246.6 | 172.31.254.196 | 10.20.20.12 | 65001 | 65001 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.5 | 10.20.246.1 | 172.31.254.196 | 10.10.10.29 | 65001 | 64512 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.5 | 10.20.246.1 | 172.31.254.196 | 10.10.10.29 | 65001 | 64512 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.5 | 10.20.246.2 | 172.31.254.196 | 10.10.10.31 | 65001 | 64512 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.5 | 10.20.246.2 | 172.31.254.196 | 10.10.10.31 | 65001 | 64512 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
--------------------------------------------------------
Device IP [Role] : 10.20.246.1 [Spine]
Device Health : Red
Configuration State Health : Red
Dev State : not provisioned
App State : cfg ready
Operational State Health : Red
Physical Topology Device Health : Green
Underlay Topology Device Health : Red
Device underlay topology errors
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| SOURCE DEVICE IP | DESTINATION DEVICE IP | SOURCE DEVICE ROUTER ID | NEIGHBOR IP | SOURCE DEVICE ASN | DESTINATION DEVICE ASN | VRF | NEIGHBOR AFI STATE | NEIGHBOR SAFI | UNDERLAY STATE | ERROR |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| 10.20.246.1 | 10.20.246.4 | 172.31.254.144 | 10.10.10.16 | 64512 | 65000 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.1 | 10.20.246.4 | 172.31.254.144 | 10.10.10.16 | 64512 | 65000 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.1 | 10.20.246.3 | 172.31.254.144 | 10.10.10.20 | 64512 | 65000 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.1 | 10.20.246.3 | 172.31.254.144 | 10.10.10.20 | 64512 | 65000 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.1 | 10.20.246.6 | 172.31.254.144 | 10.10.10.24 | 64512 | 65001 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.1 | 10.20.246.6 | 172.31.254.144 | 10.10.10.24 | 64512 | 65001 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.1 | 10.20.246.5 | 172.31.254.144 | 10.10.10.28 | 64512 | 65001 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.1 | 10.20.246.5 | 172.31.254.144 | 10.10.10.28 | 64512 | 65001 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
--------------------------------------------------------
Device IP [Role] : 10.20.246.2 [Spine]
Device Health : Red
Configuration State Health : Red
Dev State : not provisioned
App State : cfg ready
Operational State Health : Red
Physical Topology Device Health : Green
Underlay Topology Device Health : Red
Device underlay topology errors
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| SOURCE DEVICE IP | DESTINATION DEVICE IP | SOURCE DEVICE ROUTER ID | NEIGHBOR IP | SOURCE DEVICE ASN | DESTINATION DEVICE ASN | VRF | NEIGHBOR AFI STATE | NEIGHBOR SAFI | UNDERLAY STATE | ERROR |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| 10.20.246.2 | 10.20.246.4 | 172.31.254.205 | 10.10.10.18 | 64512 | 65000 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.2 | 10.20.246.4 | 172.31.254.205 | 10.10.10.18 | 64512 | 65000 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.2 | 10.20.246.3 | 172.31.254.205 | 10.10.10.22 | 64512 | 65000 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.2 | 10.20.246.3 | 172.31.254.205 | 10.10.10.22 | 64512 | 65000 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.2 | 10.20.246.6 | 172.31.254.205 | 10.10.10.26 | 64512 | 65001 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.2 | 10.20.246.6 | 172.31.254.205 | 10.10.10.26 | 64512 | 65001 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.2 | 10.20.246.5 | 172.31.254.205 | 10.10.10.30 | 64512 | 65001 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.2 | 10.20.246.5 | 172.31.254.205 | 10.10.10.30 | 64512 | 65001 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
--------------------------------------------------------
Device IP [Role] : 10.20.246.4 [Leaf]
Device Health : Red
Configuration State Health : Red
Dev State : not provisioned
App State : cfg ready
Operational State Health : Red
Cluster Health : Red
Operational State : false
Peer Operational State : false
Peer Keepalive Operational State : false
Physical Topology Device Health : Green
Underlay Topology Device Health : Red
Device underlay topology errors
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| SOURCE DEVICE IP | DESTINATION DEVICE IP | SOURCE DEVICE ROUTER ID | NEIGHBOR IP | SOURCE DEVICE ASN | DESTINATION DEVICE ASN | VRF | NEIGHBOR AFI STATE | NEIGHBOR SAFI | UNDERLAY STATE | ERROR |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
| 10.20.246.4 | 10.20.246.3 | 172.31.254.90 | 10.20.20.10 | 65000 | 65000 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.4 | 10.20.246.1 | 172.31.254.90 | 10.10.10.17 | 65000 | 64512 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.4 | 10.20.246.1 | 172.31.254.90 | 10.10.10.17 | 65000 | 64512 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.4 | 10.20.246.2 | 172.31.254.90 | 10.10.10.19 | 65000 | 64512 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.4 | 10.20.246.2 | 172.31.254.90 | 10.10.10.19 | 65000 | 64512 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
+------------------+-----------------------+-------------------------+-------------+-------------------+------------------------+-------------+--------------------+---------------+----------------+-------------------------+
--------------------------------------------------------
Device IP [Role] : 10.20.246.3 [Leaf]
Device Health : Red
Configuration State Health : Red
Dev State : not provisioned
App State : cfg ready
Operational State Health : Red
Cluster Health : Red
Operational State : false
Peer Operational State : false
Peer Keepalive Operational State : false
Physical Topology Device Health : Green
Underlay Topology Device Health : Red
Device underlay topology errors
+------------+-------------+-----------------+-------------+-----------+-------------+-------------+----------+---------+----------+-------------------------+
| SOURCE | DESTINATION | SOURCE DEVICE | NEIGHBOR IP | SOURCE | DESTINATION | VRF | NEIGHBOR | NEIGHBOR| UNDERLAY | ERROR |
| DEVICE IP | DEVICE IP | DEVICE ROUTER ID| | DEVICE ASN| DEVICE ASN | | AFI STATE| SAFI | STATE | |
+------------+-------------+-----------------+-------------+-----------+-------------+-------------+----------+---------+----------+-------------------------+
| 10.20.246.3| 10.20.246.4 | 172.31.254.145 | 10.20.20.11 | 65000 | 65000 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.3| 10.20.246.1 | 172.31.254.145 | 10.10.10.21 | 65000 | 64512 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.3| 10.20.246.1 | 172.31.254.145 | 10.10.10.21 | 65000 | 64512 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
| 10.20.246.3| 10.20.246.2 | 172.31.254.145 | 10.10.10.23 | 65000 | 64512 | default-vrf | l2vpn | evpn | | neighbor_not_configured |
| 10.20.246.3| 10.20.246.2 | 172.31.254.145 | 10.10.10.23 | 65000 | 64512 | default-vrf | ipv4 | unicast | | neighbor_not_configured |
+------------+-------------+-----------------+-------------+-----------+-------------+-------------+----------+---------+----------+-------------------------+
---------------------------------------------------------------------------------------------------------------------------------------------------------------
===============================================================================================================================================================