Based on the event, the forwarding agents print the logs with the required information for debugging and understanding of the scenarios. Also, each log is added with the time stamp and the logs from different agents can be correlated.
The forwarding agents are integrated with the infra tracing support which indicates the functions entry and exit point to ease debugging.
All forwarding agents logs are available at /var/log/pods/<container-specific-id>/<forwarding-agent-name>/<number>.log where <number> indicates the number of times the container is restarted. The latest or highest-numbered log file must be taken for recent logs.
/var/log/pods/ngnpb_agent-sp-intf-ms-85cbc88bcb-cmc9j_eb47ced9-e318-4112-b5b3-3cf5c61cff7a/agent-sp-intf-ms/25.log /var/log/pods/ngnpb_agent-sp-nhop-ms-6db59887d4-xrq9p_429d1d16-7ddf-49d6-89d8-f7f25e8fce25/agent-sp-nhop-ms/25.log
{"log":"\u001b[37mTRAC\u001b[0m[06:01:29.588 28-05-2020] addIngressSFPSel:
Enter
\n","stream":"stdout","time":"2020-05-28T06:01:29.58855818Z"}
{"log":"\u001b[37mTRAC\u001b[0m[06:01:29.588 28-05-2020] addIngressSFPSel:to be added sfpsel entry {Priority:0 ControlHandle:0 Sfc:[0 13] Result1:[] Result2:[{Valid:true Spi:[0 0 8] Si:[6] SiPredec:[6]}]}
\n","stream":"stdout","time":"2020-05-28T06:01:29.58866029Z"}
{"log":"\u001b[37mTRAC\u001b[0m[06:01:29.600 28-05-2020] addIngressSFPSel:Added sfpsel entry {Priority:0 ControlHandle:0 Sfc:[0 13] Result1:[] Result2:[{Valid:true Spi:[0 0 8] Si:[6] SiPredec:[6]}]}
\n","stream":"stdout","time":"2020-05-28T06:01:29.600646936Z"}
{"log":"\u001b[37mTRAC\u001b[0m[06:01:29.600 28-05-2020] addIngressSFPSel:
Exit
\n","stream":"stdout","time":"2020-05-28T06:01:29.600774916Z"}
{"log":"\u001b[36mINFO\u001b[0m[06:46:39.799 21-05-2020] *** routemap_1 sap12 12
\n","stream":"stdout","time":"2020-05-21T06:46:39.799420893Z"} {"log":"\u001b[36mINFO\u001b[0m[06:46:39.799 21-05-2020] ***SAP-POLICY ASSOCIATION routemap_1 sap12 12 \n","stream":"stdout","time":"2020-05-21T06:46:39.79954709Z"} {"log":"\u001b[36mINFO\u001b[0m[06:46:39.799 21-05-2020] Route Map Binding route-map:routemap_1 serviceIF:sap12 \n","stream":"stdout","time":"2020-05-21T06:46:39.799740477Z"}
{"log":"\u001b[31mERRO\u001b[0m[06:46:39.803 21-05-2020] Ingress Entry Insert error: \u0026\{0xc0012ac090 0xc0012aa390 0xc0012bc380 0xc001216580 0xc0012b0540 64 1 0}
; \u0026{66 0 [0 0] [0 0] [0 0 0 0] [0 0 0 0] [0 0 0 0] [0 0 0 0] [9] [255] [0] [0] [0] [0] [0] [0] [0] [0] [0 0 0 0] [0 0 0 0] [0 12] [255 255] [0] [0] [0 0] [0 0] [0 0] [0 0]
{false}
{false} {true [0] [0] [0] [0] [0 0] [1] [0 13] [0] [0] [0] [0] [0]}}; rpc error: code = PermissionDenied desc = Write from non-master is not permitted.; \u0026{sap12 12 3 1 true 13} {false 0} {false 0} {false 0} {false 0} {false 0} {false 0} {false 0} {false 0 {0xc0003b2bc0} 0xc004467680} \n","stream":"stdout","time":"2020-05-21T06:46:39.803203753Z"}
{"log":"\u001b[31mERRO\u001b[0m[06:46:39.803 21-05-2020] Bind Acl IPv4-1 serviceIF:12 owner:3 direction:1 Err:1