R35.1 PCIe i210 throughput slow
                                    
                                    Mar 04, 2024
                                
                            On Xavier NX, R32.6.1, custom carrier board: everything works well.
On Xavier NX, R35.1, same hardware: PCIe performance to i210 GigE Ethernet ICs seems to be very poor in the Tx (Xavier NX egress) path. Rx (Xavier NX ingress) path does not seem to be affected.
Benchmarks:
R35.1:
# iperf3 -c 192.168.1.157 -u -b 950M
Connecting to host 192.168.1.157, port 5201
[  5] local 192.168.1.225 port 44297 connected to 192.168.1.157 port 5201
[ ID] Interval           Transfer     Bitrate         Total Datagrams
[  5]   0.00-1.00   sec  7.33 MBytes  61.4 Mbits/sec  5305
R32.6:
# iperf3 -c 192.168.1.157 -u -b 950M
Connecting to host 192.168.1.157, port 5201
[  4] local 192.168.1.226 port 56975 connected to 192.168.1.157 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec   112 MBytes   943 Mbits/sec  14388
Any ideas? Only thing that might be ‘special’ about the configuration is that the i210 is behind a PCIe switch. Running nvpmodel doesn’t seem to make any difference to the throughput.