PCIe EP/RP speedtest for virtual network and DMA

Hello,

I have successfully gotten a PCIe link working between my Orin AGX (EP) and Xavier NX M.2 port (RP). lspci enumeration, memory-mapped data transfer, and virtual Ethernet-over-PCIe are working properly.

The link is set to Speed 8GT/s, Width x4.

When I perform a speed test over this PCIe link, I get 3.33 Gbit / sec as seen here:

Screen Shot 2023-12-07 at 5.05.17 PM1920×544 130 KB

I am curious about two things:

• Does this PCIe virtual network speed match NVIDIA’s tests (i.e. with the resource overhead bottleneck of TCP/IP, are my speedtest results reasonable)?
  
  
  
  • If the answer is “no”, what factors may improve this speed? We would like to eventually use virtualized PCIe in our application.
  
  
  
  


• How can I perform a DMA speedtest and/or hit the max possible physical transfer rate, to compare to the theoretical max?

EP is AGX Orin, RP is Xavier NX. Both run Jetpack 5.1.2.