(+86) 15013630202 sales@pcie.com

Jetson Orin and RTX 3080

Mar 04, 2024

I have had great success hosting some of the large language models like Alpaca and Vicuna (7B and 13B versions) on my Jetson Orin. I am upgrading my workstation with a 4090, which leaves my RTX3080 without a home.


I would like to try to use the 3080 in the PCIe slot available on the Orin dev kit. I have an extra ATX Power Source to supply the 3080, and I can rig and enclosure to hold it in place. What considerations am I going to have to take though in order to get this setup working?