Need advice - building a private GPU cloud

Hi, new here, I've built a 3D application that I will run for some customers on my own servers. I've tested nearly every GPU cloud provider (probably all of them at this point) but it's looking likely I will need to create at least 2-3 colocation deployments of some GPU servers in the US for my needs. I will/can use some of the GPU cloud providers that I've tested but none of them give me exactly what I need for all use cases...


For instance, my network egress for some customers will be high, therefore I can't be capped by what some providers offer in terms of bandwidth and I can't use the massively inflated bandwidth charges for AWS/Azure for example. So, here are some basic features for my app and I'm looking for some advice on the best bang for buck and availability for a GPU to use in my servers.


- My app delivers low-res 3D graphics (photo realism is not required) and poly count is low compared to high-end games.

- This is more of an engineering type 3D (similar to CAD) application

- I'm leaning towards AMD for price / value and potentially availability bc it seems like it may be hard to get my hands on a few dozen (I may need up to 30-40 over the next year possibly more) NVIDIA GPUs but maybe I'm wrong about this...?

- I can run on either Windows server or Linux but likely will standardize on Linux (probably Ubuntu)


For a data center GPU, that comes in under say $4-5K per GPU which GPU would you guys recommend?


Thanks!