I have a Dell T7610 and I got 2x P40s for running LLMs. However, nno matter what I do, I can’t get both of my P40s to work on the system. Both of them work by themselves in either PCIE slot, but when both of them are plugged in, the one on the first PCIE slot always returns an error in device manager. Does anyone have any experience with setting up these cards in a system like this?
Any system you want to put multiple Tesla cards in needs to support Upper 4G and Rebar. Does that Dell system have either of these features in the bios?
I have a T7600 with 3x Quadro M6000 and I can use all 3 GPUs simultaneously without issue. At one point I did try to install a P40 but I couldn’t get even a single one working. That said, since you are able to get 1 of them working, I see no reason that 2 can’t work.
Do you have 2 CPUs installed? 2 of the PCIe x16 slots will only work with a second CPU installed.
Proxmox + Ubuntu FTW IMO