minus-squarehexaga@alien.topcakeBtoLocalLLaMA•Something wrong with older AMD high VRAM cards?linkfedilinkEnglisharrow-up1·1 year agoThey work fine but have a couple pitfalls: rocm support across software is spotty, but does work when available (mostly) rocm is less well supported os wise (have to use specific, blessed distros / kernels) most llm software is optimized for nvidia hardware, perf is worse than it could be w/ bespoke cuda kernels linkfedilink
They work fine but have a couple pitfalls: