minus-squarehexaga@alien.topBtoLocalLLaMA•Something wrong with older AMD high VRAM cards?linkfedilinkEnglisharrow-up1·2 years agoThey work fine but have a couple pitfalls: rocm support across software is spotty, but does work when available (mostly) rocm is less well supported os wise (have to use specific, blessed distros / kernels) most llm software is optimized for nvidia hardware, perf is worse than it could be w/ bespoke cuda kernels linkfedilink
They work fine but have a couple pitfalls: