minus-squaresirus20x6@alien.topBtoLocalLLaMA•Does Dual EPYC work for LLMs?linkfedilinkEnglisharrow-up1·1 year agoThere is a NUMA aware option in llama.cpp linkfedilink
There is a NUMA aware option in llama.cpp