minus-squarefnbr@alien.topBtoLocalLLaMA•Speed and energy use - RAM vs Mac Studio vs RTX cardslinkfedilinkEnglisharrow-up1·1 year agoHow important is local processing for you? It might be worth looking into renting a cloud server. Datacenter GPUs, like the A/H100s, have much more memory. Could be better bang for your buck if all you care about it throughput. linkfedilink
How important is local processing for you? It might be worth looking into renting a cloud server. Datacenter GPUs, like the A/H100s, have much more memory. Could be better bang for your buck if all you care about it throughput.