asdfgbvcxz3355@alien.topB to LocalLLaMAEnglish · 1 year agoAnyone know what the speed difference between 2x 4090 vs 2x 3090 would be for larger LLMs (70B-120B)plus-squaremessage-squaremessage-square2fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareAnyone know what the speed difference between 2x 4090 vs 2x 3090 would be for larger LLMs (70B-120B)plus-squareasdfgbvcxz3355@alien.topB to LocalLLaMAEnglish · 1 year agomessage-square2fedilink
asdfgbvcxz3355@alien.topB to LocalLLaMAEnglish · 1 year agoDoes a 7900xtx work for LLM?plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareDoes a 7900xtx work for LLM?plus-squareasdfgbvcxz3355@alien.topB to LocalLLaMAEnglish · 1 year agomessage-square0fedilink
minus-squareasdfgbvcxz3355@alien.topOPBtoLocalLLaMA•Buying a p40 for 70b-120blinkfedilinkEnglisharrow-up1·1 year agoAlso are there better alternatives to the p40 that don’t cost a crazy amount? linkfedilink
asdfgbvcxz3355@alien.topB to LocalLLaMAEnglish · 1 year agoBuying a p40 for 70b-120bplus-squaremessage-squaremessage-square10fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareBuying a p40 for 70b-120bplus-squareasdfgbvcxz3355@alien.topB to LocalLLaMAEnglish · 1 year agomessage-square10fedilink
Also are there better alternatives to the p40 that don’t cost a crazy amount?