minus-squarerunforpeace2021@alien.topcakeBtoLocalLLaMA•AMD EPYC CPU or 1x RTX 4090?linkfedilinkEnglisharrow-up1·1 year agoIf you like m1 ultra, wait until m3 ultra … . M3 max already smokes M1 Max by 3x the speed in inference. So expect m3 ultra to be in the 20t/s range linkfedilink
minus-squarerunforpeace2021@alien.topcakeBtoLocalLLaMA•AMD EPYC CPU or 1x RTX 4090?linkfedilinkEnglisharrow-up1·1 year ago4090 bc it will keep its value unlike the CPU linkfedilink
If you like m1 ultra, wait until m3 ultra … . M3 max already smokes M1 Max by 3x the speed in inference.
So expect m3 ultra to be in the 20t/s range