minus-squareShap6@alien.topBtoLocalLLaMA•Macs with 32GB of memory can run 70B models with the GPU.linkfedilinkEnglisharrow-up1·1 year agoyou can’t but its not just apple being assholes like what they did with SSD’s, the “M” chips are completely integrated SOC’s that use unified memory that is shared between the GPU and CPU linkfedilink
you can’t but its not just apple being assholes like what they did with SSD’s, the “M” chips are completely integrated SOC’s that use unified memory that is shared between the GPU and CPU