minus-squareelekibug@alien.topBtoLocalLLaMA•Is there a technical reason that distributed LLMs don't exist?linkfedilinkEnglisharrow-up1·1 year agoThe cost of separating task to workers and combining result is too much. Distributed computing only make sense if the cost of data transfer is small enough to be ignored linkfedilink
The cost of separating task to workers and combining result is too much. Distributed computing only make sense if the cost of data transfer is small enough to be ignored