Both_Garage_1081@alien.topBtoLocalLLaMA•Is there a technical reason that distributed LLMs don't exist?English
1·
1 year agoYou guys are all talking about inference but how about using distributed computing strictly for training. That alone would save developers some serious moolah assuming somebody is able to solve all the technical problems like security & privacy.
But what about developer support. Can they come up with a developer ecosystem that can compete with CUDA that’s 20+ years old. Will developers feel comfortable switching? Dev communities takes years to build like cuda or Java. Can it be manufactured overnight?