I’m a data scientist working in consulting (EU) and I would like to push my company to delve more into open-source LLMs over closed ones (OpenAI…).
I’m constantly amazed by the progress shown by open-sourced LLMs in this sub. The increasing efficiency of models coupled with the expanding open-source LLM ecosystem make these models more and more competitive.
I keep thinking that there’s a market for custom LLMs, notably for private-sensitive companies like banks and insurances.
Any insights?
Yes, there are a few reasons. Companies might want them offline, fine-tuned to their industry/company and lower operating cost are the ones that come to mind.