I’m a data scientist working in consulting (EU) and I would like to push my company to delve more into open-source LLMs over closed ones (OpenAI…).

I’m constantly amazed by the progress shown by open-sourced LLMs in this sub. The increasing efficiency of models coupled with the expanding open-source LLM ecosystem make these models more and more competitive.

I keep thinking that there’s a market for custom LLMs, notably for private-sensitive companies like banks and insurances.

Any insights?

  • artelligence_consult@alien.topBEnglish
    1·
    1 year ago

    . We are handling sensitive data which requires us to do it local

    Likely this is incompetence on your end because - cough - OpenAI models are available under Azure and ok for even medical data. Takes some reading - but most “confidential, cannot use cloud” is “too stupid to read contracts”. Ther are some edge cases, but heck, you can even get government use approved from Azure.