Does anyone have any recommendations on an api service that provides access to open source LLMs?
You must log in or # to comment.
OpenRouter.ai It’s an openai proxy server that also offer many opensource models.
Replicate
https://skymel.com/ . We are in closed beta and provide javascript library ( along with api endpoint) that decides in real time whether to run inference locally on the device or call api . You only pay for the api calls or gpu minutes used.
NLP Cloud? --> https://nlpcloud.com