teddybear082@alien.topBtoLocalLLaMA•Llama.cpp on colab with Bakllava-1.Q8_0 (Mistral+LLaVA 1.5)English
1·
1 year agoI had done something similar and set up a little chat bot with whisper, stable diffusion, llava and speech to text (me know if you want me to send you a link) but I hadn’t seen before what you did with the google-colab-output eval js cell. Is that basically a way to create a tunnel without having to use trycloudflare or similar? If so that’s awesome!
Openrouter and some of the models hosted are free.
Google colab but depends on how long google will let you use it for free (you can also pay monthly)