• 1 Post
  • 6 Comments
Joined 1 year ago
cake
Cake day: November 10th, 2023

help-circle


  • itsuka_dev@alien.topBtoLocalLLaMALLM Web-UI recommendations
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Thank you for the kind words! I stopped maintaining OAI UIs because things got a bit stagnant a few months ago (there were literally no new UIs for weeks, I think). But with the new features announced at DevDay, I’m expecting to see a surge in new UIs, especially those that leverages multi-modality. As a maintainer of list projects, this is such an exciting time.

    I think we can keep both at the meantime

    Absolutely. Someone needs to maintain an awesome list for local UIs, and I don’t think my projects fall into that category. Besides, my list got a mix of native UIs in there too, which is important to me since I’m building both web and native UIs.

    let me know what breakdown makes more sense from your end

    For local UIs, sorting/grouping by model backend (e.g. llama.cpp, ollama, ExLlama) makes the most sense, IMO - and the rest of what I mentioned above is optional.



  • itsuka_dev@alien.topBtoLocalLLaMALLM Web-UI recommendations
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    What is your favorite project to interact with

    I still don’t have a favorite, tbh. I’ve tried a few of the UIs you shared, and I found them to be either too complicated or lacking in certain areas I need. Like many others, I ended up building my own.

    Share your findings

    Recently, I started collecting local UIs and this is what I’ve gathered so far: UI list.


  • itsuka_dev@alien.topBtoLocalLLaMAWhat UI do you use and why?
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Is anyone working on local UI interested in forming a community of builders? I think it would be great to share knowledge, learn from each other, and ultimately raise the bar for a better UI for everyone.

    Anyone who wants to take the lead on this is more than welcome to. I’m just putting the idea out there.