Power User
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Deadlibor@alien.topB to LocalLLaMAEnglish · 2 years ago

What UI do you use and why?

message-square
message-square
57
link
fedilink
1
message-square

What UI do you use and why?

Deadlibor@alien.topB to LocalLLaMAEnglish · 2 years ago
message-square
57
link
fedilink

From the wiki:

Text generation web UI

llama.cpp

KoboldCpp

vLLM

MLC LLM

Text Generation Inference

  • SatoshiNotMe@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    A bit related. I think all the tools mentioned here are for using an existing UI.

    But what if you wanted to easily roll your own, preferably in Python. I know of some options:

    StreamLit

    Gradio https://www.gradio.app/guides/creating-a-custom-chatbot-with-blocks

    Panel https://www.anaconda.com/blog/how-to-build-your-own-panel-ai-chatbots

    Reflex (formerly Pynecone) https://github.com/reflex-dev/reflex-chat https://news.ycombinator.com/item?id=35136827

    Solara https://news.ycombinator.com/item?id=38196008 https://github.com/widgetti/wanderlust

    I like streamlit (simple but not very versatile) And reflex seems to have a richer set of features.

    My questions - Which of these do people like to use the most? Or are the tools mentioned by OP also good for rolling your own UI on top of your own software ?

LocalLLaMA

localllama

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@poweruser.forum

Community to discuss about Llama, the family of large language models created by Meta AI.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 4 users / day
  • 4 users / week
  • 4 users / month
  • 4 users / 6 months
  • 1 local subscriber
  • 11 subscribers
  • 1.02K Posts
  • 5.82K Comments
  • Modlog
  • mods:
  • communick
  • BE: 0.19.11
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org