• 0 Posts
  • 1 Comment
Joined 1 year ago
cake
Cake day: November 10th, 2023

help-circle
  • catzilla_06790@alien.topBtoLocalLLaMAlocal llm in own GUI
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I wanted to learn about writing an application using LLMs. My goal was to write something that I could load a set of PDFs and ask questions about them., all on my PC.

    I used PySide6 (Qt for Python) for the GUI since I was pretty familiar with Qt and C++, and I’m not a fan or running apps in a browser.

    I used a combination of HuggingFace APIs and Langchain to write the application itself, and ended up with a somewhat generalized application that I could load different models.

    It works, maybe not perfectly, but I did accomplish what I wanted, to learn about implementing an application.

    I did the same thing with Stable Diffusion models, but with just HuggingFace APIs, no Langchain.