Power User
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
luncheroo@alien.topB to LocalLLaMAEnglish · 2 years ago

Oh We Were So Close, Little 7b Buddy

alien.top

message-square
8
link
fedilink
1

Oh We Were So Close, Little 7b Buddy

alien.top

luncheroo@alien.topB to LocalLLaMAEnglish · 2 years ago
message-square
8
link
fedilink
alert-triangle
You must log in or register to comment.
  • Binliner42@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    What is this GUI?

  • ShiftyTys@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    That’s actually fkn hilarious

  • gar1t@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    The Gambler benchmark: 0.96

    • luncheroo@alien.topOPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 years ago

      I’m going to petition Huggingface to add it.

  • TheManicProgrammer@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    May I ask what preset are you using? In my LMStudio it cannot seem to find a correct one

  • BrainSlugs83@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    How does the q8_0 version of that model do?

    • luncheroo@alien.topOPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      2 years ago

      I’m sorry to not be able to report this. I usually aim for the Q5_K_M models due to current hardware limitations with my system.

  • TheManicProgrammer@alien.topB
    link
    fedilink
    arrow-up
    1
    ·
    2 years ago

    Ok thank you!

LocalLLaMA

localllama

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@poweruser.forum

Community to discuss about Llama, the family of large language models created by Meta AI.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 4 users / day
  • 4 users / week
  • 4 users / month
  • 4 users / 6 months
  • 1 local subscriber
  • 11 subscribers
  • 1.02K Posts
  • 5.82K Comments
  • Modlog
  • mods:
  • communick
  • BE: 0.19.11
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org