Power User
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
oobabooga4@alien.topB to LocalLLaMAEnglish · 2 years ago

transformers library PR: GrammarConstrainedLogitsProcessor, compatible with llama.cpp GBNF

github.com

external-link
message-square
1
link
fedilink
1
external-link

transformers library PR: GrammarConstrainedLogitsProcessor, compatible with llama.cpp GBNF

github.com

oobabooga4@alien.topB to LocalLLaMAEnglish · 2 years ago
message-square
1
link
fedilink
[Draft] Context Free Grammar Constrained Decoding (ebnf interface, compatible with llama-cpp) by Saibo-creator · Pull Request #27557 · huggingface/transformers
github.com
external-link
What does this PR do? This PR adds a new feature (Context Free Grammar Constrained Decoding) to the library. There is already one PR(WIP) for this feature( #26520 ), but this one has a different mo...
alert-triangle
You must log in or register to comment.
  • yehiaserag@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    Is GBNF a new type of extension like GGUF?

LocalLLaMA

localllama

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@poweruser.forum

Community to discuss about Llama, the family of large language models created by Meta AI.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 4 users / day
  • 4 users / week
  • 4 users / month
  • 4 users / 6 months
  • 1 local subscriber
  • 5 subscribers
  • 1.02K Posts
  • 5.82K Comments
  • Modlog
  • mods:
  • communick
  • BE: 0.19.11
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org