Power User
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Significant_Focus134@alien.topB to LocalLLaMAEnglish · 2 years ago

Polanka 7b - Polish LLM based on Mistral

message-square
message-square
3
link
fedilink
1
message-square

Polanka 7b - Polish LLM based on Mistral

Significant_Focus134@alien.topB to LocalLLaMAEnglish · 2 years ago
message-square
3
link
fedilink

Warning, this is still work in progress.

https://huggingface.co/piotr-ai/polanka-7b-v0.1

First version of 7b Polish LLM finetuned using custom data in Polish language.

As a base model I used uncensored https://huggingface.co/ehartford/dolphin-2.1-mistral-7b so Dolphin “personality” should also be there.

It was trained using 4K context in ChatML format. All done on a single 4090 for multiple days.

  • paryska99@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    I hope we can get quantized gguf soon from the legendary TheBloke

LocalLLaMA

localllama

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@poweruser.forum

Community to discuss about Llama, the family of large language models created by Meta AI.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 4 users / day
  • 4 users / week
  • 4 users / month
  • 4 users / 6 months
  • 1 local subscriber
  • 11 subscribers
  • 1.02K Posts
  • 5.82K Comments
  • Modlog
  • mods:
  • communick
  • BE: 0.19.11
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org