• Majestical-psyche@alien.topOPB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Sorry I was playing around with it for the last day… So far I prefer it over 34B Dolphin Yi (GGUF Q4_K_m)… As for context size I only used 8k and it was pretty good with going far back. It might be able to do 12K, idk… Haven’t tried it.