Has anyone explored Intel’s new model yet? It’s a 7B model trained on Slim Orca, which is currently the top 7B model on the HF open LLM leaderboard.

I’ve found other 7B models to be surprisingly helpful, especially for annotation/data extraction tasks, so I’m curious if it’s worth replacing teknium/OpenHermes-2.5-Mistral-7B with this model.

  • vatsadev@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    IMPORTANT!

    this isnt trained, its another mistral finetune, with dpo, but with slimorca, not ultrachat.

    I would be using openHermes, its much more trialed, and its proven solid

      • vatsadev@alien.topB
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        OpenHermes 2.5 is the latest version, but the openHermes series has a history in ai models of being good, and I used it for some function calling, its really good