30,000 AI models
too many really. But from what I read in conversations and posts I notice one thing: you all try out Model all the time and that’s fine, but I haven’t yet read that anyone habitually uses one Model over others. It seems like you use one template for a few days and then start with a new one. Don’t have your favorite? Which?
OpenHermes-2.5-Mistral-7B is better than all the 13b and 7b model available.
What settings you use for it? In what UI? I tried it in silly tavern yesterday (via ooba backend), unmitigated disaster… tried bunch of setting nothing worked, as far as I go prompt template should be ChatML, but even with that…