second for this. I haven’t tested it for code yet, but it’s very enjoyable to converse with. I find it does summaries quite well, I have asked it about a wide range of topics and it has been ~90% correct on the first response, and can kind of fall apart after going back and forth a few times, but it’s only 7b.
Could you share your temperature and sampler settings for OpenHermes? I see it recommended all over the place, but I get only mediocre results with it in SillyTavern.
Loved the responses from OpenHermes 2.5, however found the inference on the slower side especially when comparing it to other 7B models like Zephyr 7B or Vicuna 1.5 7B
Mistral OpenHermes 2.5
second for this. I haven’t tested it for code yet, but it’s very enjoyable to converse with. I find it does summaries quite well, I have asked it about a wide range of topics and it has been ~90% correct on the first response, and can kind of fall apart after going back and forth a few times, but it’s only 7b.
Could you share your temperature and sampler settings for OpenHermes? I see it recommended all over the place, but I get only mediocre results with it in SillyTavern.
Loved the responses from OpenHermes 2.5, however found the inference on the slower side especially when comparing it to other 7B models like Zephyr 7B or Vicuna 1.5 7B