Loved the responses from OpenHermes 2.5, however found the inference on the slower side especially when comparing it to other 7B models like Zephyr 7B or Vicuna 1.5 7B
- 0 Posts
- 2 Comments
Joined 2 years ago
Cake day: November 24th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Haven’t you noticed slower inference from OpenHermes 2.5 compared to other 7B models?