This is my latest output after re-installing the entire program. I re-downloaded your model and used the q4_k version this time rather than q4_k_m. Still running into this weird issue, where after its done, i get another answer, but this time its from gpt4. I have no idea what that even means. I tried to highlight my settings in red.
- 0 Posts
- 3 Comments
Joined 1 year ago
Cake day: October 25th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
How do you figure out the correct config files for models. I am using LMstudio. For example, say I have this. How am I supposed to know how to distill this info for each model? Is there some sort of guide or logic to learn. Its driving me crazy.
Prompt template: OpenChat
GPT4 User: {prompt}<|end_of_turn|>GPT4 Assistant:
I’ve tried 10 coding models ranging from 7b to 13b, and open hermes is by far the best. All the other models struggled with anything not python. They couldn’t even get hello world to be typed backwards in c++. If anyone has any proven suggestions to a 13B model thats better, please do share.