Is this modal just not good enough? I would think it would know the difference between python and js at the very least?
You must log in or register to comment.
Try DeepSeek Coder, the 6.7b is so much better than CodeLlama any of them
Also i’d give the new openchat 3.5, if the benchmarks are indeed correct then it’s the best 7B model so far (altough there are so many of them that i might be wrong, but it’s better than base mistral 7B)
I’ll be honest- my expectation of a 7b q6 model to generate a usable code block would be pretty darn low. I use 7b as a small code snippet analyzer in Continue.dev, but I’m not sure I’d really put a lot of faith in any 7b to do that task. The CodeLlama 34b models are actually pretty decent, though; I use the 34b q8 of CodeFuse, Codebooga and Phind v2 and they are all pretty decent.
Make sure you are using the Codellama Instruct preset. Also, work on your prompting:
“You are tasked to write a python script that takes an email address…”