I am quite new to finetuning and have been planning to finetune the Mistral 7B model on the SHP Dataset. However I am not sure on what is the right prompt format to use. As of right now I think the alpaca format is the way to go but im not too sure. Can anyone guide me here ? Thanks!

Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

​

### Instruction:

{instruction}

​

### Input:

{input}

### Response:

  • nobodycares_no@alien.topBEnglish
    1·
    1 year ago

    I’m also new to this but if you are using the base Mistral model then you can fine-tune it using any format that you’d like and if you are planning to fine-tune the instruct version you should use the official prompt template for the best results (again, i’m also new to this)

    <s>[INST] Instruction [/INST] Model answer</s>