minus-squareAtticusAtom@alien.topBtoLocalLLaMA•Structured Output with ZephyrlinkfedilinkEnglisharrow-up1·3 years agoThe correct answer here is reading logprobs/logits over the true/false tokens after parsing the input. Using a grammar is overkill and a classification model might not get you the fidelity you want. linkfedilink
The correct answer here is reading logprobs/logits over the true/false tokens after parsing the input.
Using a grammar is overkill and a classification model might not get you the fidelity you want.