Euphoric-Nebula-4559@alien.topB to LocalLLaMAEnglish · 2 years agoFinetuning LLMs: Does it add new knowledge to model or not?message-squaremessage-square8linkfedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareFinetuning LLMs: Does it add new knowledge to model or not?Euphoric-Nebula-4559@alien.topB to LocalLLaMAEnglish · 2 years agomessage-square8linkfedilinkfile-text
minus-squarekristaller486@alien.topBlinkfedilinkEnglisharrow-up1·2 years agoFull-weight fine-tuning should add new knowledge. Not LoRa.
minus-squareEuphoric-Nebula-4559@alien.topOPBlinkfedilinkEnglisharrow-up1·2 years agoAny repo for llama-2 to do this?
Full-weight fine-tuning should add new knowledge. Not LoRa.
Any repo for llama-2 to do this?