1·
1 year agoI could not get any of the quants loaded, looks like the config is looking for XX of 25 safetensors
FileNotFoundError: No such file or directory: "models\Venus-120b-v1.0\model-00001-of-00025.safetensors"
with exl2-3.0bpw having only XX of 06 safetensors
Defaulted to transformers, loaded right away in ExLlamav2_HF, thank you I didn’t know what I don’t know.