May I know the LoRA parameters, if you used q/LoRA?

Yup, it’s the best I’ve tried for tables and math formulas.

nougat by Facebook is your best bet.

Deepseek coder should be good, you can try the quantised 34B model.

Hey, you could just download the config file and lora_train.py file and run it as I’ve explained in the readme!

To simplify it further, open both the file in any editor and load up the same environment you use for oobabooga. Then make all the changes based on your req in the lora_config.yaml file. Once you’re done just run “python lora_train.py”.

If you need further help, feel free to ask!