Don’t use an LLM for translation, use an MT model for that.

which as far as I know, isn’t an AI.

Google Translate uses an AI, but not an LLM. It uses a “neural machine” so basically an MT model.

google translate is an ai, it works in a fairly similar way to llms, it’s just a little less general

As far as I tried this kind of things, it works well in French.

And I think there is more French than Portuguese in the majority of training data sets, so it might be related?

I also have plans for generating Portuguese contents, and yes they are also quite poor on translating, even worse when we’re talking about European Portuguese. I’m considering using specialized models for translation, such as Argos translate, but I didn’t test it yet, I’m poor in hardware resources and this is a pet project.

Claude 2 and gpt4 do a pretty good job for English to Italian and vice versa. Gpt3.5 seem a little more “robotic” for English > italian, but work fine with italian > English.

Obviously that’s only feeling…i haven’t done any objective test.

ChatGPT and GPT 4 have been significantly more accurate than google translate for Norwegian.

Edit: Compare the grammar and spelling of properly uncensored models with censored ones, when it comes to “gendered” grammar and natural language concepts. There is a huge difference.

That’s not the question of language, that’s the result of promoting diversity through censorship, and the worst part is, none of the big companies give a faintest whiff of a fuck about diversity or minorities, they are just crossing things off of their marketing bucket list.

Censorship causes massive performance degradation. If you mindlessly force a model to have a bias, no matter the subject, the model will propagate this bias throughout its entire base knowledge.

Good or bad, a bias is a bias, because we are talking about computers, which are deterministic and literal and computer code only ever takes things literally, and LLMs are barely the first step towards generalisation and unassisted extrapolation.

Even when the general concept of say, fighting gender discrimination, is good in its core, force-feeding that to an LLM which is a computer code after all, will do stuff like making it completely loose the concept of genders, including linguistics concepts, solely because they share the word “gender” through literature and so the training dataset.

Yes, discrimination is stupid, racism is stupid, forcing everybody to live exactly the one “right” way is stupid.

But using censorship, to fight this, is hands down the dumbest, and laziest way possible.