mlc llm(deploying llms on mobiles and in browsers)
mlc llm(deploying llms on mobiles and in browsers)
Instead of using gaussian noise(in the latent space), I wonder if we can introduce noise by randomly inserting/deleting/replacing/swaping words. Cant we train a BERT model to predict the original text from a noise-added text?
https://github.com/m-bain/whisperX/issues/569