Shi Yu Yu-Shi
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2020/07/17 | |
| Title: Cross-lingual Language Model Pretraining | |
| Area: LM | |
| Year: 2019 | |
| 本文提出了训练跨语言 LM 的方法。一种方法比较直接，使用多个单语言的语料，使用合并的 BPE。还提出了一种使用平行语料的有监督训练方法 TLM。TLM 是 MLM 的扩充。将两个平行的语句 concat 到一起作为输入，采用类似的方法 mask 掉部分词。模型为了预测词，既可以根据周围的词汇推断，又可以根据平行语料进行推断，这一点比较新颖。 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cat ~/.ssh/id_rsa.pub | ssh username@server "cat >> ~/.ssh/authorized_keys" |