Backup of BERT (No. 4)

• Backup list
• View the diff.
• View the diff current.
• View the diff for visual.
• View the source.
• Go to BERT.
  • 1 (2019-11-30 (Sat) 18:34:22)
  • 2 (2020-01-28 (Tue) 14:13:45)
  • 3 (2020-05-04 (Mon) 17:53:17)
  • 4 (2020-09-24 (Thu) 18:44:20)

MachineLearning > Transformer > NaturalLanguageProcessing

• XLNet
• ALBERT (a Lite BERT)
• DistillBERT

言語毎

• 🇩🇪 German BERT https://deepset.ai/german-bert
• 🇫🇷 CamemBERT https://arxiv.org/abs/1911.03894, FlauBERT https://arxiv.org/abs/1912.05372
• 🇮🇹 AlBERTo http://ceur-ws.org/Vol-2481/paper57.pdf
• 🇳🇱 RobBERT https://arxiv.org/abs/2001.06286
• 🇷🇺 RuBERT https://arxiv.org/abs/1912.09582
• 🇪🇸 BETO https://github.com/dccuchile/beto
• 🇳🇱 BERTje https://arxiv.org/abs/1912.09582
• 🇧🇷 Portuguese BERT https://github.com/neuralmind-ai/portuguese-bert
• 🇩🇪https://github.com/dbmdz/berts/blob/master/README.md

.

• はじめての自然言語処理 第3回 BERT を用いた自然言語処理における転移学習
  • https://www.ogis-ri.co.jp/otc/hiroba/technical/similar-document-search/part3.html

• 事前学習言語モデルを用いたVision & Languageの動向 / A Survey of Pre-trained Language Models for Vision & Language
  • https://speakerdeck.com/kyoun/a-survey-of-pre-trained-language-models-for-vision-and-language/

• 自然言語処理の王様「BERT」の論文を徹底解説
  • https://qiita.com/omiita/items/72998858efc19a368e50