Remove 2014 Remove Computational Linguistics Remove Neural Network
article thumbnail

The State of Transfer Learning in NLP

Sebastian Ruder

Later approaches then scaled these representations to sentences and documents ( Le and Mikolov, 2014 ; Conneau et al., This goes back to layer-wise training of early deep neural networks ( Hinton et al., Early approaches such as word2vec ( Mikolov et al., 2017 ; Peters et al., 2006 ; Bengio et al.,

NLP 75
article thumbnail

Major trends in NLP: a review of 20 years of ACL research

NLP People

The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019) is starting this week in Florence, Italy. Neural Networks are the workhorse of Deep Learning (cf. White (2014). Neural Network Methods in Natural Language Processing. References E. Cambria and B. Toutanova (2018).

NLP 52