Sebastian Ruder

AUGUST 18, 2019

2017 ) and pretrained language models ( Peters et al., 2017 ; Peters et al., This goes back to layer-wise training of early deep neural networks ( Hinton et al., 2017 ; Howard and Ruder, 2018 ; Chronopoulou et al., CoNLL 2017 , Kirkpatrick et al., PNAS 2017 ). 2018 ; Akbik et al., 2006 ; Bengio et al.,

NLP 75

NLP BERT Natural Language Processing Computational Linguistics 75

The Stanford AI Lab Blog

OCTOBER 13, 2021

In Proceedings of the IEEE International Conference on Computer Vision, pp. Distributionally robust neural networks for group shifts: On the importance of regularization for worst-case generalization. In Association for Computational Linguistics (ACL), pp. Selective classification for deep neural networks.

Neural Network 40

Neural Network Machine Learning Computational Linguistics Deep Learning 40

Sebastian Ruder

JUNE 6, 2022

The initiative focuses on making Computational Linguistics (CL) research accessible in 60 languages and across all modalities, including text/speech/sign language translation, closed captioning, and dubbing. To supervise models, we can use incidental supervision such as comparable texts ( Roth, 2017 ).

NLP 52

NLP Natural Language Processing Computational Linguistics Neural Network 52

Sebastian Ruder

JANUARY 24, 2022

Transactions of the Association for Computational Linguistics, 9, 978–994. Transactions of the Association for Computational Linguistics, 9, 570–585. In Proceedings of NIPS 2017. Skillful Twelve Hour Precipitation Forecasts using Large Context Neural Networks, 1–34. Schneider, R.,

NLP 52

NLP ML BERT Computational Linguistics 52

NLP People

JULY 24, 2019

The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019) is starting this week in Florence, Italy. Neural Networks are the workhorse of Deep Learning (cf. Goldberg and Hirst (2017) for an introduction of the basic architectures in the NLP context). Hirst (2017). Jaitly (2017).

NLP 52

NLP Neural Network Deep Learning Natural Language Processing 52

Probably Approximately a Scientific Blog

OCTOBER 30, 2017

Take for example a Google search for "ACL 2017". 2017 " is a context word for the acronym ACL ), it is possible to find texts that contain the expansion. Today, similarly to other NLP tasks, parsers are mostly based on neural networks. Given enough context (e.g. This can either be by searching for a pattern (e.g.

Natural Language Processing 52

Natural Language Processing NLP Machine Learning Computational Linguistics 52