Sebastian Ruder

AUGUST 18, 2019

This post expands on the NAACL 2019 tutorial on Transfer Learning in NLP. In the span of little more than a year, transfer learning in the form of pretrained language models has become ubiquitous in NLP and has contributed to the state of the art on a wide range of tasks. However, transfer learning is not a recent phenomenon in NLP.

NLP 75

NLP BERT Natural Language Processing Computational Linguistics 75

Sebastian Ruder

NOVEMBER 14, 2022

At the same time, a wave of NLP startups has started to put this technology to practical use. I will be focusing on topics related to natural language processing (NLP) and African languages as these are the domains I am most familiar with. This post takes a closer look at how the AI community is faring in this endeavour.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52

ML Review

MARCH 5, 2019

Note : The “Charts and Additional Insights” page, one chart being “Top topics from 2014 onwards”. Note : Top 100 cited papers according to the semantic scholar API from 2014+ (specifically from our arxiv dataset). In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (Vol.

AI 40

AI AI Computer Vision Computational Linguistics 40

NLP People

JULY 24, 2019

The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019) is starting this week in Florence, Italy. We took the opportunity to review major research trends in the animated NLP space and formulate some implications from the business perspective. But what is the substance behind the buzz?

NLP 52

NLP Neural Network Deep Learning Natural Language Processing 52