Sebastian Ruder

JANUARY 24, 2022

2021) 2021 saw many exciting advances in machine learning (ML) and natural language processing (NLP).   2021 saw the continuation of the development of ever larger pre-trained models. 2021 saw the development of alternative model architectures that are viable alternatives to the transformer. style loss.

NLP 52

NLP ML BERT Computational Linguistics 52

Allen AI

JULY 8, 2023

This research posits that simply scaling up models will not imbue them with theory of mind due to the inherently symbolic and implicit nature of the phenomenon, and instead investigate an alternative: can we design a decoding-time algorithm that enhances theory of mind of off-the-shelf neural language models without explicit supervision?

Computational Linguistics 52

Computational Linguistics NLP Explainability OpenAI 52

Sebastian Ruder

NOVEMBER 14, 2022

For a recent study [3] , we similarly reviewed papers from ACL 2021 and found that almost 70% of papers only evaluate on English. Initiatives   The Association for Computational Linguistics (ACL) has emphasized the importance of language diversity, with a special theme track at the main ACL 2022 conference on this topic.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52

The Stanford AI Lab Blog

JANUARY 21, 2022

Indeed, this recipe of massive, diverse datasets combined with scalable offline learning algorithms (e.g. Replicating these impressive generalization and adaptation capabilities in robot learning algorithms would certainly be a step toward robots that can be used in unstructured, real world environments. Chen, Suraj Nair, Chelsea Finn.

Robotics 40

Robotics Computational Linguistics BERT Computer Vision 40

Topbots

JANUARY 30, 2023

400k AI-related online texts since 2021) Disclaimer: This article was written without the support of ChatGPT. We are quick to attribute intelligence to models and algorithms, but how much of this is emulation, and how much is really reminiscent of the rich language capability of humans? Association for Computational Linguistics. [2]

Large Language Models 52

Large Language Models Computational Linguistics LLM Natural Language Processing 52

Applied Data Science

DECEMBER 23, 2022

In our review of 2019 we talked a lot about reinforcement learning and Generative Adversarial Networks (GANs), in 2020 we focused on Natural Language Processing (NLP) and algorithmic bias, in 202 1 Transformers stole the spotlight. This trend started in 2021, with OpenAI Codex , a GPT-3 based tool. How is this even possible?

Neural Network 52

Neural Network Data Science AI AI 52

Sebastian Ruder

JUNE 6, 2022

The initiative focuses on making Computational Linguistics (CL) research accessible in 60 languages and across all modalities, including text/speech/sign language translation, closed captioning, and dubbing. For more on code-switching, check out this excellent ACL 2021 survey. Similarly, Hofmann et al.

NLP 52

NLP Natural Language Processing Computational Linguistics Neural Network 52