Applied Data Science

DECEMBER 23, 2022

Just wait until you hear what happened in 2022. In our review of 2019 we talked a lot about reinforcement learning and Generative Adversarial Networks (GANs), in 2020 we focused on Natural Language Processing (NLP) and algorithmic bias, in 202 1 Transformers stole the spotlight. In 2022 we got diffusion models ( NeurIPS paper ).

Neural Network 52

Neural Network AI AI Data Science 52

Sebastian Ruder

JUNE 6, 2022

ACL 2022 took place in Dublin from 22nd–27th May 2022. Language diversity and multimodality Panelists and their spoken languages at the ACL 2022 keynote panel on supporting linguistic diversity. This was my first in-person conference since ACL 2019. This is also my first conference highlights post since NAACL 2019.

NLP 52

NLP Natural Language Processing Computational Linguistics Neural Network 52

Marek Rei

NOVEMBER 4, 2024

EMNLP 2022. EMNLP 2022. NeurIPS 2022. EMNLP 2022. EMNLP 2022. They show performance improvements in some settings and speed improvements in all evaluated settings, showing particular usefulness in settings where the LLM needs to retrieve information about multiple entities (e.g. UC Berkeley, CMU. Google Research.

Machine Learning 80

Machine Learning NLP Large Language Models LLM 80

Topbots

JANUARY 30, 2023

We are quick to attribute intelligence to models and algorithms, but how much of this is emulation, and how much is really reminiscent of the rich language capability of humans? For instance, in April 2022, DeepMind introduced Flamingo, a visual language model that can seamlessly ingest text, images and video. [5] 10.48550/arXiv.2212.08120.

Large Language Models 52

Large Language Models Computational Linguistics LLM Natural Language Processing 52

Sebastian Ruder

NOVEMBER 14, 2022

This post is partially based on a keynote I gave at the Deep Learning Indaba 2022. Linguistic and demographic global utility metrics for a number of language technology tasks. Overall, however, we observe very low linguistic utility numbers, showing an unequal performance distribution across the world's languages.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52

Allen AI

JULY 8, 2023

This research posits that simply scaling up models will not imbue them with theory of mind due to the inherently symbolic and implicit nature of the phenomenon, and instead investigate an alternative: can we design a decoding-time algorithm that enhances theory of mind of off-the-shelf neural language models without explicit supervision?

Computational Linguistics 52

Computational Linguistics NLP Explainability OpenAI 52

Topbots

JUNE 15, 2023

70% of research papers published in a computational linguistics conference only evaluated English.[ A comprehensive explanation of the BPE algorithm can be found on the HuggingFace Transformers course. In Findings of the Association for Computational Linguistics: ACL 2022 , pages 2340–2354, Dublin, Ireland.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59