Marek Rei

NOVEMBER 4, 2024

They show state-of-the-art results on long-context language modelling, finding a hidden passcode from a 1M token length context, and summarizing 500K length books. BooookScore: A systematic exploration of book-length summarization in the era of LLMs Yapei Chang, Kyle Lo, Tanya Goyal, Mohit Iyyer. Computational Linguistics 2022.

Machine Learning 80

Machine Learning NLP Large Language Models LLM 80

Sebastian Ruder

JANUARY 24, 2022

2021) 2021 saw many exciting advances in machine learning (ML) and natural language processing (NLP). If CNNs are pre-trained the same way as transformer models, they achieve competitive performance on many NLP tasks [28].   Popularized by GPT-3 [32] , prompting has emerged as a viable alternative input format for NLP models.

NLP 52

NLP ML BERT Computational Linguistics 52

Topbots

JUNE 15, 2023

Language Disparity in Natural Language Processing This digital divide in natural language processing (NLP) is an active area of research. 70% of research papers published in a computational linguistics conference only evaluated English.[ Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

Google Research AI blog

JULY 10, 2023

Posted by Malaya Jules, Program Manager, Google This week, the 61st annual meeting of the Association for Computational Linguistics (ACL), a premier conference covering a broad spectrum of research areas that are concerned with computational approaches to natural language, is taking place online.

Large Language Models 93

Large Language Models Natural Language Processing Computational Linguistics NLP 93

Bugra Akyildiz

JULY 16, 2023

Natural language processing (NLP) or computational linguistics is one of the most important technologies of the information age. In this course, students will gain a thorough introduction to cutting-edge research in Deep Learning for NLP.

LLM 52

LLM Chatbots Neural Network Large Language Models 52

Sebastian Ruder

NOVEMBER 14, 2022

At the same time, a wave of NLP startups has started to put this technology to practical use. I will be focusing on topics related to natural language processing (NLP) and African languages as these are the domains I am most familiar with. This post takes a closer look at how the AI community is faring in this endeavour.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52

Sebastian Ruder

FEBRUARY 23, 2023

For modular fine-tuning for NLP, check out our EMNLP 2022 tutorial. Fixed routing can select different modules for different aspects of the target setting such as task and language in NLP or robot and task in RL, which enables generalisation to unseen scenarios. We cover such methods for NLP in our EMNLP 2022 tutorial.

Deep Learning 52

Deep Learning NLP Computer Vision Metadata 52