Sebastian Ruder

NOVEMBER 14, 2022

At the same time, a wave of NLP startups has started to put this technology to practical use. I will be focusing on topics related to natural language processing (NLP) and African languages as these are the domains I am most familiar with. This post is partially based on a keynote I gave at the Deep Learning Indaba 2022.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics AI 52

Sebastian Ruder

JANUARY 24, 2022

2021) 2021 saw many exciting advances in machine learning (ML) and natural language processing (NLP). If CNNs are pre-trained the same way as transformer models, they achieve competitive performance on many NLP tasks [28].   Popularized by GPT-3 [32] , prompting has emerged as a viable alternative input format for NLP models.

NLP 52

NLP ML BERT Computational Linguistics 52

Topbots

JUNE 15, 2023

Language Disparity in Natural Language Processing This digital divide in natural language processing (NLP) is an active area of research. 70% of research papers published in a computational linguistics conference only evaluated English.[ Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

Topbots

JANUARY 30, 2023

For instance, in April 2022, DeepMind introduced Flamingo, a visual language model that can seamlessly ingest text, images and video. [5] In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pages 5185–5198, Online. Association for Computational Linguistics. [2] 2212.08120.

Large Language Models 52

Large Language Models LLM Computational Linguistics Natural Language Processing 52

Allen AI

MAY 30, 2023

2022; Levine et al., arXiv preprint arXiv:2201.07763 (2022). In Findings of the Association for Computational Linguistics: EMNLP 2020 , pp. 2020; Awad et al., Learning to ask the right questions We use Reinforcement Learning (PPO) to train our question generation system. When is it acceptable to break the rules?

Computational Linguistics 52

Computational Linguistics Linked Data Chatbots NLP 52

Sebastian Ruder

FEBRUARY 23, 2023

For modular fine-tuning for NLP, check out our EMNLP 2022 tutorial. Fixed routing can select different modules for different aspects of the target setting such as task and language in NLP or robot and task in RL, which enables generalisation to unseen scenarios. We cover such methods for NLP in our EMNLP 2022 tutorial.

Deep Learning 52

Deep Learning NLP Computer Vision Metadata 52

Mlearning.ai

FEBRUARY 6, 2023

This methodology has been used to provide explanations for sentiment classification, topic tagging, and other NLP tasks and could potentially work for chatbot-writing detection as well. 2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics. [7] Resources and References [1] A.

Explainable AI 52

Explainable AI Explainability ChatGPT Chatbots 52

AWS Machine Learning Blog

MAY 22, 2023

Amazon EBS is well suited to both database-style applications that rely on random reads and writes, and to throughput-intensive applications that perform long, continuous reads and writes. """, """ Amazon Comprehend uses natural language processing (NLP) to extract insights about the content of documents.

Natural Language Processing 85

Natural Language Processing Machine Learning Computational Linguistics NLP 85

Snorkel AI

JUNE 14, 2023

Timo Mertens is the Head of ML and NLP Products at Grammarly. He presented “Toward Superhuman Communication Assistance” at Snorkel AI’s The Future of Data-Centric AI Summit in 2022. I’m very excited to see how machine learning and NLP can come together at Grammarly to help our users with those foundational and fundamental tasks.

Machine Learning 52

Machine Learning Natural Language Processing Data Scientist Computational Linguistics 52

Snorkel AI

JUNE 14, 2023

Timo Mertens is the Head of ML and NLP Products at Grammarly. He presented “Toward Superhuman Communication Assistance” at Snorkel AI’s The Future of Data-Centric AI Summit in 2022. I’m very excited to see how machine learning and NLP can come together at Grammarly to help our users with those foundational and fundamental tasks.

Machine Learning 52

Machine Learning Natural Language Processing Data Scientist Computational Linguistics 52