Sebastian Ruder

NOVEMBER 14, 2022

This post is partially based on a keynote I gave at the Deep Learning Indaba 2022. Linguistic and demographic global utility metrics for a number of language technology tasks. Overall, however, we observe very low linguistic utility numbers, showing an unequal performance distribution across the world's languages.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52

Allen AI

MAY 30, 2023

2022; Levine et al., arXiv preprint arXiv:2201.07763 (2022). In Findings of the Association for Computational Linguistics: EMNLP 2020 , pp. 2020; Awad et al., Learning to ask the right questions We use Reinforcement Learning (PPO) to train our question generation system. When is it acceptable to break the rules?

Computational Linguistics 52

Computational Linguistics Linked Data Chatbots NLP 52

Allen AI

JULY 8, 2023

2022) tasks showcase a scenario where initial predictions by a learned model (yˆ) are incorrect. Two examples for action planning (Tandon et al., 2021) and summarization (Saunders et al., Human-written critiques © indicate errors in model outputs. While humans can reliably critique each other, machines lack such ability.

Computational Linguistics 52

Computational Linguistics NLP Explainability OpenAI 52

Topbots

JUNE 15, 2023

70% of research papers published in a computational linguistics conference only evaluated English.[ In Findings of the Association for Computational Linguistics: ACL 2022 , pages 2340–2354, Dublin, Ireland. Association for Computational Linguistics. Association for Computational Linguistics.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

ODSC - Open Data Science

APRIL 3, 2023

She is currently the president of the Association of Computational Linguistics. In 2022, she received an ERC Advanced Grant to support her vision for the next big step in NLP, “InterText — Modeling Text as a Living Object in a Cross-Document Context.”

Neural Network 117

Neural Network Natural Language Processing NLP Computational Linguistics 117

Sebastian Ruder

FEBRUARY 23, 2023

For modular fine-tuning for NLP, check out our EMNLP 2022 tutorial. We cover such methods for NLP in our EMNLP 2022 tutorial. This post gives a brief overview of modularity in deep learning. For a more in-depth review, refer to our survey. For more resources, check out modulardeeplearning.com. These models are monoliths.

Deep Learning 52

Deep Learning NLP Computer Vision Metadata 52

Flipboard

SEPTEMBER 7, 2023

We’re kind of at the point where we can make fire but do not even have the rudiments of what we’d need to understand it,” my friend Luke Gessler , a computational linguist, told me. We have no reason to believe any current AIs are sentient, but we also have no way of knowing whether or how that could change.

AI 181

AI AI Computational Linguistics Chatbots 181

Sebastian Ruder

JANUARY 24, 2022

It also requires developing models for which the input does not exist in a vacuum but is grounded to extra-linguistic context and the real world. For more work on this topic, check out the EvoNLP workshop at EMNLP 2022. Transactions of the Association for Computational Linguistics, 9, 978–994. Schneider, R.,

NLP 52

NLP ML BERT Computational Linguistics 52

AWS Machine Learning Blog

MAY 22, 2023

arXiv preprint arXiv:2210.11416 (2022). [2] Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). “Scaling instruction-fine tuned language models.” 2] Rajpurkar, Pranav, Robin Jia, and Percy Liang. Know What You Don’t Know: Unanswerable Questions for SQuAD.”

Natural Language Processing 112

Natural Language Processing Machine Learning Computational Linguistics NLP 112

Snorkel AI

JUNE 14, 2023

He presented “Toward Superhuman Communication Assistance” at Snorkel AI’s The Future of Data-Centric AI Summit in 2022. That ranges all the way from analytical and computational linguists to applied research scientists, machine learning engineers, data scientists, product managers, designers, UX researchers, and so on.

Machine Learning 52

Machine Learning Natural Language Processing Data Scientist Computational Linguistics 52

Snorkel AI

JUNE 14, 2023

He presented “Toward Superhuman Communication Assistance” at Snorkel AI’s The Future of Data-Centric AI Summit in 2022. That ranges all the way from analytical and computational linguists to applied research scientists, machine learning engineers, data scientists, product managers, designers, UX researchers, and so on.

Machine Learning 52

Machine Learning Natural Language Processing Data Scientist Computational Linguistics 52

Mlearning.ai

FEBRUARY 6, 2023

2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics. [7] 57th Annual Meeting of the Association for Computational Linguistics [9] C. 2022) Shtetl-Optimized: The Blog of Scott Aaronson. [11] Resources and References [1] A. OpenAI [4] E. Mitchell, Y. Weigreffe, Y.

Explainable AI 52

Explainable AI Explainability ChatGPT Chatbots 52

Marek Rei

OCTOBER 4, 2019

2018 saw the launch of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL), which is organising its first conference next year (co-located with IJCNLP) in Suzhou, China. One good reason to take our major conferences to new countries is to equalise the barrier of obtaining visas to attend.

NLP 52

NLP Computational Linguistics Automation ML 52

ML @ CMU

SEPTEMBER 22, 2023

Trends Human Computer Interaction. [2] In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). [3] In CHI Conference on Human Factors in Computing Systems. [5] In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.

Computational Linguistics 106

Computational Linguistics LLM Large Language Models Algorithm 106