Sebastian Ruder

NOVEMBER 14, 2022

Initiatives   The Association for Computational Linguistics (ACL) has emphasized the importance of language diversity, with a special theme track at the main ACL 2022 conference on this topic. 2020) (Ahia et al., The size of the gradient circle represents the number of languages in the class.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics AI 52

Applied Data Science

DECEMBER 23, 2022

In our review of 2019 we talked a lot about reinforcement learning and Generative Adversarial Networks (GANs), in 2020 we focused on Natural Language Processing (NLP) and algorithmic bias, in 202 1 Transformers stole the spotlight. Just wait until you hear what happened in 2022.

Neural Network 52

Neural Network AI AI Data Science 52

The Stanford AI Lab Blog

FEBRUARY 1, 2022

Towards a human-like open-domain chatbot arXiv preprint arXiv:2001.09977 (2020). ↩ Roller, Stephen, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu et al. Recipes for building an open-domain chatbot arXiv preprint arXiv:2004.13637 (2020). ↩ Hannah Raskin, Eric Michael Smith, Margaret Li, and Y-Lan Boureau.

Computational Linguistics 40

Computational Linguistics Chatbots Robotics Natural Language Processing 40

Mlearning.ai

FEBRUARY 19, 2023

GPT-3 is a autoregressive language model created by OpenAI, released in 2020 . OpenAI’s research paper on the GPT-3, “Language Models are Few-Shot Learners” was released in May 2020 and it outlined the fact that state-of-the-art GPT-3 generated text is nearly indistinguishable to that of the text written by humans. What is GPT-3?

Auto-classification 52

Auto-classification Natural Language Processing Auto-complete NLP 52

Sebastian Ruder

JUNE 6, 2022

The initiative focuses on making Computational Linguistics (CL) research accessible in 60 languages and across all modalities, including text/speech/sign language translation, closed captioning, and dubbing. Another useful aspect of the initiative is the curation of the most common CL terms and their translation into 60 languages.

NLP 52

NLP Natural Language Processing Computational Linguistics Neural Network 52

Sebastian Ruder

DECEMBER 6, 2021

2020 ) train models to maximize the similarity between question and passage and then retrieve the most relevant passages via maximum inner product search. 2020 ) Multi-Domain QA In each of the two main sections of this post, we will first discuss common datasets and then modelling approaches. 2020 ) and AskUbuntu ( dos Santos et al.,

BERT 52

BERT NLP Natural Language Processing Computational Linguistics 52

Topbots

JANUARY 30, 2023

In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pages 5185–5198, Online. Association for Computational Linguistics. [2] Association for Computational Linguistics. [4] References [1] Emily M. Bender and Alexander Koller. 4] Ryan Daws. 5] DeepMind.

Large Language Models 52

Large Language Models LLM Computational Linguistics Natural Language Processing 52

Topbots

JUNE 15, 2023

70% of research papers published in a computational linguistics conference only evaluated English.[ In Findings of the Association for Computational Linguistics: ACL 2022 , pages 2340–2354, Dublin, Ireland. Association for Computational Linguistics. Association for Computational Linguistics.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

Sebastian Ruder

JANUARY 24, 2022

  Retrieval-augmented language models, which integrate retrieval into pre-training and downstream usage, have already featured in my highlights of 2020. Advances in Neural Information Processing Systems, 2020. Transactions of the Association for Computational Linguistics, 9, 978–994. What happened?  

NLP 52

NLP ML BERT Computational Linguistics 52

The Stanford AI Lab Blog

JANUARY 21, 2022

Conference of the North American Chapter of the Association for Computational Linguistics. ↩ Devlin, J., Annual Meeting of the Association for Computational Linguistics. ↩ Brown et al. Florence: A New Foundation Model for Computer Vision. . ↩ Peters, M., Neumann, M., Gardner, M., Toutanova, K.

Robotics 40

Robotics Computational Linguistics Computer Vision BERT 40

Explosion

DECEMBER 28, 2019

Adriane is a computational linguist who has been engaged in research since 2005, completing her PhD in 2012. Dec 9: Ines’ key thoughts on trends in AI from 2019 and looking into 2020. With the community and the team continuing to grow, we look forward to making 2020 even better. Thanks for all your support!

NLP 52

NLP BERT Machine Learning Python 52

Marek Rei

OCTOBER 4, 2019

2018 saw the launch of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL), which is organising its first conference next year (co-located with IJCNLP) in Suzhou, China. The first AACL conference in 2020 is very encouraging. We set out to write this post with a focus on geographic diversity in NLP.

NLP 52

NLP Computational Linguistics Automation AI 52

ML @ CMU

SEPTEMBER 22, 2023

Trends Human Computer Interaction. [2] In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). [3] In CHI Conference on Human Factors in Computing Systems. [5] In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.

Computational Linguistics 112

Computational Linguistics LLM Large Language Models Algorithm 112