The Stanford AI Lab Blog

MAY 25, 2022

The 60th Annual Meeting of the Association for Computational Linguistics (ACL) 2022 is taking place May 22nd - May 27th. We’re excited to share all the work from SAIL that’s being presented, and you’ll find links to papers, videos and blogs below.

Computational Linguistics 40

Computational Linguistics Robotics BERT Large Language Models 40

Viso.ai

JULY 18, 2024

Emergence and History of LLMs Artificial Neural Networks (ANNs) and Rule-based Models The foundation of these Computational Linguistics models (CL) dates back to the 1940s when Warren McCulloch and Walter Pitts laid the groundwork for AI. GPT-4, BERT) based on your specific task requirements.

Large Language Models 52

Large Language Models Neural Network Natural Language Processing BERT 52

Topbots

JUNE 15, 2023

70% of research papers published in a computational linguistics conference only evaluated English.[ In Findings of the Association for Computational Linguistics: ACL 2022 , pages 2340–2354, Dublin, Ireland. Association for Computational Linguistics. Are All Languages Created Equal in Multilingual BERT?

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

Explosion

DECEMBER 28, 2019

The update fixed outstanding bugs on the tracker, gave the docs a huge makeover, improved both speed and accuracy, made installation significantly easier and faster, and added some exciting new features, like ULMFit/BERT/ELMo-style language model pretraining. ✨ Mar 20: A few days later, we upgraded Prodigy to v1.8 to support spaCy v2.1.

NLP 52

NLP BERT Machine Learning Python 52

Sebastian Ruder

NOVEMBER 14, 2022

Research models such as BERT and T5 have become much more accessible while the latest generation of language and multi-modal models are demonstrating increasingly powerful capabilities. In Findings of the Association for Computational Linguistics: ACL 2022 (pp. RoBERTa: A Robustly Optimized BERT Pretraining Approach.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52

The Stanford AI Lab Blog

JANUARY 21, 2022

Conference of the North American Chapter of the Association for Computational Linguistics. ↩ Devlin, J., BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. RoBERTa: A Robustly Optimized BERT Pretraining Approach. . ↩ Peters, M., Neumann, M., Gardner, M., Zettlemoyer, L.

Robotics 40

Robotics Computational Linguistics BERT Computer Vision 40

Sebastian Ruder

JANUARY 24, 2022

6] such as W2v-BERT [7] as well as more powerful multilingual models such as XLS-R [8]. For each input chunk, nearest neighbor chunks are retrieved using approximate nearest neighbor search based on BERT embedding similarity. W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training.

NLP 52

NLP ML BERT Computational Linguistics 52

Applied Data Science

DECEMBER 23, 2022

The first computational linguistics methods tried to bypass the immense complexity of human language learning by hard-coding syntax and grammar rules in their models. As humans we do not know exactly how we learn language: it just happens. The debate was on again: maybe language generation is really just a prediction task?

Neural Network 52

Neural Network Data Science AI AI 52

Sebastian Ruder

DECEMBER 6, 2021

Reading Comprehension assumes a gold paragraph is provided Standard approaches for reading comprehension build on pre-trained models such as BERT. Using BERT for reading comprehension involves fine-tuning it to predict a) whether a question is answerable and b) whether each token is the start and end of an answer span.

BERT 52

BERT NLP Natural Language Processing Computational Linguistics 52

Marek Rei

NOVEMBER 4, 2024

Linguistic Parameters of Spontaneous Speech for Identifying Mild Cognitive Impairment and Alzheimer Disease Veronika Vincze, Martina Katalin Szabó, Ildikó Hoffmann, László Tóth, Magdolna Pákáski, János Kálmán, Gábor Gosztolya. Computational Linguistics 2022. University of Szeged. Imperial, Google Research.

Machine Learning 80

Machine Learning NLP Large Language Models LLM 80

NLP People

JULY 24, 2019

The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019) is starting this week in Florence, Italy. Especially pre-trained word embeddings such as Word2Vec, FastText and BERT allow NLP developers to jump to the next level. Transfer learning is another approach to reusing models across different tasks.

NLP 52

NLP Neural Network Deep Learning Natural Language Processing 52