AWS Machine Learning Blog

MARCH 2, 2023

Transformer-based language models such as BERT ( Bidirectional Transformers for Language Understanding ) have the ability to capture words or sentences within a bigger context of data, and allow for the classification of the news sentiment given the current state of the world. The code can be found on the GitHub repo.

BERT 88

BERT Deep Learning Metadata Auto-complete 88

Topbots

JUNE 15, 2023

70% of research papers published in a computational linguistics conference only evaluated English.[ I additionally use metadata from The World Atlas of Language Structures to obtain information such as language family (e.g. Association for Computational Linguistics. Association for Computational Linguistics.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

Sebastian Ruder

NOVEMBER 14, 2022

Research models such as BERT and T5 have become much more accessible while the latest generation of language and multi-modal models are demonstrating increasingly powerful capabilities. Writing System and Speaker Metadata for 2,800+ Language Varieties. In Findings of the Association for Computational Linguistics: ACL 2022 (pp.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52

Marek Rei

NOVEMBER 4, 2024

Linguistic Parameters of Spontaneous Speech for Identifying Mild Cognitive Impairment and Alzheimer Disease Veronika Vincze, Martina Katalin Szabó, Ildikó Hoffmann, László Tóth, Magdolna Pákáski, János Kálmán, Gábor Gosztolya. Computational Linguistics 2022. Additive embeddings are used for representing metadata about each note.

Machine Learning 80

Machine Learning NLP Large Language Models LLM 80