AWS Machine Learning Blog

MARCH 2, 2023

He spent 10 years as Head of Morgan Stanley’s Algorithmic Trading Division in San Francisco. Ana has had several leadership roles at startups and large corporations such as Intel and eBay, leading ML inference and linguistics related products. He is an Expert Advisor of Digital Technologies for Circular Economy with United Nations.

BERT 98

BERT Deep Learning Metadata Auto-complete 98

Marek Rei

NOVEMBER 4, 2024

Linguistic Parameters of Spontaneous Speech for Identifying Mild Cognitive Impairment and Alzheimer Disease Veronika Vincze, Martina Katalin Szabó, Ildikó Hoffmann, László Tóth, Magdolna Pákáski, János Kálmán, Gábor Gosztolya. Computational Linguistics 2022. Additive embeddings are used for representing metadata about each note.

Machine Learning 80

Machine Learning NLP Large Language Models LLM 80

Topbots

JUNE 15, 2023

70% of research papers published in a computational linguistics conference only evaluated English.[ A comprehensive explanation of the BPE algorithm can be found on the HuggingFace Transformers course. I additionally use metadata from The World Atlas of Language Structures to obtain information such as language family (e.g.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

Sebastian Ruder

FEBRUARY 23, 2023

d) Hypernetwork: A small separate neural network generates modular parameters conditioned on metadata.  Instead of learning module parameters directly, they can be generated using an auxiliary model (a hypernetwork) conditioned on additional information and metadata. Parameter composition.  We Module parameter generation.  Instead

Deep Learning 52

Deep Learning NLP Computer Vision Metadata 52

Sebastian Ruder

NOVEMBER 14, 2022

Initiatives   The Association for Computational Linguistics (ACL) has emphasized the importance of language diversity, with a special theme track at the main ACL 2022 conference on this topic. Writing System and Speaker Metadata for 2,800+ Language Varieties. Computational linguistics, 47(2), 255-308.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52

Sebastian Ruder

JUNE 6, 2022

The initiative focuses on making Computational Linguistics (CL) research accessible in 60 languages and across all modalities, including text/speech/sign language translation, closed captioning, and dubbing. We can also incorporate additional knowledge by modifying the training data, e.g., by inserting metadata strings (e.g.,

NLP 52

NLP Natural Language Processing Computational Linguistics Neural Network 52